1. Introduction
The resolution of ordinary optical microscope cannot exceed the optical diffraction limit [
1], which limits the observation ability of the microscope in the microscopic field. Super-resolution technology breaks through the limitation of the optical diffraction limit, and the imaging resolution is less than 200 nm, or even smaller by specific methods. The optical imaging system combined with super-resolution technology has become an indispensable observation tool in the biomedical field. At present, there are three methods to achieve super-resolution microscopy: Single Molecule Location Microscopy (SMLM) [
2,
3], Stimulated Emission Depletion Microscopy (STED) [
4] and Structured Illumination Microscopy (SIM) [
5]. The main principle of SMLM is to use a single emitter to randomly activate or switch in a continuous acquisition through a small subset of a specific dye or activated fluorescence. This method observes single-molecule switching events that are sparse enough to be identified, and then continuously collects the activated fluorescent molecules for super-resolution. The main principle of STED is to use the inhibitory effect of the loss light on the excitation light to greatly reduce the effective excitation area of the focal plane [
6,
7], then scan the sample, and obtain the super-resolution image through image reconstruction. Based on the principle of Moiré effect, SIM modulates the sample through the structural fringes with known frequency and phase, collects and processes the mixing signal, demodulates the frequency signal of the sample, and then expands the spectrum of the sample in the frequency domain. Compared with other super-resolution techniques, SIM has the characteristics of fast imaging speed, low phototoxicity and simple sample preparation. It has become a powerful tool for living cell biomedical research. Therefore, many research results have been proposed [
8,
9,
10,
11,
12,
13,
14,
15,
16,
17].
Due to the difference between theory and actual experiment, the modulation of structured light cannot ensure that its frequency and phase are exactly the same as the theoretical value. Therefore, the estimation of the modulation frequency and phase of structured light fringes have become a key step in SIM reconstruction. So far, many researchers have proposed frequency phase estimation algorithms to make the estimation of reconstruction parameters more accurate, thereby improving the quality of image reconstruction. In 2009, Shroff proposed the phase of peaks algorithm (POP) [
18]. This algorithm could correctly calculate the phase when the modulation contrast of the structural fringe was high enough and the spatial frequency was moderate, but its universality was poor due to the limitation of conditions. In 2013, Wicker proposed a cross-correlation iterative minimization algorithm that could provide correct phase estimation in most cases [
19]; however, this method was complex in calculation and had modulation restrictions. In the same year, Wicker proposed the autocorrelation iterative method. This method simplified the calculation, but the effect was poor when the image signal-to-noise ratio was poor [
20]. In 2017, Zhang proposed an algorithm for normalizing coefficients by calculating the modulation factor and initial phase of the illumination mode and obtained a better reconstruction resolution [
21]. In 2018, Cao proposed a phase estimation algorithm based on inverse matrix [
22], which could obtain the analytical solution of the phase without iteration. This method could also obtain the correct phase in the case of low modulation depth. In 2023, Qian proposed an efficient robust SIM algorithm based on principal component analysis, which achieved more accurate parameter estimation and anti-noise ability than traditional cross-correlation algorithm [
23].
When the high and low frequency components are separated, it is necessary to superimpose the separated frequency spectrum. Through a reasonable reconstruction algorithm to deal with the frequency spectrum of the overlapping part, the image artifacts can be reduced. In 2008, the generalized Wiener reconstruction algorithm was proposed, eight years after Gustafsson first proposed the concept of structured light super-resolution imaging [
24]. This algorithm realized the lateral super-resolution for the first time and became a classical algorithm in this field. In 1972, Richardson proposed an image reconstruction algorithm based on Bayesian iteration [
25]. In 1974, Lucy proposed an iterative technique of observation step-by-step correction [
26]. Based on these two methods, researchers proposed the R-L reconstruction method named by two researchers. The algorithm could make the image clearer after a certain number of iterations. In 2014, Chu proposed a TV reconstruction method [
27]. The reconstruction algorithm required less signal and thus reduced the photobleaching of the sample, and successfully improved the temporal resolution of the two-dimensional SIM by 15 times while maintaining the spatial resolution and image quality comparable to the traditional method. In 2017, Dan proposed a super-resolution reconstruction algorithm for optical slice images [
28]. After the analysis of the imaging principle, the defocused light in the imaging process was suppressed, and the signal-to-noise ratio of the image was improved, but the imaging resolution was suppressed to a certain extent. In 2018, Huang proposed a structured illumination deconvolution algorithm based on Hessian matrix [
29], which used the temporal continuity of biological samples as a priori knowledge to guide image reconstruction, and performs rolling reconstruction of the original image. At the imaging frequency of 188 Hz, the spatial resolution was increased to 88 nm, which greatly improved the spatial and temporal resolution of SIM. In 2019, Fei proposed a partial spectrum method [
30], which only needed 4 original images for reconstruction but did not improve the spatial resolution. In 2021, Zhao proposed a sparse deconvolution algorithm [
31], which used the prior knowledge of the sparsity and continuity of biological structures to increase the resolution of super-resolution microscopy by nearly two times. In 2022, Wang proposed a rapid reconstruction algorithm termed joint space and frequency reconstruction. By replacing Fourier domain operation with real space operation, the reconstruction speed is 80 times faster than Wiener reconstruction without losing image quality [
32]. The methods mentioned above have improved the imaging quality in different aspects, but they are not good at suppressing defocused light in the frequency domain.
The problem of artifacts in SIM super-resolution image reconstruction has always been a difficulty in this research field. In the supplementary document of the article, Huang made a comprehensive summary of the types and causes of artifacts in the current SIM super-resolution image reconstruction. When the sample moves too fast, motion artifacts will be generated. When the frequency and phase estimation of the modulated wave vector is inaccurate, ring artifacts will be generated. When the Optical Transfer Function OTF measurement of the optical system is inaccurate, snowflake artifacts will be generated. When there is a defocused background in the sample image, streak artifacts will be generated. The above artifacts can be overcome in different ways. Improving the image acquisition speed of the system can overcome the motion artifacts, accurately estimating the modulation parameters can overcome the ring artifacts and accurately measuring the OTF of the system can avoid snowflake artifacts. Streak artifacts can be removed by suppressing the defocusing background. The imaging depth by the total internal reflection imaging method is very shallow, so there is no defocusing background during data acquisition. At the same time, its imaging depth limits its observation of thick samples. Therefore, the method of using algorithms to suppress is more universal than the method of adjusting optical devices aiming to solve the problem of streak artifacts caused by defocusing background during thick sample imaging. However, many existing algorithms are not effective in suppressing such artifacts. As shown in
Figure 1 below, the streak artifacts in the circle area in the figure obviously lead to low signal-to-noise ratio of the image. Therefore, this paper proposes a structured light super-resolution image reconstruction algorithm combining Notch function (Notch SIM, N-SIM for short) for the streak artifacts caused by the defocused background.
By analyzing the mathematical model of structured light illumination imaging, a filter was designed to process the low-frequency signal in the imaging process. Under the condition of retaining the information of the image, the streak artifacts caused by defocused light in the imaging process were effectively suppressed, and the imaging quality of the image was improved. Mitochondria are organelles responsible for producing energy in organisms. They are the main place for cells to carry out aerobic respiration and are closely related to the state of cells. Long-term damage to mitochondria is shown to be associated with the occurrence of liver disease, and changes in mitochondrial function is confirmed in a variety of chronic liver diseases. Studies have shown that OSGIN1 allele imbalance is associated with the progression of liver cancer [
33]. The N-SIM algorithm proposed in this paper was applied to reconstruct the mitochondria and lipid droplets in mouse hepatocytes, and then the MATLAB development tool was developed to detect and identify the images. It was found that the mitochondria in OSGIN1 overexpressed cells were more active, and the interaction with lipid droplets was more obvious. This finding is very meaningful, indicating that the SIM system combined with N-SIM algorithm mentioned in this paper can provide a clear subcellular organelle observation platform for biomedical workers, which can visualize metabolic diseases.
2. Materials and Methods
The optical imaging system of a wide-field microscope was actually equivalent to a low-pass filter. Due to the limitation of optical diffraction, the process of imaging the sample actually truncated the high-frequency information (the fine structure of the sample) of the sample beyond the support domain of the optical transfer function (OTF), thereby limiting the spatial resolution of the imaging. The SIM could move high-frequency information to the OTF support domain to achieve super-resolution. The imaging principle is shown in
Figure 2.
The illumination light with spatial structure excited the sample in the SIM. Based on the principle of Moiré effect, the high frequency information of the sample (the detail information of the sample) that cannot be obtained under the wide-field illumination mode was modulated into the OTF support domain of the optical microscopy imaging system. Then, through the frequency domain signal demodulation, high and low frequency signal separation, shift, reconstruction and other steps could achieve a relative wide-field microscope imaging twice the resolution. In SIM, the cosine structured light is usually applied to illuminate the sample. The Fourier transform of the spectral expression of the SIM raw image is as follows:
where
is the OTF of the optical system,
represents the defocus signal,
is the imaginary unit,
represents the direction of the structured illumination light,
represents the initial phase of the structured illumination light. The spectrum of the original image contained not only the low frequency component
, but also the high frequency components
and
.
is the low-frequency information of the sample after the deconvolution operation.
and
are high-frequency information of samples after deconvolution. The spectrum of this part contained the detailed (super-resolution) structure information of the sample. Since the OTF of the system was actually constant, the structured light illumination method using cosine mode was also limited by diffraction. Therefore, in general, the modulation frequency
of the cosine structured light would not exceed the cut-off frequency
of the system OTF, so the highest frequency of the sample that the system could observe in this case was
.
Through the above methods, the resolution in one direction can be improved. If the super-resolution of the image in the whole plane is needed, the structural fringes need to be rotated
and
, respectively, for the same operation. By obtaining three original images with a phase interval of
, the equations could be constructed. As shown in
Figure 2, the high-frequency components and low-frequency components in each direction could be obtained by solving the following equations. As shown in Formula (2):
In general, the observation sample of the optical microscope was thin after special preparation. However, the samples used in dynamic imaging of living cells were thick, this inevitably produced defocus noise. If the defocus signal was not suppressed, it would have produced streak artifacts in the process of image reconstruction [
28], affecting the imaging quality. The schematic diagram of the imaging process is shown in
Figure 3.
From the Equation (1), it can be seen that the low frequency signal and defocus signal of the collected sample had the same frequency range, so the Equation (1) can be rewritten as follows:
Therefore, the defocus signal only affected the low frequency spectrum of the sample spectrum and did not affect the high frequency signal. In the frequency domain, the defocus signal and the low frequency spectrum were mixed together, so the appropriate processing of the low frequency spectrum could achieve better defocus signal suppression.
In this paper, based on the generalized Wiener reconstruction algorithm, the reconstruction algorithm expression was rewritten appropriately. A notch function was added to the equation to limit the defocus signal in the low frequency spectrum. The generalized Wiener reconstruction expression is as follows:
where
is the final super-resolution reconstruction image,
is the conjugate of the optical transfer function in the direction of each structural illumination stripe,
is the high and low frequency spectrum component, when
is equal to 0, it is the low frequency spectrum, when
is equal to
, it is the high frequency spectrum,
is the Wiener parameter, ifft is the inverse Fourier transform operation,
is the apodization function, the Equation (4) is rewritten as follows:
where
is a notch function introduced to suppress the low frequency spectrum. By controlling the parameters of
, the effective spectrum information can be retained and the defocus signal in the low frequency spectrum can be suppressed. The function form of the notch filter mentioned in this paper is as follows:
The above Equation (6) is the expression of the two-dimensional Gaussian function, which can be transformed to a notch function by the following Equation (7), and the notch degree can be controlled by controlling the parameter
of the Gaussian function.
where
represents the maximum value of Gaussian function.
4. Discussion
OSGIN1 gene has a strong tumor suppressor function, mainly encoding oxidative stress proteins involved in the regulation of cell death [
34]. Therefore, it is of great significance to study the expression of OSGIN1 gene in cells to overcome the disease. The sample cells in this paper were OSGIN1 gene overexpression cells, and normal cells are control groups for experiments. The difference between mitochondria and lipid droplets in OSGIN1 gene overexpression cells and normal mouse hepatocytes is explored in this chapter.
4.1. Sample Preparation and Data Acquisition
The sample cells in this paper were purchased from the American culture library (Rockville, MD, USA), cultured in a basal medium supplemented with 10% fetal bovine serum and ITS-G (5 mg/mL insulin, 5 mg/L transferrin, 5 μg/L selenite), cultured in an incubator containing 5% carbon dioxide (37 °C), and using oleic acid and palmitic acid in 75% ethanol. The mixture was heated to 55 °C and completely dissolved for membrane formation. Lipid droplets and mitochondria in mouse hepatocytes were then stained with Bodipy493/503 and Mito-tracker Red CMXRos, respectively. Membrane formation and staining were performed in a confocal dish.
Sample data acquisition through the optical system mentioned above. The CMOS camera collected 9 original images, the sampling interval was 5 ms, and a set of pictures is collected every 30 s. Then the N-SIM algorithm mentioned in the paper was used to reconstruct the image to achieve image super-resolution. After reconstruction, a dynamic image with a time resolution of 30 s could be obtained.
4.2. Data Analysis
The OSGIN1 gene overexpressed cells and normal cells were subjected to structural illumination imaging, and the collected data were super-resolution reconstructed with the N-SIM algorithm. The time interval between each frame of images was 30 s. The mitochondria in each frame of images were observed. The results are shown in
Figure 11.
It can be observed from
Figure 11 that the mitochondria in normal mouse hepatocytes had less morphological changes from 0 s to 210 s, while the cells with OSGIN1 gene overexpression had more frequent mitochondrial morphological changes over time, resulting in mitochondrial fission and fusion. Applying the tool (mainly using image enhancement, connected domain analysis, circle detection and other methods, which are implemented by us through MATLAB) identified and counted the mitochondria in the collected cell images, the results are shown in
Figure 12a,b. From the diagram, it can be seen that the number of mitochondria in normal cells changed more smoothly than the number of mitochondria in OSGIN1 gene overexpressing cells, indicating that the number of mitochondrial fusion and fission events in OSGIN1 gene overexpressing cells was more, so the mitochondrial activity of OSGIN1 gene overexpressing cells was stronger. From the results of immunoblotting in
Figure 12c, the specific proteins in the same number of normal cells and OSGIN1 gene overexpressed mouse hepatocytes were analyzed, respectively. GAPDH was an intracellular reference, which could ensure the same number of cells in the experiment. Under the condition of the same number of cells, the OSGIN1 protein contained in the OSGIN1 gene overexpressed cells was more than the same protein in the normal cells, which was in line with the logic of the experiment. In this case, we tested the PPIF (mitochondrial-specific protein) in the sample and found that the total amount of mitochondrial proteins in the two cells was basically the same. Then, the lipid droplet protein (PLIN2) on mitochondria was detected. It was found that the lipid droplet protein on mitochondria of OSGIN1 gene overexpression cells was significantly more than that of ordinary cells, which indicated that the interaction between mitochondria and lipid droplets in OSGIN1 gene overexpression cells was more active.
In hepatocytes, mitochondria interact with lipid droplets, so the activity of mitochondria also has a great influence on the state of lipid droplets in cells. The samples were observed using a 100× objective lens. After image reconstruction, it was found that there were more and larger lipid droplets in normal mouse hepatocytes, and the morphology of lipid droplets in OSGIN1 gene overexpressed cells was smaller and less, as shown in
Figure 13a,b.
In this paper, MATLAB software was applied to realize lipid droplet recognition and size detection. The size distribution of lipid droplets in normal mouse hepatocytes and OSGIN1 gene overexpressed hepatocytes was obtained as shown in
Figure 13c. It could be found that there are lipid droplets with a radius of more than 1.1
in normal cells, while the radius of lipid droplets in OSGIN1 overexpressed cells was all less than 0.9
, and the number of lipid droplets with a radius of 0.9
in normal cells was significantly higher than that in OSGIN1 overexpressed cells.
4.3. Phenomenon Analysis
Via data collection and reconstruction, it was found that OSGIN1 gene overexpressed cells had stronger mitochondrial activity. Specifically, during the same time, the number of mitochondria in OSGIN1 gene overexpressed mouse hepatocytes changed greatly, while the number of mitochondria in normal mouse hepatocytes was relatively more stable. It was also shown that there were more mitochondrial fission and fusion events in OSGIN1 gene overexpressing cells than in the normal cells.
In addition, mitochondria in OSGIN1 overexpressed hepatocytes significantly promoted the decomposition of lipid droplets. This is evidenced by more and larger lipid droplets in normal hepatocytes than in OSGIN1 overexpressed hepatocytes. This observation is further confirmed by biological experiments, which verify the reliability of the system and N-SIM algorithm mentioned in this paper.
5. Conclusions
In this paper, a Wiener reconstruction algorithm combined with notch function is proposed by analyzing the principle of generalized Wiener reconstruction algorithm. Through the processing of the low frequency part in the reconstruction process, the streak artifacts caused by defocused light in the image reconstruction process are successfully controlled, and the lateral resolution of 144 nm is realized, which improves the imaging quality of image reconstruction. The structured light super-resolution image reconstruction software is developed by MATLAB, which integrates the two existing reconstruction algorithms and the reconstruction algorithm proposed in this paper. In the experiment, it is found that the activity of mitochondria in OSGIN1 gene overexpressed cells is higher than that in normal cells, and the decomposition of lipid droplets is more obvious. For the two organelles of mitochondria and lipid droplets, an image recognition detection program is developed by MATLAB.
The N-SIM algorithm proposed in this paper suppresses the defocused light in the imaging process. However, the imaging resolution of the system is not improved, and the reconstruction time of the algorithm is long (512 × 512 pixels, CPU i5-10300H, GTX 1650 4 GB, RAM 16 GB, the whole calculation process takes about 9 s). Camera with smaller pixels can be applied, and the algorithm process can be optimized to improve the efficiency of software operation.
In summary, this paper provides a stable and reliable observation platform for biomedical researchers for mitochondria and lipid droplets in biological cells.