1. Introduction
With the development of computer-based visual simulation technology, infrared imaging simulation has received increasing attention. Many integrated scenario infrared visual simulation systems have been developed abroad [
1,
2,
3,
4,
5,
6]. These systems play an important role in the design and evaluation of sensors. Space targets are often observed as point targets on images due to their distance from sensors, making it challenging to obtain complete and accurate data. Therefore, simulation is necessary to supplement real data. The Systems Tool Kit/electro-optical and infrared sensors (STK/EOIR) module takes into account the interactions between sensors, targets, and the environment to establish a customizable, high-confidence optoelectronic sensor model. This model can provide accurate data support for the simulation of spatial point target groups. One study [
7] provides an overview of the simulation process of this module and analyzes the simulation results. However, it does not address the performance overhead that this module brings to system operation during calculation. At the same time, STK has limitations with respect to simulation objects. For example, when the target is in deep space with stars as the main background element, users can only make simple adjustments based on the software’s built-in star catalog. Additionally, detailed infrared simulation results are only displayed within the software and cannot be output together with the simulation images. This makes it difficult to create datasets for follow-up target detection and recognition algorithms.
In the area of stellar research, several publicly available infrared star catalogs have been established by missions that observe stars [
8,
9,
10,
11,
12,
13]. They provide precise materials for stellar simulations. Huang et al. [
14] analyzed various all-sky survey programs and their generated infrared catalogs, selected suitable stars for astronomical infrared calibration, and integrated atmospheric effects. Wang et al. [
15] proposed a method of stellar energy extrapolation for multiple catalog data and calculated the relationship between magnitude and point source irradiance. Miao et al. [
16] obtained the stellar backgrounds of different observatories in the visible range by using the Hipparcos catalog with space time conversion. Li et al. [
17] and Hong et al. [
18] developed a radiative generation model of the starry sky point source background based on the MSX catalog and simulated images in the corresponding wavelength bands, emphasizing the spatiotemporal accuracy of star background generation. However, these studies did not address the efficiency of visual simulation or the presence of targets in the scenario.
STK provides two connection modes to aid users in secondary development. Early system development is generally connected through Connect mode. Zhang et al. [
19] designed a multi-target flight simulation system with micromotion characteristics using MATLAB and STK. Li et al. [
20] delved into the method of system integration between Visual C++ (VC) and STK to realize the combination of STK simulation and VC data analysis. Huo et al. [
21] improved the Connect mode calling method to reduce the complexity of type conversion. Zhang et al. [
22] used High-Level Architecture (HLA) to solve the problem of rapid integration of verification systems in space orbit through the interconnection of VC and STK. Owing to the many inconveniences of using Connect mode, the newly introduced component object model (COM)-based approach has been gradually adopted by external systems to complete connection and control work in recent years. Zhang et al. [
23] analyzed the applicable scenarios of MATLAB under the two development approaches and simulated the Global Navigation Satellite System (GNSS) constellation. Guo et al. [
24] implemented a three-dimensional scene display for radar simulation based on Microsoft Foundation Class (MFC) and COM. Chen et al. [
25] established an STK-based spatial posture simulation system. These visual simulation scenarios, in combination with STK, focus on analyzing the motion and coverage of satellites. When the sensor is operating under the EOIR module, Zhou et al. [
26] proposed a simulation method for simulating the infrared imaging of space-based infrared system to point source targets and analyzing their characteristics. Cao et al. [
27] used it to generate sequence images and proposed an algorithm for detecting spatial targets in and out of the field of view of the sequence frame images. Clark et al. [
28] used it to compare the simulation results with their own starfield simulator, and mentioned performance problems of STK during target group simulations; however, they did not solve the performance issue of this module in simulating image output which is very important for real-time visual simulation [
29,
30,
31,
32].
The current system has the following main issues: the simulation performance does not match the actual needs, there are limited options for star catalogs, and it is difficult to construct complex scenes. Thus, we construct a space-based infrared point target simulation system to improve performance and practicality. We decompose the EOIR simulation flow and build a lookup table to improve the background simulation efficiency; use external MSX catalogs to generate stellar backgrounds, improving the scalability of the system; and use COM mode to connect STK to adapt to complex simulation needs.
3. Star Background Simulation
Given that the simulation scenario spans less than one day, the change in the position of stars relative to Earth can be considered negligible. Thus, the initial position of each star can be assumed to be static throughout the simulation. The process for simulating the star background is illustrated in
Figure 4. Firstly, we read the data from the MSX catalog to obtain the initial position and the proper motion of the star. Next, we calculated both the right ascension and declination of the star at the beginning of the simulation, and the infrared magnitude of stars at different wavelengths. This information is stored in a database that adopts the format of latitude/longitude grid-latitude band, which enhances the efficiency of the background simulation module as it facilitates the search for stars in the FOV based on the optical axis point.
3.1. Star Catalog Selection
In practical applications, the background for space targets primarily consists of deep-space and various objects present in the universe. Given the limited FOV of sensors, we selected deep-space and stars as the background. Since the distance between stars and the Earth is vast, they can be considered as point targets in theory. The selection of a star catalog depends on the target’s equilibrium temperature and the sensor’s waveband range. In practice, the equilibrium temperature of the target is generally around 300 K, and the waveband range of the real sensor is generally medium wave or long wave. The MSX catalog provides spatial data, including the orientations and proper motions of 177,860 stars, as well as irradiance data ranging between 4 and 22 μm, making it a more suitable source of simulation data than other catalogs.
3.2. Infrared Magnitude Calculation
In the MSX catalog, the brightness of stars is represented by Jansky (
Jy), which is denoted by
[
14].
where
Jy is the unit of spectral flux density,
W is the unit of power and
m is the unit of length.
Irradiance within a specific wavelength band is denoted as
and measured in W⋅cm
−2⋅μm
−1, and the conversion relation is [
14]:
where
c is the speed of light and its value is 3 × 10
8 m/s;
λ is the wavelength.
In astronomy, we commonly use equivalent magnitude to represent the brightness of celestial bodies. Therefore, we converted the brightness of stars to equivalent magnitude for storage and calculation [
15]. Infrared magnitudes are established with reference to apparent magnitudes. The infrared magnitude of the requested star
s1 is represented as
m1. The irradiance of the zero-magnitude star and the star are represented as
and
, respectively. We can then express the relationship between these values using Equation (3):
By combing in Equations (2) and (3), it is possible to directly convert from the catalog
Jy to the corresponding infrared magnitude. This conversion provides a straightforward method for determining the brightness of stars in infrared wavelengths:
The relevant information from this catalog is presented in
Table 1, including the number of stars with the same brightness in different infrared bands, as shown in
Figure 5. Owing to the difference in the wavelength bands, there is a significant difference in the radiant fluxes corresponding to zero magnitude stars in band A and band C. However, the difference between band A and band C is not significant in terms of the number of stars of different magnitudes by calculation. Stars observed in the infrared band at each magnitude are one order of magnitude higher than those in visible light. Therefore, the influence of stars in the background should not be ignored.
3.3. Lookup Table Design
The actual position of the star during the simulation time may not match the catalog owing to the motion of both the star and the Earth. Therefore, before the simulation starts, it is necessary to conduct spatial and temporal processing of the catalog. In our system, we mainly considered the effects of the proper motion of stars. Equation (5) calculates the right ascension and declination of the star at the beginning of the simulation in the J2000 coordinate system [
18]:
where
and
are the right ascension and declination of the star at the simulation moment. The values
and
are the right ascension and declination recorded by the catalog. The values
and
denote annual proper motion of the right ascension and declination. This,
, is the time difference between the simulation moment and the initial moment in years.
Additionally, the uneven distribution of stars in the catalog means that processing all the data in each frame would take excessive time. To address this issue, star sensors often use star map partitioning to accelerate the star detection process. For our database, we adopted a common partitioning method used in the field [
36]. A longitude–latitude grid is used when the latitude along the optical axis is less than 60°, with one grid per degree; other high-latitude regions adopt a latitude band division with one band per degree of latitude. We created a two-dimensional array of size 360 × 180 to reduce the time complexity from O(n) to O(1) by space for time. This corresponding grid can be loaded based on the sensor’s optical axis point and FOV size; the required data can be obtained through deserialization, avoiding the traversal of the catalog during simulation. Because the array stores star data of high-latitude regions in the first grid corresponding to the latitude, it also avoided complex cross-region issues. The three catalog division methods are shown in
Figure 6.
3.4. Star Brightness Calculation
We calculated the stellar dynamic range using the specifications of the Space Infrared Imaging Telescope (SPIRIT III) sensor on the MSX satellite. This instrument underwent sufficient corrections before the measurement to ensure the accuracy of the results. Equation (6) shows the exact calculation, where the dynamic range of the star is determined by its own irradiance and the sensor noise equivalent irradiance (NEI) and saturated equivalent irradiance (SEI) together.
where
and
are the dynamic range and magnitude of the star,
is the dynamic range of the sensor, and
and
are the irradiance of the 0-magnitude star and target star, respectively. For instance, in the case of the C band in the MSX catalog, stars with magnitudes less than 4 are not relevant and can be ignored during storage, which simplifies subsequent star filtering. The relevant information is presented in
Table 2.
The diffraction effect causes the star’s infrared radiation to be imaged as a point with a certain area as it passes through the optical system. To improve the accuracy of the simulation’s background, we considered the primary diffraction spot in the background simulation and assumed that the energy of the star obeys a Gaussian distribution in Equation (7) within the spot [
37].
where
are the coordinates of the target on the sensor, and
is the standard deviation which indicates the width of the point diffusion.
The radius of the Airy spot is given by Equation (8). Combining the pixel pitch of the sensor, we can calculate the size of the Airy spot and the gray values of different pixels based on the dynamic range of the star.
where
λ is the wavelength,
L is the focal length, and
D is the diameter of the optical pupil.
5. Results and Discussion
The improvements of proposed method compared to others are shown in
Table 8. In terms of simulation performance, while the original techniques excelled in establishing simplistic space-based infrared simulation scenarios and presenting results in an intuitive manner [
7,
29], they encountered challenges when confronted with complex scenarios. Furthermore, they lacked support for fast infrared simulation output. Conversely, the proposed method achieved real-time simulation of space-based sensors on space point targets, thereby enhancing its practicality. In terms of background generation, the original STK-based methods could generate star backgrounds without requiring complex setups [
7]. However, the absence of customization options for star catalogs and the inability to export star simulation results limited their practicality. Other star background simulation methods accurately calculated star positions [
17,
18], yet they did not provide further discussion of spatial targets within the FOV. In this regard, the proposed method generated high-quality star background for the targets, effectively compensating for STK’s deficiency in star simulation. In terms of target features, the original techniques primarily focused on the influence of target attitude while setting the temperature to a fixed value or a linear function of time [
7,
37,
41,
43]. In contrast, the proposed method embraced a dynamic temperature model and accounted for the impact of micromotion during the simulation process. In terms of development mode, the original methods fulfilled their specific application requirements through secondary development of STK, leveraging its data analysis capabilities [
20,
21,
22,
23], but they did not mention the program maintainability and expandability. The proposed method employed contemporary tools and connection modes to enhance the system’s scalability. In short, we established the foundation of a modern space-based simulation platform.