5.2. Case 1: Single Identification Process for One Reference Star
To analyze the performance of the algorithm, simulations were carried out for three different cases. The first case was to measure the fundamental performance of each algorithm as it performed star identification for a single reference star. In this case, the identification rates and average number of misidentified stars were provided to allow comparison of the proposed algorithm with others. The positional error was introduced as a single noise source via random Gaussian noise with
ranging from 0 to 150 arc-seconds. The simulation was performed 10,000 times at each noise level.
Figure 10 shows plots of the identification rates and number of misidentified stars.
As shown in the first result plots, the new algorithm features identification rates far superior to those of other algorithms with respect to position error. Despite not using all the surrounding stars, the new algorithm provides more reliable identification rates, and it also shows the least number of misidentified stars at all noise levels. This result is attributed to the use of more complicated patterns. These become more robust against position error by appropriately giving one more degree of freedom to the cell index. The results at 150 arc-seconds position error are listed in
Table 7 to facilitate comparison of the algorithms. It is noteworthy that the identification speed of the proposed methods is much faster without the need for the look-up table technique. The proposed method takes about 1.35 ms for a single identification process, which is similar to grid and modified grid algorithms. These results are achieved by efficiently reducing the number of candidates in the initial matching stage so that only a small part of the database is searched. Our database consists of 5850 stars and 87,330 associated patterns, so that 87,330 candidates exist prior to the initial step. After the initial match, the average number of remaining candidates in the database is only 147.8—A significantly reduced number compared with the size of the original database. Thus, one can conclude from the simulation results that the proposed method could provide more favorable performance for this error type in terms of identification rates, as well as providing the lowest erroneous matching.
5.4. Study Parameters for the Proposed Method
The proposed algorithm creates a database that includes the six nearest stars. This is one of several redundant strategies to enhance the capability of the algorithm because the pattern of the reference star is generated using the five nearest stars. However, the image pattern was also modified to be generated using the six nearest stars as with the database strategy. Then, the five sets of computed patterns (
Figure 9) were expanded to produce 15 sets of an extended pattern. This modification is examined in the Case 2 simulations. The results are shown in
Figure 12, in which np5 and np6 mean the case using the nearest five and six stars, respectively.
In the result plots, success rate and average number of identified stars are clearly improved by using the extended pattern from the six nearest stars. The resulting parameters at 150 arc-seconds are listed in
Table 9. Although the running time of the algorithm increased from 16.54 to 24.91 ms, the important thing is that it maintained the same level of misidentification. Thus, the algorithm can provide enhanced performance when the reference star pattern is created utilizing the nearest six stars.
5.5. Case 3: Overall Performance for the Entire Image
The Case 3 simulations compare the overall performance of the algorithms for the entire image when a false star exists with a position error. Unlike in the previous section, the simulation performed the identification procedure for all the stars imaged to measure the overall performance, while the position error was fixed at 150 arc-seconds. In the Case 3 simulations, the pyramid algorithm was excluded due to its lack of robustness, and the proposed algorithm used star identification with patterns produced using the both five and six nearest stars for performance comparison. Another desirable ability of a star identification algorithm is reliable performance regardless of the FOV size. This was tested in this case by changing the camera to achieve narrow and wide FOVs. In the case of a wide FOV, the image resolution changed to 1024 1024 pixels (twice that of a narrow case), so that the FOV was enlarged from 12.09° to 23.98°.
In contrast with the previous simulations, the false stars appeared at random locations within the FOV and the number of the false stars was increased from 1 to 10 in both cases. In addition, the false stars were assumed to be false negative error so that they did not exist in the database. All the simulations were performed 10,000 times for each false star number. The average run time, number of correctly matched stars, and number of misidentified stars are presented to demonstrate the effectiveness of the proposed algorithm in more complicated situations. The memory usage of all methods is compared at the end of this section.
First presented are the results of the narrow FOV case (Case 3-1 in
Figure 13). The success rates of all algorithms tend to decrease with increase in the number of false stars. These results are incurred by the probability that the spurious stars are likely to generate patterns entirely different from the stored one. In dynamic situations, this error factor is inevitable, but the proposed method can handle such cases due to its pattern complexity and matching strategy.
The resultant parameters for the presence of 10 false stars and 150 arc-seconds position error are summarized in
Table 10. The average number of stars is about 26.4 in the narrow FOV including 10 false stars. When we consider that the number of true stars is about 16.4 compared with 10 false stars, this would be a very challenging condition under which to identify stars. One can observe that the proposed algorithm produces a remarkable performance in the number of correctly identified stars. Furthermore, it should be noted that a failure to match is preferred to the mismatching of stars in the identification process, regarding later navigation. This makes obvious that this method is more appropriate for dynamic conditions because the number of misidentified stars remains at the lowest level, even with increase in the number of false stars.
The second results are of the wide FOV case (Case 3-2 in
Figure 14). The average number of stars in one image is increased significantly (relative to the narrow FOV). As more stars are included to be identified, greater differences in the number of misidentified stars and identification time results. The results from the comparison based on 150 arc-seconds position error with 10 false stars are presented in
Table 11.
When the FOV contains about 73 stars, the identification time of the proposed algorithm is 0.18 s (np5) and 0.40 s (np6), which is dramatically shorter than the 2.89 s of the grid algorithm, 5.26 s of the modified grid algorithm, respectively. These results imply the advantage of patterns using fixed number of stars: It makes the identification time almost linearly proportional to the number of stars. We can see that the identification time of the grid and modified grid algorithm increases more steeply in the wide FOV case because their patterns are based on the surrounding stars. From the results, we can recognize that proposed initial matching scheme is more efficient than a look-up table generation in other pattern matching algorithms. Thus, the proposed method could make the algorithm more reliable for high-rate applications, with faster run-time as well as robust performance.
In this study, a performance indicator is also proposed to facilitate the comparison of each algorithm. The performance indicator is defined by taking into account a subsequent attitude determination and navigation purpose. It is because a larger number of correctly matched stars directly affect the accuracy and reliability of systems, that one can consider the ratio between the average numbers of correctly and incorrectly matched stars. In addition, the average number of stars in the FOV could be slightly different due to arbitrary bore sight directions, so the ratio is divided by this value. Here, the performance indicator can be given as
The defined performance indicator of each algorithm is shown in
Figure 15 and summarized in
Table 12. As one can see in the plots, the proposed method exhibits the best performance for both narrow and wide FOV, and the difference grows more distinct for the wide FOV. Although the fixed number of stars is used for the pattern generation, the proposed method can preserve the least mismatched star numbers to provide additional opportunities for star identification trials. This could be one significant contribution of our algorithm, that a highly reliable navigation system could be developed by minimizing the adverse effect of incorrectly matched stars.
Memory usage is also an important parameter for on-board algorithm implementation. The memory usage of all methods is summarized in
Table 13. The proposed method requires 2275 and 2347 KB for the databases of Case 3-1 and 3-2, which are larger than those required for the grid and modified grid algorithms. This is because the proposed algorithm stores the extended fifteen sets of patterns for each reference star. However, the bigger database size is necessary to provide a feasible solution in a dynamic situation. One more issue regarding memory usage is that the memory usage of the proposed algorithm will not increase with the FOV because its result relies upon a fixed number of stars to construct the pattern. Only the grid and modified grid algorithms showed an increase in their memory usage for wide FOVs.