2. Materials and Methods
Prior to the launch of L7 and its ETM+ sensor on 15 April 1999, the USGS developed and built the IAS to calibrate and characterize the L7 spacecraft and the ETM+. Since that time, the mission of the IAS has expanded to include all Landsat missions and instruments with respect to calibration and characterization. This expansion included the ability to calibrate and characterize the L8 spacecraft and its instruments the OLI-1 and the TIRS-1, and then in late 2021 the L9 and the OLI-2 and TIRS-2 instruments. Due to the similarity in the spacecrafts and instruments the steps involved, the L9 commissioning and its instruments were the same as that of L8. This paper briefly describes the steps involved with the commissioning of L9 from a geometry perspective. Further information on the calibration steps performed during commissioning can be found in the L8 and L9 Algorithm Description Documents (ADD) [
22].
The geometric calibration of the L9 spacecraft and its instruments involve a specific set of steps that need to be performed in a specific order. Because many of the geometric calibration procedures rely on being able to register new OLI-2 acquisitions to ground reference images, an initial coarse alignment calibration between the OLI-2 pan band and the spacecraft attitude reference is used to achieve an absolute instrument pointing accuracy sufficient to allow automated ground control point mensuration. The basis for the absolute calibration of all instruments onboard L9 relies on a calibrated OLI-2 pan band, therefore the first priority for geometric calibration is to perform the OLI-2 Focal Plane Alignment on the pan band. With the pan band representing the highest resolution band among all instruments aboard L9, this band allows the best mensuration accuracy, and establishes a reference for all lower resolution bands. Once the OLI-2 pan band has its SCAs calibrated, both relative to each other and with respect to the attitude control reference system the next step is to align the OLI-2 multispectral bands to the OLI-2 pan band using the OLI-2 band-to-band alignment calibration procedure. Once the OLI-2 bands are calibrated, the next step is to improve the geometry of the TIRS-2 10.9 µm band by measuring it against the OLI-2 SWIR-1 band using the TIRS alignment calibration procedure. The OLI-2 SWIR-1 band is used as a reference for the TIRS instrument as this band’s center wavelength, 1.6 µm, closely aligns with that of the TIRS-2 10.9 μm center wavelength. Although these two bands center wavelength, and band passes, are not an ideal match when performing the image correlation during the mensuration step, they have been found to produce the best results among all the band combinations. This step simultaneously improves the 10.9-μm band internal geometry by aligning the SCAs and registers the TIRS-2 band to the OLI-2 SWIR-1 band. Once the OLI-2 pan band is calibrated both absolutely and internally, the OLI-2 multispectral bands are aligned to the pan band, and the TIRS-2 10.9-µm band is aligned to OLI-2 instrument, the final geometric calibration step is for the TIRS-2 10.9-µm and 12-µm bands to be aligned (TIRS-2 band-to-band alignment). A step that was mentioned briefly above but is a key part of the initial and final Focal Plane Alignment, involves aligning the pan band’s optical axis to the spacecraft’s Attitude Control System (ACS). This OLI-2 focal plane to ACS alignment, which calibrates the overall absolute pointing of the pan band, allows in turn, an absolute pointing calibration to be transferred to all the other lower resolution bands (including the TIRS-2 bands).
All analysis that follows within this paper is based on a set of acquisition dates from 31 October 2021 to 31 December 2021 which defines the geometric commissioning period for the L9 spacecraft and its instruments. The results shown that were measured with respect to the Geometric Supersites ground control, using the Geodetic and Geometric Accuracy assessments, are performed to assess whether the spacecraft, the instrument, and the system requirements are met. The results shown involving the GLS ground control, and the Geodetic and Geometric Accuracy assessments, are performed to demonstrate what can be expected from a geometric product accuracy standpoint. The Focal Plane Calibration procedure is based solely on Geometric Supersite locations whereas the band-to-band and instrument-to-instrument calibrations are based on both GLS and Geometric Supersite ground control. In these operations, performed only after Focal Plane Calibration has been completed, the slightly degraded accuracy when using the GLS ground control does not affect results. All calibration and characterization steps are performed based on a scene selection that is dependent on being able to correlate and achieve good mensuration results across all band wavelengths used within the calibration steps and across the full extent of the imagery. This requires cloud-free imagery, typically less than 5%, and ground features that correlate well between the Geometric Supersites and OLI-2 pan band or that correlate well across the corresponding band combinations that are being calibrated, for example, OLI-2 band 6 and TIRS-2 band 10 for OLI-to-TIRS alignment.
3. Results
The OLI-2 and TIRS-2 swath width have a requirement to cover a minimum of 185 km and for the TIRS-2 instrument to be contained within the field of view of the OLI-2 instrument. Related to the swath width, is a requirement for there not to be any data gaps between the adjacent SCAs within the bands of each instrument. The Landsat standard data acquisition schedule is dependent upon the sun elevation angle, eliminating high latitude scenes from being acquired during the commissioning time frame, which occurred over the winter months. Because the swath width and SCA-to-SCA overlap effects are both dependent upon within orbit location, as both are influenced by the satellite flight path angle and orbit height, the lack of high latitude scenes limited the range of available test data. As a result, scenes at mid-to-high latitudes and at the equator were inspected for swath width, between-sensor coverage, and SCA overlap. An example of one of the images inspected for these requirements is shown in
Figure 8 where a combination of blue, SWIR-2, and the TIRS-2 10.9 µm band are shown as a red-green-blue (RGB) image. The overlap in the multispectral OLI-2 bands with respect to the TIRS-2 band can be seen in the figure, demonstrating that TIRS-2 is contained within the field of view of OLI-2. The measured swath width upon inspection of the imagery was found to be, at the equator, 189.96 km for OLI-2 and 186.66 km for TIRS-2. A caveat to this method in measuring an L1TP product for the instrument’s swath width is that the L1TP imagery is trimmed by a few pixels at the extremes of the eastern and western portions of the image, when a data set is framed to a map projection and resampled to a nominal 30 m pixel spacing, the actual instrument swath width is thus slightly larger than this visually measured coverage extent. For determining the overlap between adjacent SCAs, the Legendre LOS polynomials were first inspected for the angular overlap between adjacent SCAs, a plot of which is shown in
Figure 9 for the OLI-2 instrument. This analysis found at least 23 multispectral pixels of overlap between adjacent SCAs. The odd-to-even pattern in the plot is due to a small yaw component in the instrument alignment to the optical axis. As the between-SCA overlap is affected by the flight dynamics of the spacecraft due to altitude changes and a within orbit, latitude based, yaw steering is applied to the spacecraft, with the yaw steering providing a better alignment of the spacecraft’s ground velocity vector to its direction of flight. A visual inspection was also performed to ensure adequate SCA-to-SCA overlap by looking for fill data between adjacent SCA boundaries. Through both a visual inspection and an inspection of the Legendre LOS coefficients, no gaps between SCAs within the individual bands were found. The same overlap analysis between adjacent SCAs was performed for the TIRS-2 instrument and those results are shown in
Figure 10.
Absolute geodetic accuracy refers to the geolocation accuracy of geometrically corrected products prior to the application of ground control points, taking into account terrain effects, and is most often associated with the absolute pointing accuracy of the spacecraft and instrument. The absolute geodetic accuracy is primarily dependent on the accuracy of the spacecraft telemetry, specifically the spacecraft’s ephemeris and attitude information, and the ability to align the OLI-2 focal plane optical axis to that of the spacecraft’s ACS. For example, the parameters associated with alignment between the OLI-2 focal plane optical axis and the spacecraft ACS are determined through the Sensor Alignment algorithm. Relative geodetic accuracy refers to the internal accuracy of the geometrically corrected products prior to the application of ground control points while taking into account terrain effects. Both geodetic accuracy requirements are primarily dependent upon the spacecraft performance of its telemetry but also involve the OLI-2 instrument pointing knowledge (thermal) stability, which translates to its LOS stability over time, the ability to align the OLI-2 pan band to the spacecraft ACS, and the ability to align each SCA within each instruments focal plane. Once an SCA alignment for the pan band is performed, an OLI-2 instrument band-to-band alignment can be performed aligning all other OLI-2 bands and their SCAs to the calibrated pan band. Once an alignment of the OLI-2 bands is achieved, the SCA alignment of the TIRS-2 thermal bands can be performed. The combination of these steps, specifically with the OLI-2 pan band being fully calibrated, achieves the final post-calibration geodetic accuracy results for the system of both instruments for all bands.
The results from the Sensor Alignment calibration procedure, and the corresponding calculated roll, pitch, and yaw interior orientation parameters, determined both during pre-launch testing and during the commissioning period are shown in
Table 1. With respect to the sensor alignment L9 requirements, the alignment control requirement is 4 milli-radian (mrad), the post-launch requirement for co-alignment between instruments is 7 mrad, and the alignment knowledge requirement is 2 mrad (pre-launch). All of these alignment requirements, pre-launch, and post-launch, were met (
Table 1).
As discussed previously, Focal Plane Alignment aligns the pan band SCAs, from both an absolute and relative perspective, based on measurements between the L1TP imagery and Geometric Supersites. Once this step is performed an OLI-2 band-to-band calibration can be performed, adjusting the OLI-2 multispectral bands to align those bands to the calibrated pan band, SCA-by-SCA. The combination of these two steps determines the new, post-launch, LOS calibration parameters for all the OLI-2 bands and their SCAs. This set of LOS calibration parameters are updates to the existing pre-launch Legendre Coefficients stored in the CPF. The mean adjustment for each of the OLI-2 bands LOS, in both the along and across track direction, between the pre-launch and the post-launch commissioning calibration parameters, are shown in
Figure 11 and
Figure 12. The results shown are listed in micro (µ) radians where 42.5 µ radians is one nominal multispectral Instantaneous Field of View (IFOV).
Figure 13 and
Figure 14 show the same mean adjustments but for each of the TIRS-2 bands. The nominal IFOV for the TIRS-2 bands is 141.86 µ radians.
Focal Plane Calibration must be performed to ensure a fully calibrated pan band, which is needed to achieve calibration of the multispectral OLI-2 bands and the TIRS-2 bands. One method for quantifying the results of the Focal Plane Calibration, to ensure that adequate results have been obtained so that the other instrument bands can be calibrated, is to perform (in some cases recalculate) Focal Plane Calibration on the Geometric Supersites once the pan band has been fully calibrated. These results will give the post-fit residuals for the focal plane alignment procedure and are shown in
Figure 15. The mean pre-fit (which would represent post-calibration) residuals of all the datasets is shown in the figure with error bars that represent the standard deviation of those means. From
Figure 15 the pan band SCAs are fitted to the Geometric Supersite control with a mean error that is less than 2 µ radians and with a standard deviation of less than 6 µ radians. Considering the pan band has a nominal IFOV of 21.25 µ radians, and a nominal ground instantaneous field of view (GIFOV) of 15 m, the mean results show a fit of less than a tenth of a pixel to the reference imagery.
A similar assessment can be done on the alignment of the TIRS-2 focal plane by running the TIRS-2 to OLI-2 alignment after calibration has been performed on both instruments, inspecting the pre-fit results generated. These results, representing an assessment of post-fit calibration of the TIRS-2 10 µ meter band SCAs, is shown in
Figure 16.
The mean values shown in
Figure 15 and
Figure 16 for each SCA measured demonstrates the lack of any mean residual bias being present within the alignments performed for the two instruments. The standard deviations of those calculated means shown in both
Figure 15 and
Figure 16, where a maximum value of approximately 9 μ radians for OLI-2 and 15 urad for TIRS-2 are shown, are within a range of what can be expected when using image correlation to measure the displacement between spatial data sets [
23,
24]. Comparing these standard deviations against the OLI-2 and TIRS-2 nominal IFOVs of 42.5 μ radians and 141 µ radians also demonstrates that the magnitude of these measurements are small compared to the nominal pixel size of the instruments.
Geodetic accuracy pertains to two aspects of the spacecraft and instrument, the absolute pointing accuracy of the instrument and the relative internal, short-term, LOS stability of the instrument. Both sets of geodetic accuracy assessments apply to conditions prior to correcting the data for any position and attitude telemetry errors but involve removing terrain induced parallax offset within the imagery prior to the assessment. Absolute geodetic accuracy refers to the pointing knowledge of the spacecraft and instruments boresight, without the use of any external influences such as ground control. Relative Geodetic Accuracy refers to the internal accuracy of the imagery, the point-to-point relative accuracy within the scene. These geodetic accuracy assessments for OLI-2 are measured directly from the precision correction solution step, which calculates pre-fit statistics on measured ground control points, during the process of creating a precision-terrain corrected set of imagery from a select set of cloud-free scenes. For commissioning these assessments were performed using both the Geometric Supersite and the GLS ground control. The geodetic assessment using the Geometric Supersite ground control is carefully chosen to avoid clouds or any snow that may be present in the imagery that would degrade the measurements taken, this was accomplished by choosing scenes with less than 4% cloud cover, less than 4% snow cover and at times with a visual inspection of the data. For commissioning, 62 Geometric Supersites were chosen for assessment. The use of the more accurate Geometric Supersites and careful selection of cloud and snow free imagery for this assessment, allows for a more direct understanding of the spacecraft and instrument performance. The geodetic assessment using the GLS ground control includes a wider and more dense set of imagery, globally acquired, over the commissioning time frame. Although these scenes corrected with the GLS control are filtered to have cloud and snow cover scores of less than 4%, as was done with the Geometric Supersite imagery, the GLS assessments lacks the more careful visual inspection of the imagery and final results generated from the imagery. Therefore, the GLS based results are more of an indication of both the spacecraft and instrument performance with the additional aspect of the less accurate set of ground control and error involving the mensuration step to that ground control. Due to the less stringent outlier rejection with the GLS ground control, and it not being as accurate as the Geometric Supersite control, when strictly considering the spacecraft and instrument performance the GLS derived results are not included in the assessment or as a measurement against the L9 system meeting its established set of geometric requirements. The GLS ground control can provide a verification of any gross errors present within the data, or as more of a sanity check of the overall results determined from the more accurate control.
For the results based on both sets of ground control, along with the screening of imagery for clouds scores and snow cover of less than 4%, each scene must keep at least 50 ground control points in the precision solution step to be considered within the assessments. This criterion of keeping at least 50 GCPs in the precision solution step helps ensure that GCPs are distributed throughout the imagery providing further confidence in the quality of the precision solution and geodetic accuracy results generated. Based on the Geometric Supersite control the absolute geodetic accuracy for OLI-2 was determined as 13.40 m CE90 and the relative geodetic accuracy was 5.42 m CE90. This assessment was determined from the carefully selected 62 scenes acquired over the Geometric Supersites. The requirements for absolute and relative geodetic accuracy for L9 are 65- and 25-m CE90 respectively. Based on the GLS ground control the absolute geodetic accuracy was determined as 17.48 m CE90 and the relative geodetic accuracy was 6.46 m CE90. This assessment was based on 4335 images acquired. The higher GLS geodetic accuracy numbers are due to the control being less accurate, less stringent scene outlier rejection and the inclusion of high-latitude scenes which are not part of the Geometric Supersites and will tend to drive up in magnitude of the results due to winter conditions such as snow and ice affecting the registration results. Although some outlier logic based on snow cover and latitude was performed on the GLS related data, poor correlations due to winter type landscape conditions, regardless of the snow cover, still affect the geodetic accuracy results for the GLS control and as neither the cloud or snow cover scores are 100% accurate, a few cloudy and snowy scenes will show up in these results. The individual scene derived numbers for the absolute geodetic accuracy based on the Geometric Supersites are shown in
Figure 17 along with the requirement or specification. For comparison purposes the absolute geodetic accuracy results derived from the GLS control are shown in
Figure 18. The GLS related numbers are an indication of what can be expected for the absolute geodetic accuracy of the L9 products.
The precision solution pre-fit standard deviation results, which determines the relative accuracy of the instruments, for the along and across track direction are shown for the Geometric Supersites in
Figure 19. For comparisons purposes the pre-fit standard deviations using the GLS control are show in
Figure 20. The results based on the GLS control are an indication of what can be expected for the relative geodetic accuracy of the L9 products, where the ground control plays a larger role in the results. The larger error present in the GLS data are more of indication of the mensuration issues with imagery, such as cloud or snow cover affecting the ability to measure differences between ground control and imagery, rather than an indication of the instrument or spacecraft performance. The noticeable gap in geodetic accuracy results in the plot for
Figure 20 was due to an issue with the Solid-State Recorder onboard L9 and was associated with the reading and writing to bad memory blocks. Imaging was suspended during a brief period while investigations ensued. After thorough analysis, operational and software changes aboard the spacecraft allowed for mitigations to the impact of these bad memory blocks when performing image collects.
The OLI-2 Geodetic Accuracy results for the differing sets of control are listed in
Table 2. The difference, between the geodetic accuracy using both sets of control, allows for a comparison of the difference in the accuracy between the Geometric Supersite and GLS control. This difference, as shown in the last row of the table, is just over 4 m.
For the geodetic accuracy assessment of TIRS-2, as there is not a set of thermal ground control points within the IAS or the Landsat Product Ground System (LPGS), LPGS being the USGS product generation system, that can be used for a direct comparison to the instrument its geodetic accuracy is determined analytically. This analytical approach is performed by Root Sum Squaring (RSS) of the OLI-2 geodetic accuracy assessment, OLI-2 band registration accuracy, the TIRS-2 to OLI-2 registration accuracy and the TIRS-2 band registration accuracy. Using the OLI-2 geodetic accuracy results based on the Geometric Supersites; (1) the OLI-2 band registration accuracy, (2) the TIRS-2 to OLI-2 registration accuracy, (3) the TIRS-2 band registration accuracy, the TIRS-2 Geodetic Accuracy results are calculated to be 26.88 m CE90. This flow of the numbers, which is the RSS’ing of the individual components, used in determining the TIRS-2 geodetic accuracy results shown in
Table 3. The band alignment results, listed in the table, are discussed in the band-to-band section that follows.
The band-to-band registration accuracy specification defines the accuracy with which corresponding Level 1TP pixels, for both the OLI-2 and TIRS-2 instruments, have their spectral bands co-aligned. It is important to note that the band-to-band requirement applies to Level 1TP images, after the precision-terrain correction has been applied to the data, including image resampling. Neither sensor’s architecture provides inherent registration between spectral bands due to the along track displacement of the individual bands and SCAs, without precision and terrain corrections being applied. For band-to-band analysis 423 non-cirrus image data sets where used, while 49 image data sets were used in the analysis involving the cirrus band. The Landsat cirrus band (1.360–1390 μm) detects high-altitude cloud contamination that may not be visible in other bands. A band-to-band assessment of the OLI-2 instrument can be performed that includes the addition of the cirrus band, by choosing Landsat scenes with high altitude, cloud-free cirrus band scene content. However, this type of adequate cirrus band scenes is limited, which leads to the lowering the number of scenes for which a band-to-band assessment can be performed when this band is included in the analysis [
25]. When the cirrus band is not used in the analysis of the OLI-2 band registration accuracy, 3.18 m in the line direction and 2.99 m in sample direction LE90 were determined. When the cirrus band is used in the analysis 3.42 m in the line direction and 3.10 m in the sample direction LE90 were determined. For TIRS-2, where only the two bands are present, 6.724 m in the line direction and 6.44 m in the sample direction LE90 was determined. For the TIRS-2 to OLI-2 alignment assessment, the same procedures that are used to determine the co-registration of the bands within instruments is performed, only in this case the band-to-band assessment is between the two instruments rather than within a given instrument. For this assessment the TIRS-2 imagery is resampled to the native 30-m pixel size of the OLI-2 instrument. It is worth noting that this upsampling of the TIRS-2 imagery will produce an additional amount of uncertainty to these results when comparing their result to the OLI-2 band-to-band results due to the lower resolution of the TIRS-2 instrument. The TIRS-2 to OLI-2 registration accuracy assessment, based on 427 scenes, was determined to be 16.23 m in the line direction and 15.92 m in the sample direction LE90.
Figure 21 shows the OLI-2 band registration assessment for each band combination along with the band registration accuracy requirement of 4.5 m LE90 which is shown as a red dotted line.
Figure 22 shows both the within band registration accuracy assessment of the two TIRS-2 bands and the TIRS-2 to OLI-2, minus the cirrus band, band registration assessment. The TIRS-2 to OLI-2 registration requirement of 30 m LE90 is shown as a red dotted line. The TIRS-2 within band registration requirement is 18 m LE90. The within instrument and between instrument band registration is achieved for all bands for L9 (
Figure 21 and
Figure 22).
The Geometric Accuracy Assessment is the registration accuracy of the L1TP imagery. Both the Geometric Supersites and GLS were used in separate geometric assessments. In each case a group of the ground control, either Geometric Supersite or GLS, is used in the registration step, while a separate set of control from the same ground control type is used with the L1TP to determine how well the precision-terrain product is registered to the same type of control used for registration. Based on the Geometric Supersite control the geometric accuracy for OLI-2 was determined as 3.72 m CE90. This assessment was determined from the carefully selected 36 scenes acquired over the Geometric Supersites. The requirements for geometric accuracy for L9 are 12-m CE90. Based on the GLS ground control the geometric accuracy was determined to be 8.12 m CE90. This assessment was based on 4020 images acquired. These two sets of geometric accuracy are shown in
Figure 23 and
Figure 24.
Table 4 shows the geometric accuracy for both the Geometric Supersites and GLS control. The Geometric Supersite scenes were chosen to have less than 4% cloud cover and contain little to no snow or ice. The GLS results shown uses imagery that has less than 4% cloud cover, less than 4% snow cover, are not acquisitions acquired at high latitudes, and whose post fit geodetic accuracy means and standard deviations are below the threshold of 30 m associated with an L1TP product definition [
26]. Of note, the geometric accuracy results as less stringent with respect to the outlier logic applied to their results when compared to the geodetic accuracy results, thus their results often show higher residuals in locations with high cloud or snow cover [
27] The geometric accuracy using the GLS only acquired over the Geometric Supersite WRS-2 path and rows is shown in the table along with the difference between these results and the Geometric Supersite results over the same WRS-2 path and rows. This difference shows there is small difference in the absolute accuracy of the two, with that difference being a little greater than 4 m.
Like the geodetic accuracy for TIRS-2, the geometric accuracy for TIRS-2 is derived by analysis of the other calibration components performed. This is due to the same reason as that of the geodetic accuracy, the IAS does not contain thermal ground control chips for a direct comparison between the thermal bands and a set of reference imagery. Using the OLI-2 geometric accuracy results based on the Geometric Supersites, the TIRS-2 geometric accuracy results are calculated as 23.59 m CE90. The flow of the numbers determining the TIRS-2 geometric accuracy results are shown in
Table 5.