For hyperspectral data with a fine spectral resolution and continuous spectral sampling, the effects of shifts in the band center wavelengths can have an impact on data processing and analysis. As shown by [
20], for simulated EnMAP data and a Monte Carlo uncertainty estimation, larger uncorrected shifts of
nm can have a significant influence on the retrieval of atmospheric parameters, such as the aerosol optical thickness, and even more on the subsequent thematic analysis. Even small shifts of
nm can impact the retrieval of sensitive spectral indices related to photochemical pigments in plants. Hence, the operational analysis of spectral calibration is a crucial part of the data quality control, going hand-in-hand with the proper instrument calibration, demonstrating the validity of the generated data products and, therefore, increasing the confidence in the quality.
The spectral calibration of imaging spectrometers is usually conducted using pre-flight laboratory measurements and in-flight satellite calibration equipment, like doped Spectralon (EnMAP, see [
17,
21]) or LED banks (DESIS, see [
22]). Additionally, narrow atmospheric absorption features such as the Oxygen A absorption at 760 nm and Fraunhofer lines are used to verify the spectral calibration (see, e.g., [
23]). In short, these methods use a high-resolution version of the absorption feature, spectrally resample it to the spectral response function of the instrument, and vary the position of the center wavelength. The center wavelength is then retrieved by finding the best fit between the various simulated signals and the sensed signal. Using a similar approach, the emission lines from nighttime lights are a promising source of narrow spectral features, which are usable for the verification of the spectral calibration.
In 2000, ref. [
24] checked the spectral calibration of AVIRIS based on a nighttime observation of Las Vegas, NV, USA. The study focused on a specific and known light source, namely, the MGM Grand Hotel, with strong and narrow emissions at 535 nm. Due to the coarser spatial resolution of EnMAP, and as the lighting type of this particular area is anticipated to have changed between 2000 and 2022 (see
Section 4.2), we modified the approach using various lighting types measured precisely in the laboratory by [
15]. Therefore, we consider a similar approach to the one used in [
24], but account for a set of narrow sodium emissions lines at 819 nm and 1139 nm, as analyzed in
Section 3.1, and we consider the resulting uncertainties in
Section 3.2.
3.1. Methods and Results
Within this study, we consider the spectral features of high-pressure sodium (HPS), metal halide (MH), and low-pressure sodium (LPS) lamps. The spectra of HPS and MH have strong peaks at 819 nm and 1139 nm (which are typically the strongest in VIS/NIR and SWIR). The spectrum of LPS has a medium peak at 819 nm and a low peak at 1139 nm. Furthermore, the signals are higher in VIS/NIR than in SWIR. These spectra were measured by [
15] and the sums of the signals normalized to 1 are illustrated in
Figure 4. Other lighting types measured by [
15] do not have strong and narrow emissions in this region, as illustrated in
Section 4.2. For VIS/NIR, we do not expect any other strong influences. For SWIR, we expect some influences based on stronger thermal emissions and stronger atmospheric absorption effects, resulting in higher uncertainties.
We are especially interested in shifts of center wavelengths of the EnMAP bands, which are expected to have a major influence on changes to the spectra. To be more precise, we expect constant shifts of the center wavelengths (CWs) of the bands in the considered ranges of approximately
nm, with respect to the peak of the emission (namely, all bands are shifted by the same value); the full width at half maximum (FWHM) and radiometry, to be correct, as stated in the metadata of the product; and the spectral response function (SRF) to be a Gaussian function [
17].
Next, in the frame of this study, we make assumptions, marked as (A#), and analyze these in relation to uncertainties in
Section 3.2.
First, we consider one of the seven spectra measured by [
15] as a reference spectrum (A1), namely, the HPS spectrum illustrated in
Figure 4 (red solid line). As the differences between the spectra are limited in the considered ranges and the EnMAP observation is expected to contain a mixture of these spectra, we anticipate some minor influences on the evaluation of the spectral calibration. Furthermore, it is expected that the luminous efficacy of the lighting types (namely, how well a light source produces visible light given by the ratio of luminous flux to power) improved for 2022 compared to 2010, but most lighting types have not changed, particularly the physical properties of the light emissions and resulting spectra.
EnMAP observes light emissions either directly (upwards from the light source to the sensor) or indirectly (downwards from the light source, reflected by the Earth’s surface, and upwards to the sensor). In both cases, the signal is influenced by the path upwards through the atmosphere. Thus, we consider all light emissions per pixel to be observed either directly or indirectly via a smooth surface (constant, positive reflectance) in each of the considered ranges (A2). It is expected that most light emissions are observed directly and typical surface reflectances are basically smooth and without narrow absorption features in each of the considered ranges [
25]. Therefore, we expect some minor influences on the evaluation of the spectral calibration.
We consider a standard atmosphere (A3), namely, an urban mid-latitude summer atmosphere at nadir with a default water vapor of 3635.9 atm-cm [
26] because more detailed information is typically absent, e.g., not stated in the metadata of the product. By accounting for the atmosphere, we consider TOA (top-of-atmosphere) radiance instead of BOA (bottom-of-atmosphere) radiance of the reference spectrum. Because the dynamics of the atmosphere are limited in the considered ranges, namely, the change in the atmosphere in the EnMAP observation is limited, the differences in atmospheric transmission between a maximal, a default, and a minimal water vapor are essentially constant across these ranges, as illustrated in
Figure 5; since other atmospheric parameters exhibit limited non-constant effects, we do not expect major influences on the evaluation of the spectral calibration in this context.
Finally, we consider ranges of bands with respect to the peaks of the emission (A4), namely, ranges of approximately nm, with respect to 819 nm for VIS/NIR and 1139 nm for SWIR. These ranges cover the complete spectral range around the lighting emission feature, symmetrically, namely, low signals (bands and ), medium signals (bands and ), and high signals (bands and ), but no other spectral features.
Figure 6 illustrates the resulting image spectra for shifts of the center wavelengths for EnMAP based on the spectral calibration of
nm,
nm, and
nm (bluish, greenish, and yellow lines), with respect to the reference spectrum (red line).
To estimate the shift for an image spectrum, we normalize the sum of the signal of the bands in the considered range to 1 to obtain consistent results in the distance measure. Thereby, the absolute signal intensity is excluded from the shift estimation. For the fitting of the image spectrum to the reference spectrum, the error of the normalized signal is used, where the minimum error represents the best fit. We consider the Euclidean distance as the error measure between two spectra (A5), namely, the standard distance measure [
27].
Finally, let us analyze different approaches for selecting an image spectrum to estimate the shift (A6), which is highly relevant for the low signals in nighttime observations. Four cases are investigated, using an arbitrary pixel (arbitrary), a high-intensity pixel (maximum), a sum (or averaging) over all pixels (sum), and an optimized method based on the results of the first cases (optimum).
3.1.1. Arbitrary
In this case, we consider 1 arbitrary image spectrum out of the 1,024,000 image spectra, the center pixel (light gray lines), and the fitted reference spectrum (light green lines), as illustrated in
Figure 7. We obtain shifts of
nm for VIS/NIR and
nm for SWIR. However, the signals are low, with
W/m
/sr/nm for VIS/NIR and
W/m
/sr/nm for SWIR, as discussed in
Section 3.2. Therefore, major noise influences are expected and visible through large errors of
for VIS/NIR and
for SWIR. Therefore, this approach does not seem to be feasible for this study and is, thus, discarded.
3.1.2. Maximum
In this scenario, we consider an image spectrum with a maximal signal with respect to the considered range (dark gray lines) and the fitted reference spectrum (dark green lines), as illustrated in
Figure 7. We obtain shifts of
nm for VIS/NIR and
nm for SWIR. Now, the signals are higher, with
W/m
/sr/nm for VIS/NIR and
W/m
/sr/nm for SWIR, and the errors are
for VIS/NIR, smaller than the case of the center pixel, and
for SWIR, larger than the case of the center pixel. Minor influences of noise are expected but random effects for a single pixel are also anticipated, as illustrated, based on stronger thermal emissions in SWIR; namely, outliers have a major influence on the results, and this approach seems to be partly feasible.
3.1.3. Sum
Finally, we consider more than just a single image spectrum. To be more precise, we consider the sum of the 1,024,000 image spectra (black lines) and the fitted reference spectrum (blue lines), as illustrated in
Figure 7. We obtain shifts of
nm for VIS/NIR and
nm for SWIR. The signals are the highest of the three cases with
W/m
/sr/nm for VIS/NIR and
W/m
/sr/nm for SWIR. The errors are
for VIS/NIR and
for SWIR. Because most of the incorporated image spectra are of lower signals, an increase in these signals and overshadowing of the reference spectra are expected and visible in the near-constant to constant summed image spectra for VIS/NIR and SWIR; this approach seems to be partially feasible.
3.1.4. Optimum
Based on these results, particularly the maximum and sum scenarios, we consider the image spectra ordered from high signals to low signals with respect to the considered range, namely, a mixture of the maximum and sum. To be more precise, we consider the spectrum
resulting as the sum of the image spectra of the
ith highest signals for
1,024,000. We already analyzed
and
in the maximum and sum paragraphs. Let
be the correspondingly observed error and let
nm be the observed shift. We expect larger changes in the error (and shift) if
i is small, due to the larger influence of random effects for single pixels, as illustrated in
Figure 8 (top). We also expect smaller changes in the error (and shift) if
i is large, due to the smaller influence of an extra pixel, which has, at most, the same signal influencing the sum as the prior considered pixel, as illustrated in
Figure 8 (bottom). We intend to identify the spectrum
with a minimal error
, but for a large enough
i, so that it is not strongly affected by outliers. Future research may consider outliers and radiometric uncertainties in a more sophisticated way.
To be more precise, for a given relative deviation in the error , let , namely, the first index, such that for all consecutive indices of at least , the relative deviation in the error is, at most, e, and let , namely, the first index of at least with a minimal error. We consider (A5), namely, the relative deviation in the error shall be at most 1%.
Finally, we obtain
nm for VIS/NIR and
nm for SWIR, where
,
, and
for VIS/NIR, as well as
,
, and
for SWIR.
Figure 7 illustrates the spectra of the optimally summed image spectra (yellow lines) and the fitted reference spectra (red lines).
3.2. Sensitivities and Influences of Assumptions
In the following, we analyze the sensitivity of the method and the influences of the assumptions made in
Section 3.1 to derive the expected uncertainty ranges of this approach.
3.2.1. Sensitivity to Noise
For the analysis of sensitivity to noise of the estimated shifts, we expect that the spectra are predominantly affected by signal-independent Gaussian noise and only affected by signal-dependent shot noise to a small degree [
28]; this is because of the low measured signals, as seen when comparing the optimally summed image spectra to the fitted reference spectra, as illustrated in
Figure 7. Furthermore, we expect that the noise is equally distributed to all bands; by examining half of the image spectra with the lower signals in the considered range, we obtain
for VIS/NIR signals, averaged for each band, in the range of W/m/sr/nm with standard deviations in the range of and
for SWIR signals, averaged for each band, in the range of W/m/sr/nm, with standard deviations in the range of ,
namely, almost constant signals, averaged for each band, with constant standard deviations. Furthermore, for these image spectra, we obtain
for the VIS/NIR signal, averaged for all bands, of W/m/sr/nm, with a standard deviation of , namely, an expected relative deviation of the signal of , and
for the SWIR signal, averaged for all bands, of W/m/sr/nm, and a standard deviation of , namely, an expected relative deviation of the signal of .
Based on these estimates for the given case, the noise contribution is larger in VIS/NIR than in the SWIR.
For estimating the sensitivity, we add noise to the reference spectrum and change its shift to achieve an observed error and shift. In particular, if some ratio of the signal of the normalized, not noisy, shifted by nm, the reference spectrum with is equally added to each of the considered b bands as noise; namely, we consider the noisy reference spectrum shifted by nm, given by , and we obtain an observed error and shift.
To be more precise, we consider the mapping
. This mapping
f is not necessarily bijective, and is particularly not unambiguous, because different combinations of
r and
c may result in the same observed error
and shift
, namely,
f is not injective as
. Furthermore, no combinations of
r and
c may result in some observed error
and shift
, namely,
f is not surjective as
. The mapping
f is illustrated in
Figure 9.
Consequently, the influence of noise on the observed errors and shifts in
Section 3.1 is as follows. For the VIS/NIR, the estimates have minimal ambiguities
and only a minor change in the spectral shift of
nm. For SWIR, ambiguities increase to
, and a related major change in the shift of
is observed.
Because of the observations on noise, accounting for the expected relative deviations of the signals, averaged for all bands, of
for VIS/NIR and
for SWIR, we consider ratios
for VIS/NIR and
for SWIR. In other words, we consider more added noise to the reference spectrum. Hence, at most, all
for
, namely,
is not considered as the outlier, and where
for
and any
c are shifts that do not violate the expected deviations of the observed errors. We obtain ranges
for VIS/NIR and
for SWIR and by considering any
c, where
for
,
and any
, we obtain results on uncertainties based on sensitivity, as stated in
Table 1. We note that, at least for the considered ranges, the values of
and
r are strongly correlated by a constant positive factor. Because
for VIS/NIR and
for SWIR,
Figure 8 (lines 1 and 2) indicates these ranges of
D, and
Figure 9 indicates the resulting differences, namely, uncertainties. Notably,
nm is always contained in the ranges because, for
, the noisy and non-noisy spectra are equal.
3.2.2. A1—Influence of Lighting Types
Let us consider assumption A1 and each of the seven spectra measured by [
15] as reference spectra (3 × HPS, 3 × MH, 1 × LPS). We obtain shifts of:
| Reference | | | | | | |
| HPS 1 | HPS 2 | HPS 3 | MH 1 | MH 2 | MH 3 | LPS |
VIS/NIR | nm | nm | nm | nm | nm | nm | nm |
SWIR | nm | nm | nm | nm | nm | nm | nm |
We do not account for the minimum shifts, marked by (1), and maximum shifts, marked by (2), because of the low signals for LPS in VIS/NIR and SWIR, the expected mixtures of such spectra, and to avoid drifts in both. As expected, the differences in the shifts are marginal and we obtain results on the uncertainties based on A1, as stated in
Table 1. We note that the average shifts are
nm for VIS/NIR and
nm for SWIR, which, particularly for VIS/NIR, are close to the shifts of the reference spectrum.
3.2.3. A2—Influence of Surface Types and Upward vs. Downward Illuminations
Let us consider assumption A2 and a smooth surface reflectance with low (00.1%), medium (01.0%), and high (10.0%) absorption depths
and low (001 nm), medium (010 nm), and high (100 nm) absorption widths
applied to the constant, positive surface reflectance. For example, if a signal is a combination of 90% directly observed light emission and 10% indirectly observed light emission via a surface with a positive reflectance, and now a high absorption depth of 10.0% is applied to the surface, namely, the surface reflectance is changed by a factor of 90.0%, then a signal of
results. It is important to note that the result is the same as for 0% directly and 100% indirectly observed light emission, applying a medium absorption depth of 1.0%. To be more precise, we model the absorption of
at a specific wavelength of
nm by a linearly descending absorption to the constant, positive surface reflectance by a factor of
at
nm to
for increasing distances to
nm, where the full width at half maximum is given by
. Considering all
nm, we obtain shifts of:
VIS/NIR | low depth (00.1%) | medium depth (01.0%) | high depth (10.0%) |
low width (001 nm) | | | |
medium width (010 nm) | | | |
high width (100 nm) | | | |
SWIR | low depth (00.1%) | medium depth (01.0%) | high depth (10.0%) |
low width (001 nm) | | | |
medium width (010 nm) | | | |
high width (100 nm) | | | |
As expected, the ranges increase by increasing the absorption depths and are larger for medium widths because for low widths, the influence to a single band is limited, and for large widths, the influence on all bands is similar. We account for the minimum and maximum shifts of all considered combinations of
and
, and we obtain results on the uncertainties based on A2, as stated in
Table 1.
3.2.4. A3—Influence of Atmospheres
Let us consider assumption A3, as well as the default atmosphere, atmospheres with maximal water vapor (6651.1 atm-cm) that is not cloudy, and minimal water vapor (1817.9 atm-cm) that is half of the default water vapor, as illustrated in
Figure 5. Because water vapor has the highest influence on atmospheric absorption, we do not consider changes in the other parameters. We obtain shifts of
nm and
nm for VIS/NIR, and
nm and
nm for SWIR. In particular, for VIS/NIR, the shifts are close to the ones for the default atmosphere because the dynamics of the atmosphere are limited in this wavelength range. We also obtain results on the uncertainties based on A3, as stated in
Table 1. If we do not account for the atmosphere at all, shifts of
nm for VIS/NIR and
nm for the SWIR result, which, as expected, are close to the shifts considering the default atmosphere.
3.2.5. A4—Influence of the Range of Bands around the Lighting Emission Peaks
Let us consider assumption A4, in addition to the default range of
bands,
bands, and
bands around the lighting emission peaks, namely, 819 nm for VIS/NIR and 1139 nm for SWIR. We obtain shifts of
nm and
nm for VIS/NIR and
nm and
nm for SWIR. Again, particularly for VIS/NIR, these are close to the shifts of the default range of bands. We also obtain results on the uncertainties based on A4, as stated in
Table 1. This assumption is already incorporated into the considerations of sensitivity, namely, changes in the considered bands will result in corresponding changes in sensitivity and, therefore, are not relevant for uncertainty estimations. However, the results illustrate the robustness of the considered method.
3.2.6. A5—Influence of Distance Metrics
Let us consider assumption A5 for normalized image spectra
, and reference spectra
next to the default Euclidean distance
, the Manhattan distance
, and the distance
. We obtain shifts of
nm and
nm for VIS/NIR and
nm and
nm for SWIR, particularly for VIS/NIR, close to the shifts for the default distance measure. We obtain results on the uncertainties based on A5, as stated in
Table 1. This assumption is already incorporated into the considerations of sensitivity, namely, changes in the considered distance measure will result in corresponding changes in the sensitivity and, therefore, are not relevant for uncertainty estimations in this context. However, the results illustrate the robustness of the considered method.
3.2.7. A6—Influence of Image Spectra Selections
Let us consider assumption A6, in addition to the default relative deviation in the errors of
,
, and
, as well as
,
, and
for later investigations, namely, lower and higher values as the default. We obtain shifts of the following:
VIS/NIR |
e | | | | |
| nm | 2069 | 2069 | |
| nm | 724 | 724 | |
| nm | 156 | 286 | |
| nm | 60 | 286 | |
| nm | 8 | 286 | |
| nm | | 286 | |
SWIR |
e | | | | |
| nm | 944 | 944 | |
| nm | 85 | 268 | |
| nm | 57 | 268 | |
| nm | 6 | 268 | |
| nm | 4 | 268 | |
| nm | | 268 | |
Because
for VIS/NIR, this may be seen as an indicator that
is a very conservative value in this context; nevertheless, the shift for
is close to the one for
and for SWIR
. Furthermore, for
, we obtain
for VIS/NIR and SWIR. We obtain results on uncertainties based on A6, as stated in
Table 1. Because all these observed errors and shifts are already incorporated into the considerations of sensitivity, this assumption is not relevant for uncertainty estimations in this context. When we consider
and
, namely, we do not consider
e at all, but an optimum, we obtain the same shifts as for
. Furthermore, because
for VIS/NIR and SWIR, this may be seen as a strong indicator that
is a very conservative value in this context.
3.2.8. Summary of A1 to A6
Assuming the worst case, where these estimated uncertainties (sensitivity and assumption typeset in bold in the first column in
Table 1) are correlated and the ranges need to be added, we obtain total uncertainties, as given in
Table 1, namely, expected shifts of
nm in the range of
for VIS/NIR and
nm in the range of
for SWIR. These values—even the estimated shifts, not considering the estimated uncertainties—are well within the accuracy of
nm for the spectral calibration based on laboratory calibrations and dedicated satellite equipment [
17]. Thus, assuming shifts of
nm for VIS/NIR and
nm for SWIR, we obtain symmetric uncertainties of
nm for VIS/NIR and
for SWIR.
In addition to the investigations of other spectral features of light emissions, future research may consider atmospheric absorption features, such as the Oxygen A band absorption at 760 nm or CO absorption at 2060 for homogeneous light or thermal emissions in that range.
Figure 10 illustrates the integrated signals for each pixel in the complete EnMAP tile (accounting for the bands in the considered range), where, for illustration purposes, a non-linear signal stretch is applied. Marginal systematic striping effects (also denoted as fixed-pattern noise) are visible in the along-track direction in VIS/NIR, and marginal systematic higher signals are visible at the borders compared to the center in the across-track direction in SWIR.
3.2.9. Spectral Along-Track Stability
Another aspect to investigate is the spectral stability over short time intervals, particularly in the along-track direction. If we split the EnMAP tile into two halves in the along-track direction, we observe that pixels with high signals are located in both halves and we obtain shifts of nm (with an error of ) and nm (with an error of ) for VIS/NIR and nm (with an error of ) and nm (with an error of ) for SWIR. All these estimated shifts are close to the estimated shifts for the complete EnMAP tile and are well within the estimated uncertainties. Thus, for this given scene, the described approach allows estimating the short time stability, which is confirmed for EnMAP.
3.2.10. Spectral Across-Track Characteristics
As hyperspectral push-broom sensors often exhibit slight changes in center wavelengths in the across-track direction (often denoted as the spectral smile), this sensor property is also assessed with this method. For the EO tile, we observe that pixels with high signals are located, in particular, between approximately pixel 570 and 630 in the across-track direction of the sensor. To be more precise, for , the average sensor pixel—when weighted based on the considered signals of the relevant pixel—is for VIS/NIR and for SWIR. For these sensor pixels, shifts of nm for VIS/NIR and nm for SWIR are expected according to the spectral calibration based on laboratory characterization. Therefore, accounting for the shifts in these sensor pixels, we assume shifts of nm for VIS/NIR and nm for SWIR.
To analyze the spectral smile, we separate the 1000 valid sensor pixels per band to 4 parts of 250 pixels each. We consider the two parts with the lowest fitting errors and we obtain shifts of
nm (with an error of
) and
nm (with an error of
) for the third and fourth parts of VIS/NIR (all other parts have errors of at least
) and
nm (with an error of
), and
nm (with an error of
) for the third and fourth parts of SWIR (all other parts have errors of at least
).
Figure 11 illustrates these results. All these results are well within the estimated uncertainties.
For VIS/NIR, the estimated smile is highly consistent, being close to the estimate using a constant across-track fitting, and shows the same across-track slope as the smile based on laboratory calibrations. For SWIR, where the uncertainties are estimated to be much larger than for VIS/NIR, the estimated shifts decrease with increasing across-track pixels, similar to the spectral calibration based on laboratory measurements; however, the magnitude of changes is not consistent.