1. Introduction
Millimeter-wave (MMW) range (30–300 GHz) is currently considered to be an optimal radio frequency (RF) sub-band for imaging [
1,
2,
3,
4]. MMW imaging systems combine high resolution with low absorption in air and many other mediums and materials. The ability of MMW radars to enable the visibility of objects in fire environments was proven [
5]. The MMW band is demonstrated to be an ideal part of the electromagnetic radiation to diagnose human skin conditions [
6]. Terahertz (0.3–3 THz) imaging is being actively developed for short-range applications [
7].
A lot of methods of MMW imaging have been proposed to date. A mechanical scanning is conceptually the simplest one. In this method, an image can be built up by scanning a single pixel receiver, either by moving a receiver in the focal plane of the antenna or mechanically scanning the beam direction of the system [
1]. A shortcoming of the single-element mechanical scanning is a low frame rate. For increasing the speed, a receiver of the mechanically scanning systems can consist of several sensing elements (usually, <~10) [
8,
9,
10,
11]. A real-time passive imaging is achieved in these systems [
8]. A further increase of a number of the sensing elements in the receiving array leads to emerging qualitatively new types of imaging methods that cannot include the mechanical movements at all. These methods make it possible to create imaging systems with higher sensitivity and portability.
The interferometric array, the phased array, and the focal-plane array (FPA) are the main types of the multi-element imaging systems [
1]. The interferometric [
12] and phased array [
13] systems are based on measuring or manipulating the phase of the signal, which requires the creation of the complicated array RF circuits. The multiple-input/multiple-output (MIMO) radar technique [
14] allows us to reduce a total number of the interferometric array elements, and this is achieved by using a number of transmitting elements that radiate orthogonal waveforms. This makes the interferometric systems more applicable. A number of the MIMO radar systems have been presented to date [
15,
16]. In Reference [
17], a high-resolution MMW imaging system combining 2D MIMO arrays with synthetic aperture radar (SAR) technique, along with a novel Fourier-based image reconstruction algorithm using sparsely sampled aperture data, was proposed.
Special attention is paid to the development of optimal signal-processing methods and algorithms for MMW imaging. Recently, algorithms for fast fully focused imaging, which includes the case of location-constrained MIMO arrays or partially damaged transceivers, were proposed [
18,
19]. Methods for improving the resolution of the passive MMW images and making it more preferable for object recognition were suggested and studied [
20,
21]. A method that allows detecting > 15 distinct skeletal joints by using MMW radar reflection signals was developed [
22].
In FPA imaging systems, an image is built up with a quasi-optical objective, and direct-detection receiving elements can be used for measuring RF power distribution at the focal plane [
1,
2,
23]. The FPA approach can be applied to both passive [
2] and active [
23] imaging. In passive mode, a role of the radiation sources plays the imaged objects themselves; thus, the received power is proportional to 1/
r2, where
r is the range to an object. In the active mode, the received power is proportional to 1/
r4. At a typical power level of the MMW sources (~1–100 mW), the maximum range of the active imaging systems is usually not more than several meters.
According to the classic radar equation [
13], the maximum range of the active FPA system can be increased in several ways. The first way is an increase in the gain of the transmitting antenna. This approach, however, leads to a reduction in the beamwidth of the transmitting power and, as a consequence, to a reduction in the field of view of the imaging system. The maximum range can be enhanced by increasing the quasi-optical objective aperture. The undesirable result of this approach is an increase in the system’s dimensions. The third way is to enhance power of the RF source. This way, however, does not look attractive: the power should be increased ten thousand times for a tenfold increase in the maximum range. The fourth way is to enhance the sensitivity of the receiver. A more sensitive FPA receiver can be built by using the heterodyne-detection principle that is based on mixing the received signal with the reference one. The magnitude of the output signal in this case is proportional not to the RF power but to the amplitude of the RF field, which depends on the range to a target as 1/
r2. The heterodyne-type receiving allows not only for a significant increase in sensitivity of the imaging systems, but also provides the ability to employ radar methods. It becomes possible to determine the range to a target and its radial velocity in addition to a 2D picture of the scene.
The superheterodyne-type FPA imaging systems were studied [
1,
24,
25], but they have not been widely used. The main reason for this is difficulties in creating an array with a high number (>~100) of the receiving elements. Feed of local oscillator (LO) power to the array elements, reduction in the power consumption, and decrease in the cost are some of the difficulties to be overcome.
In this work, we suggest a new approach to creating FPA imaging system that we studied. This approach is based on employing a direct-conversion array receiver, which has a simpler design in comparison to the superheterodyne receiver and, at the same time, can achieve higher sensitivity in comparison to the direct-detection receiver. Realization of the suggested approach became possible due to developed sensitive receiving elements that could be relatively easily integrated into the multi-element array [
26].
2. Imaging Principle
An operation principle of the suggested imaging system is generally depicted in
Figure 1. An MMW source provides a frequency-modulated (FM) continuous wave, the power of which is divided into two parts. The first part goes to illuminating the scene, and the second part goes to the receiver as the LO power. An object (or objects) at the scene scatters the incident power in different directions. A part of the power reflects toward a quasi-optical objective that focuses it at the focal plane. Each point of the focal plane corresponds to the direction that the signal comes from. The focused radiation is captured by antennas of the array, and, at each pixel, the received RF signal is mixed with the LO signal. The frequency modulation of the MMW signal leads to that the frequency of the echo signal differs from the frequency of the LO signal, which results in appearance of a beat frequency (BF) signal at the output of the mixing element. Distribution of the BF signal amplitude among the array elements corresponds to the distribution of reflectors over the scene. Information about the radial coordinate and velocity can be evaluated from the phase of the BF signal in accordance with the FM continuous-wave (FMCW) radar technique [
27,
28,
29].
As described above, a 2D image and the radial coordinates of the objects are obtained in different ways. The 2D image is formed by the quasi-optical objective. In accordance with the laws of geometrical optics [
30], the surface RF power density (
ρRF) at a point of the focal plane
P with coordinates (
ξ,
η) is related with the radiant intensity (
IΩ,RF) incident onto the objective from the direction
with coordinates (
α,
β) as follows:
where ∂(
ξ,
η)/∂(
α,
β) is the Jacobian determinant.
The radial coordinate (
r) of the object is related to the phase of the received RF signal [
27]:
where
f is the frequency of the MMW signal,
c is the velocity of propagation, and
t is the time. As can be seen from (2), measurement of the phase may allow determining not only the range to an object but the 3D image entirely.
The received RF signal at the focal plane has the surface power density given by (1) and the phase given by (2). Let us denote PRF() as the power that falls onto the area ΔPi of the array element number i, where is a solid angle of the object space that corresponds to ΔPi. The phase of the incident signal is denoted by ΦRF(, r). The integrated quantities {PRF, ΦRF} are determined by the differential quantities {ρRF, φRF} and parameters of the antenna array.
The RF signal is mixed with the LO signal that has the power per element,
PLO, and the phase,
ΦLO. The resulting BF current is as follows [
26,
27]:
where
Σ, which is dependent on
PLO, characterizes the sensitivity of the mixing element.
As can be seen from (3), the amplitude of the BF current is IBF~PRF1/2; the BF is fb~|f(t − 2r/c) − f(t)|, which can be obtained by taking into account (2). At a linear dependence of the MMW signal frequency on time (f~t), the BF is fb~r.
3. 1 × 3 Array Imaging System
A 94 GHz imaging system with a direct-conversion 1 × 3 FPA receiver was developed for studying the basic characteristics of the suggested imaging method. A schematic representation of the imaging system is shown in
Figure 2. An RPC “Istok” OV-71 backward-wave oscillator (BWO) is used as the W-band MMW source. The BWO output power weakly depends on the frequency in the range from 82 to 110 GHz. A value of BWO power near 94 GHz is about 10 mW. The frequency modulation of the oscillator is performed with a LG FG-8002 function generator by changing the BWO anode voltage near the operating point. A dependence of the frequency from the anode voltage has a quasilinear form in the operating range with a slope of 48 MHz/V. The chirp modulation waveform is used with a period of 4.5 ms and peak-to-peak amplitude of 12 V, which corresponds to a bandwidth of
B = 576 MHz.
The radiation of the source passes through a metal waveguide to a Quinstar QJG-E03300 directional coupler, where the power is almost equally divided into two parts. One of these parts is used to illuminate the scene with a conical horn antenna, which has a directivity of about 26 dB. The other part of the power passes to the receiver as LO power.
An air path is used to provide LO power to the receiver. The LO power is radiated from the open end of the waveguide that is located at the focus of a dielectric lens. The radiation of a point source is collimated with the lens to a parallel beam, which falls on the array receiver.
A high-density polyethylene (HDPE) aspherical lens with a diameter of 10 cm is used as a quasi-optical objective for focusing received RF power and collimating the LO power. The focal length of the lens is 10 cm. The lens is not symmetrical relatively to its plane; a side facing the scene is more convex. The asymmetrical aspherical shape provides low aberration, hence the small size of the focal spot. A spot size of about 4 mm was experimentally evaluated [
31], which makes it possible to achieve high resolution of imaging.
A three-element array receiver is located at the focal plane of the lens. A photograph of the receiver is shown in
Figure 3. Three modified slot antennas are formed on a Rogers 5880 dielectric plate by photolithography methods. A low-barrier Mott diode [
32] that serves as a mixing element is mounted on each antenna with conductive glue. The diodes operate at zero bias, and therefore the RF front-end of the receiver does not require any power supply. Low-barrier Mott diodes with a differential resistance (
Rd) of about 3 kΩ were chosen, which corresponds to the minimum value of the effective barrier height (~0.2 eV) that can be controllably achieved within the developed technology. The curvature coefficient (
α =
Rd·d
2i/d
u2), which is determined from the dc current–voltage characteristic
i(
u) of the diodes, is about four times less than for an ideal Mott diode (
αideal = 40 A/W), which is related with effects of lowering the barrier height. The capacitance of the diodes is about 15 fF, and the series resistance is 15–40 Ω [
33].
The dielectric plate with receiving elements is attached to a copper-coated substrate that provides rigidity of the module. The BF signal is output from the diodes with thin wires that are routed from the antennas and leaves through the dielectric plate to the rear side of the substrate, where connectors for the BF amplifier are mounted.
The BF current of the diode is converted to voltage via a transimpedance amplifier that has a gain of 110 kΩ and a frequency band from 100 Hz to 100 kHz. A compact 16-channel transimpedance amplifier was developed for creating an 8 × 8 array receiver (see
Section 5). For the 1 × 3 array, 3 of 16 channels were used.
The sensitivity of the developed 3-element array receiver was studied in [
34]. It was found that the noise equivalent power (NEP) of the direct-conversion receiving elements at an accessible LO power of 10 μW per element is about 10
−17 W/Hz. The estimations show that the found sensitivity value corresponds to increasing the maximum range of the FPA imaging system by 30 times, if comparing with the direct-detection receivers. In this work, the estimations of [
34] were confirmed experimentally.
The BF signals of the receiving elements pass to an NI USB-6225 multifunction I/O device, which is synchronized with the function generator. The signals are sequentially digitized and written to the buffer during 10 periods of modulation for each channel. The signal processing is performed on a laptop that obtains the data from the I/O device buffer with a USB port. The data of each channel are averaged over the 10 periods of modulation, which were written in one cycle. The averaged signals undergo a fast Fourier transform (FFT) procedure, resulting in the amplitude spectrums of the BF signals of all receiving elements.
5. 8 × 8 Array Imaging System
A photograph of the 8 × 8 array imaging system is presented in
Figure 8. The system includes an MMW transceiver module, a control and analog-to-digital converter (ADC) module (control&ADC module), power supplies, and a laptop.
The MMW transceiver module is shown in
Figure 9. The OV-71 BWO with 10 mW output power is used for generating MMW signal, as in the 1 × 3 array imaging system. The triangular modulation waveform is used with a period of 10 ms and peak-to-peak amplitude of 14 V, which corresponds to a bandwidth of
B = 672 MHz.
The output power of the BWO is divided into two equal parts with a Dok NO-10/3 directional coupler. The scene is illuminated with a Dok 92–96 GHz Prime Source conical horn antenna, which has a gain of 15 dB and a half-power beamwidth of 30° at the E-plane and 34° at the H-plane.
A dielectric rod antenna was developed for adapting a radiation pattern of the open end of the waveguide to a size of the objective aperture. The same 10 cm–diameter lens objective was used in the 8 × 8 array imaging system as in the 1 × 3 array one. A 3D model of the dielectric rod antenna with the main dimensions is presented in
Figure 10a. The key element of the antenna is a polytetrafluoroethylene (PTFE) rod that is inserted into the 2.4 × 1.2 rectangular waveguide. The rod has small dimensions that ensure negligible perturbations of the received radiation falling onto the lens from the scene. The radiation pattern of the developed antenna is shown in
Figure 10b (filled circles). A half-power beamwidth of 60° at the E-plane and 52° at the H-plane is obtained.
A smooth shape of the rod antenna radiation pattern does not ensure a smooth shape of the LO power distribution at the focal plane. For that reason, exploration of this distribution was conducted. A vector network analyzer (VNA) was used for measuring the S
21 parameter, where the first port was the rod antenna, and the second port was a probe antenna moved at the focal plane. The probe antenna is an open end of the 2.4 × 1.2 rectangular waveguide with modified form of the outer walls for reducing scattering. The positioning accuracy of the probe antenna is 0.1 mm. The measured LO power distribution shown in
Figure 11 indicates the presence of power inhomogeneity that achieves up to 27 dB in the region where the array is located. A possible reason for this inhomogeneity is related to cutting the rod antenna radiation pattern with the lens frame. The inhomogeneity could be reduced by narrowing the radiation pattern or by increasing the diameter of the lens.
A part of the LO power falls onto the area outside the array receiver. RF absorbers are incorporated into the design of the transceiver module to exclude unwanted reflections in the system. The RF absorbers are fabricated with graphite filled (25% by weight) acrylonitrile butadiene styrene (ABS) in fused filament fabrication (FFF) technology. The RF absorber consists of elements that are right square pyramids with a base length of 8 mm, a perpendicular height of 24–28 mm and a rotation angle around the height axis of −10° to 10°. The height and the rotation angle are set randomly for each pyramid. A reflection coefficient of −33 to −35 dB has been measured with a Michelson interferometer [
35] in the 100–200 GHz range.
The low-barrier Mott diodes with a differential resistance of 3–7 kΩ and a curvature coefficient of 18–25 A/W were chosen for 8 × 8 array receiver fabrication. A stack of the four 16-channel BF amplifiers (see
Section 3) was manufactured. The current sensitivity (
RI) of the array elements, which can be used as detectors, was measured firstly; values of 0.8–3.0 A/W were obtained. The LO power incident on the mixing element (
PLO) was measured by using the element itself as a detector; values of 0.6–4.5 μW were obtained. A dependence of
Σ on
PLO in the square-law region of the sensing element (
PLO < ~10 μW) is given by the formula
Σ =
Σ2PLO1/2 [
26]. The proportionality constant
Σ2 is related to the current sensitivity (
RI), as
Σ2 = 2
RI (see
Appendix A). Therefore, the measured values of
RI and
PLO allow us to find the sensitivity of the mixing element,
Σ. A map of
Σ over the array elements is shown in
Figure 12. The sensitivity of the elements varies from 2 to 9 mA/W
1/2. Wide dispersion of the
Σ values is caused by inhomogeneity both
RI and
PLO. The difference in sensitivity of the mixing elements is eliminated by introducing the proper correction coefficients in the signal-processing program.
The noise of the receiver includes the noise of the mixing element and the noise of the BF amplifier. The mixing-element noise is the thermal noise of the diode, which is defined by its differential resistance (Rd). The BF amplifier noise has a more complex spectral density characteristic, which consists of a low-frequency flicker and higher-frequency broadband noise. Within the specified parameters of the imaging system, the BF is higher than the corner frequency (~1 kHz) of the amplifier, which allows us to consider only the frequency-independent broadband noise. The input-referred current and voltage noises of the BF amplifier are 3.1 pA/Hz1/2 and 5.7 nV/Hz1/2, respectively. The corresponding noise factor (Famp) at the Rd = 3–7 kΩ input resistances is 3–5. The values of the total noise current (<iN2>1/2) of the receiving elements referring to the BF amplifier input lie within a range of 3.6–4.5 pA/Hz1/2. The noise spectral amplitude, IN = (2<iN2>)1/2, is a more convenient quantity when the amplitude spectrum of the BF signal is computed.
The NEP of the direct-conversion receiver based on a square-law mixing element is given by the formula
NEP = (
IN/
Σ)
2 [
26]. The noise,
IN, has low dispersion; thus, a map of
NEP is similar to a map of
Σ shown in
Figure 12. The values of
NEP are within a range of 3.9 × 10
−19–9.2 × 10
−18 W/Hz.
The smallest received power that can be detected by the developed imaging system prototype is increased due to a clutter BF signal that resulted in reflections of the LO power inside the system. The spectral amplitude of the clutter BF signal can exceed the noise spectral amplitude by one or two orders of magnitude, which can particularly be seen in
Figure 5. The amplitude spectrum of the background signal
IB(
fb), which includes the receiver noise and the clutter signal, is well described by the function
IB =
IN(1 + (
fb0/
fb)
2), where
fb0 is a fitting parameter. Values of
fb0 are different for different receiving elements and lie within a range from 60 kHz to 4 MHz. We suppose that the reflections that result in the clutter signal are from/inside the dielectric lens, which can lead to the law 1/
fb2 of decreasing the clutter signal spectral amplitude at increasing
fb. This issue, however, requires further research.
The control & ADC module consists of five stacked printed circuit boards (PCBs). The top PCB includes a function generator based on Texas Instruments TMS320F28377D micro controller unit (MCU) and a power supply for the BF amplifiers. An output waveform of the function generator has dc and ac components. The dc voltage sets the central frequency of the RF signal; the ac voltage serves as the modulation signal. The function generator signal passes to a high-voltage, high-power amplifier (a device at the lower shelf of the rack in
Figure 8) that supplies power to the BWO. The function generator also provides a synchronization signal for the ADCs.
The bottom four PCBs are identical. Each of them contains four four-channel ADCs (16 ADCs in total) based on the TMS320F28377D MCUs. Thereby, there is an individual ADC for each receiving element, which provides digitizing, recording, and averaging of the BF signal. The linear increasing part of the triangular modulation signal is used to obtain the data.
The averaged digitized data are transmitted from the control & ADC module to a laptop, where the further signal processing is performed. The signal level is corrected in accordance with the sensitivity, Σ, of the corresponding receiving element. Then these signals undergo the FFT procedure, resulting in the amplitude spectrums of the BF signals for all receiving elements.
As is pointed out in
Section 2, at a linear part of a
f(
t) dependence, the BF (
fb) is proportional to the range to an object (
r). Parameters
r0 and
k of the relationship
r =
r0 +
kfb should be determined in a calibration procedure. This procedure starts with measuring the experimental dependence
fb(
r), which is then approximated by the theoretical dependence
fb = (
r −
r0)/
k, with the fitting parameters
r0 and
k. Measurements at distances from 1 to 16 m were carried out for calibrating the 8 × 8 imaging system. The values
r0 = 0.11 m and
k = 0.998 m/kHz were obtained. The reference point of the distance is at the aperture of the horn antenna. It should be noted that, at the given system parameters, values of
fb lie in the 100 kHz range up to a distance of about 100 m.
7. Conclusions
Millimeter waves are used in many applications, and their area of use constantly grows. One of the important applications is robotic systems, which are intended to replace humans in many difficult and dangerous scenarios. Optical cameras, which are actively used in robotic systems, have their limits, and other sensors are often necessary for image acquiring. The robotic systems that operate in bad conditions could be equipped with cameras of different frequency ranges, such as optical, infrared, terahertz, and MMW cameras. This would allow for us to obtain the most complete information about the environment. The optical cameras have high resolution but low penetration. The resolution of MMW cameras is not the highest, but millimeter waves can penetrate through fog, smoke, dust, etc. Cameras of various frequency ranges could give the robotic systems the ability that is not available to humans.
This work was devoted to creating an MMW imaging system with improved characteristics. A new method of acquiring an image in the MMW range was studied. This method is an evolution of the well-known FPA MMW imaging approach. The main difference is the use of a direct-conversion array receiver while employing an FMCW radar technique. This approach allows us to increase the maximum imaging range up to ~100 m, thus keeping the main characteristics of the FPA MMW imaging systems at the same level.