Open Access
13 September 2012 Small detectors in infrared system design
Gerald C. Holst, Ronald G. Driggers
Author Affiliations +
Abstract
Recent progress, in small infrared detector fabrication, has raised interest in determining the minimum useful detector size. We approach detector size analysis, from an imaging system point of view, with reasonable assumptions for future sensor design. The analysis is a simplified version of the target task performance model using the parameter Fλ/d for generalization. Our figure-of-merit is a system characteristic. The results are easy to use and yield minimum useful detector size of 2 μm for the mid-wave infrared region (MWIR) and 5 μm for the long-wave infrared region (LWIR) when coupled with an F/1 optical system under high signal-to-noise ratio conditions. Final size depends upon optical design difficulty, manufacturing constraints, noise equivalent differential temperature, and the operational scenario. For challenging signal-to-noise ratio conditions and more reasonable F/1.2 optics, a 3 μm MWIR detector and a 6 μm LWIR detector are recommended. There are many benefits to approaching these detector sizes with low F -number optics. They include lower cost detectors, no need for dual FOV or continuous zoom optics, and no need for dual F -number optics. Our approach provides the smallest volume and lowest weight sensor with maximum range performance. While this paper focuses on infrared design, our approach applies to all imaging sensors.

1.

Introduction

Predicted target acquisition range depends upon a variety of parameters such as system noise, system modulation transfer function (MTF), atmospheric conditions, and target characteristics. The analyst must understand the underlying physics to interpret program outputs and be able to distinguish the effects of each parameter. Models such as the night vision integrated performance model (NV-IPM),1* provide a variety of useful trades. These include range probability versus focal length, aperture diameter, or jitter. However, these trades frequently do not provide insight into basic camera design.

There are many variables. What should be kept constant for a trade study? Choices are field-of-view (FOV), number of detectors (N), detector size, d, chip size, focal length, f, aperture diameter, D, and F-number, F. Many are linked such as FOV=Nd/f and F=f/D. Each graph looks quite different and represents a different slice though this multidimensional space. Optimization of any one parameter becomes more difficult as atmospheric transmission, turbulence, target characteristics, and task difficulty are added.

Range performance depends upon both the optical blur, which is proportional to Fλ, and detector size. The Fλ/d approach24 appears applicable to all imaging systems. Small Fλ/d values represent detector-limited operation, whereas, large values represent optics-limited operation which is also called the diffraction-limited region. In the optics-limited region, decreasing the detector size does not generally increase range. The suggested minimum detector size occurs when the detector size no longer influences range performance. From a sampling view point, this occurs when Fλ/d=2.

There are an infinite number of combinations that satisfy Fλ/d=2. Using a system design approach, this paper suggests that the smallest practical detector size is 2 μm for the mid-wave infrared region (MWIR) and 5 μm for the long-wave infrared region (LWIR) with F/1 optics when the signal-to-noise ratio is high. For challenging signal-to-noise ratio conditions and more reasonable F/1.2 optics, a 3 μm MWIR detector, and a 6 μm LWIR detector are recommended. Our approach provides the smallest volume, lowest weight imaging sensor.

In keeping with the current U.S. military mixed unit terminology, the units of focal length and aperture diameter are inches, FOV is degrees, detector size in micrometers, chip size in millimeters, background temperature in Celsius, and the noise equivalent differential temperature (NEDT) in milliKelvin. In this paper, the FOV, N, and spatial frequency refer to the horizontal direction only. The same equations apply to the vertical direction. The small angle approximation is used throughout the paper although it is not accurate when the FOV is >10deg.

Section 2 addresses the rational for small detectors. Using a step-by-step approach, the MTF is described in Sec. 3 with object space units of cycles/mrad. Then sampling is added to illustrate aliasing. As described in Sec. 4, the most important component is the reconstruction filter. Its presence creates the spurious response (SR). Section 5 introduces a simple figure-of-merit (FOM) from which the acquisition range can be calculated. The NEDT is discussed in Sec. 6. Section 7 provides practical aspects that suggest one wavelength band may be a better choice than the other. As discussed in Sec. 8, final size depends upon optical design difficulty, manufacturing constraints, noise, and the scenario such as cold weather operation, atmospheric conditions, and task on hand. The precise values, shown in this paper, are unique to the spectral responses selected. However, the results are sufficiently general to apply to all imaging systems.

This paper is an extension of Ref. 4. It provides more detail and, thereby, has broader applicability to all imaging systems.

2.

Why Smaller Detectors?

Over the past few years, significant progress has been achieved in small detector fabrication. A few companies have fabricated 5 μm MWIR5 or LWIR detectors in test devices. Fixed format array is the most popular design and are typically 512×512, 640×480, 1280×720, or 1920×1080 pixels. When the detector format is selected, a smaller detector corresponds to a smaller chip. This lowers the detector cost since a single wafer can yield more focal planes. This leads to economy of scale.

In the detector-limited region, reducing the detector size provides better resolution if the focal length is kept constant. This leads to the popular statement, “Smaller detectors provide better resolution.” But the array size is also reduced leading to a smaller FOV. On the other hand, if the focal length is reduced in the same proportion as the detector size, the instantaneous-field-of-view (IFOV), and FOV remain the same. In the optics-limited region, smaller detectors have no effect on system spatial resolution.

For a fixed FOV, fixed F-number, and detector-limited system, a smaller detector mandates a smaller focal length and aperture size. Here, the optics volume decreases with the cube of the detector size. In the optics-limited region, a smaller detector decreases the optics volume by the focal length providing a linear reduction in optical volume. In the transition region between detector-limited and optics-limited, the optics volume reduction is between a cubic and linear reduction. Commensurate with reduced volume is reduced weight. This process leads to size, weight and power (SWAP) reduction.6

Even more significant than system size reduction, is the potential reduction in optical complexity. For example, consider a large 5k×5k array consisting of 5 μm detectors. Coupled with a 6-inch aperture and F/1 optics, the array provides a 9.4 deg wide FOV which is suitable for search and detection. By selecting the central 512×512 detectors, the FOV narrows to 0.96 deg, which is ideal for long range target identification. The FOV switch is performed in software. In fact, the change in FOV is continuous from wide-field-of-view (WFOV) to narrow-field-of-view (NFOV). Both the detection and identification functions exist with a single, low F-number optical system.

3.

MTF and Aliased Signal

The system MTF is dominated by the optics, detector, and display MTFs. Since the detector spatially samples the scene, sampling artifacts further corrupt the image. Other blurs such as aberrations, crosstalk, diffusion, and antenna effects are considered negligible in our approach.

The MTF for a circular diffraction-limited optical system is

Eq. (1)

MTFOPTICS(u)=2π[cos1(uuC)uuC1(uuC)2]

The object-space cutoff frequency is uC=D/λ, where D is the aperture diameter and u has units of cycles/mrad. The average wavelength is used: λ=4μm for the MWIR and λ=10μm for the LWIR. The detector MTF is

Eq. (2)

MTFDETECTOR(u)=|sinc(παu)|=|sin(παu)παu|.

The detectors are square with each side d. The IFOV, α, is simply the detector size divided by the effective focal length: α=d/f. The detector MTF exists for all frequencies from to +. The detector cutoff is defined as the first zero in Eq. (2). It occurs when u=1/α. For simplicity, the detector MTF is plotted up to its cutoff frequency only.

Considering the optics and detector combination, Fλ/d is the ratio of the detector cutoff frequency to optics cutoff frequency. In space, Fλ/d is a measure of the optical blur diameter relative to the detector size. Fλ/d uniquely defines the shape of the optics/detector MTF combination.

The sampling frequency is determined by the detector pitch. Assuming a 100 percent fill factor array, the pitch is equal to the detector size. The sampling frequency, uS, is equal to the detector cutoff and the Nyquist frequency, uN, is 1/2α. In the frequency domain, the scene spatial frequencies are replicated about integer multiples of the sampling frequency. For mathematical simplicity and simple graphs, only the first replication is shown. The higher order replicas further distort the imagery. While not shown, they do not significantly alter the conclusions drawn here. In Figs. 1 and 2, the detector cutoff frequency is normalized to unity and the optics MTF changes with Fλ/d. MTFDO(u)=MTFOPTICS(u)MTFDETECTOR(u). As will be shown later, the detector-limited region occurs when Fλ/d0.41 and the optics-limited region occurs when Fλ/d2.

Fig. 1

Optics and detector MTFs and the signal replica when Fλ/d=0.41. For 100 percent fill factor arrays, the detector cutoff frequency is identical to the sampling frequency.

OE_51_9_096401_f001.png

Fig. 2

Optics and detector MTFs and the signal replica when Fλ/d=2.0.

OE_51_9_096401_f002.png

In-band refers to all spatial frequencies from zero to the Nyquist frequency. The in-band replicated signal decreases as Fλ/d increases. As illustrated in Fig. 2, it is zero when Fλ/d=2. This suggests image quality will not be corrupted by sampling artifacts in the optics-limited region. This is only true if an ideal reconstruction filter is present. The ideal filter has unity response up to the Nyquist frequency and zero thereafter.

4.

Reconstruction

Digital data cannot be seen because it resides in a computer. The reconstruction filter converts it into viewable analog data. Cathode ray tubes (CRT), flat panel displays, light-emitting diode (LED) projectors, and printers are all reconstruction filters. Each has its own unique frequency response. None are ideal. CRT-based displays act somewhat like an ideal reconstruction filter. The work by Schade, Legault, Sequin, and others researched CRT frequency response. They tried to minimize the MTF at Nyquist frequency while maintaining a high in-band response.

A flat panel display does not have the same frequency response as a CRT. Each monochrome display element provides the output of one detector. Here, the display MTF is identical to the detector MTF.

Eq. (3)

MTFFLAT PANEL(u)=|sinc(παu)|=|sin(παu)παu|.

As illustrated in Figs. 3 and 4, the flat panel display modifies both MTFDO(u) and the replicated signal. Here, MTFOUTPUT(u)=MTFFLAT-PANEL(u)MTFDO(u). The modified replicated signal is the SR. The SR represents frequencies that were not in the original scene and it reduces image quality. As illustrated in Fig. 4, there is some out-of-band SR when Fλ/d=2. Out-of-band frequencies are those greater than the Nyquist frequency. Higher Fλ/d values will further reduce the SR. However, it will also reduce in-band MTFDO(u) and further reduce contrast and edge sharpness.

Fig. 3

Spurious response (SR) when Fλ/d=0.41.

OE_51_9_096401_f003.png

Fig. 4

Spurious response (SR) when Fλ/d=2.

OE_51_9_096401_f004.png

The human visual system (HVS) is another reconstruction filter. For convenience, the HVS response is defined as the inverse of the contrast sensitivity function, CTFEYE(u), normalized to unity. As illustrated in Fig. 5, as the observer moves away from the display he will no longer be able to perceive the higher frequencies. Therefore, the SR in Fig. 4 is considered minimal in terms of perceived image quality.

Fig. 5

HVS response for two different viewing distances.

OE_51_9_096401_f005.png

5.

Range Performance

NVThermIP, the precursor to NV-IPM, plots two contrast transfer functions (CTF)

Eq. (4)

CTFSYS-EYE(u)=CTFEYE(u)MTFDISPLAY(u)MTFSYS(u)CTFNOISE(u)=CTFEYE(u)MTFDISPLAY(u)MTFSYS(u)k(QH(u)QV(u)NEDTSCNTMP)2.

The definition of the variables can be found in Ref. 7. Although CTFNOISE includes the eye CTF, the two components appear similar in shape when the three-dimensional noise components are zero. This suggests that the frequency component of CTFNOISE is dominated by CTFEYE. Assuming MDISPLAY=1, the approximations are

Eq. (5)

CTFSYS(u)CTFEYE(u)MTFSYS(u)1+k(NEDTSCNTMP)2

Eq. (6)

TTPCTARGET[1+k(NEDTSCNTMP)2]0.25uLOWuUPPERMTFSYSCTFEYEdu.

The integral in the targeting task performance (TTP) is our FOM. It does not include the NEDT which is discussed in Sec. 6. The lower limit of integration is near zero. For high contrast targets, the upper limit is the Nyquist frequency. Then

Eq. (7)

FOM0uN|MTFOPTICS(u)MTFDETECTOR(u)MTFFLAT PANEL(u)CTFEYE(u)|du.

The integral3 was numerically evaluated for a variety of Fλ/d values normalized to the optical cutoff. NVThermIP was run at a variety of Fλ/d values to obtain the out-of-band SR. These values were multiplied to create a FOM that includes the SR. As illustrated in Fig. 6, a curve fit valid up to Fλ/d=4 is

Eq. (8)

FOM0.0254(Fλd)6+0.2686(Fλd)50.9282(Fλd)4+1.1314(Fλd)31.6296(Fλd)2+7.6343(Fλd).

Fig. 6

FOM.

OE_51_9_096401_f006.png

There are two distinct operating regions. They are detector-limited when Fλ/d0.41 and optics-limited when Fλ/d2.0. The transition region is large. When Fλ/d=0.41, the Airy disk is equal to the detector size. The MTFs are illustrated in Figs. 1 and 3. When Fλ/d=2.0, the optics MTF is zero at uN, as illustrated in Figs. 2 and 4. The location of the optics-limited region is somewhat arbitrary. Schade’s equivalent resolution and the modulation transfer function area (MTFA) suggest3 that the optics-limited region occurs when Fλ/d1.

NVThermIP documentation7 defines inherent contrast as the target, ΔT, divided by the scene contrast, SCNTMP. The apparent target contrast, CTARGET, is the target inherent contrast modified by the atmospheric transmittance, TATM:

Eq. (9)

CTARGET=TATM12ΔTSCNTMP.

Neglecting the NEDT, acquisition range depends upon the target effective size, W, and task difficulty V:

Eq. (10)

Range=WCTARGETVFOMDλ.

The advantage of the FOM is that it is a system characteristic that is independent of noise and atmospheric conditions. Since the range is proportional to the FOM, it is convenient to plot relative range versus Fλ/d as illustrated in Fig. 7. When detector-limited, decreasing the detector size has a dramatic effect on range. On the other hand, in the optics-limited region, decreasing the detector size has minimal effect on range performance.

Fig. 7

Relative range as a function of Fλ/d predicted by the FOM. The acquisition range is reduced when atmospheric transmission and the NEDT are included.

OE_51_9_096401_f007.png

In the detector-limited region, range is independent of wavelength and inversely proportional to the IFOV. Since the FOV simply depends upon the number of detectors, range is inversely proportional to the FOV when the atmosphere is transparent. As illustrated in Fig. 8, to take advantage of the smaller optical blur in the MWIR, d/F must be less than 10. Maximum ranges approximately occurs at d/F=2 in the MWIR and at d/F=5 in the LWIR. These values correspond to detector sizes of 2 μm in the MWIR and 5 μm in the LWIR with F/1 optics.

Fig. 8

Relative range versus d/F for MWIR and LWIR systems using only the FOM. If the aperture diameter increases n-fold, the range increases n-fold.

OE_51_9_096401_f008.png

Note that range is proportional to FOM (D/λ) and FOM is a function of (fλ/Dd). The aperture diameter appears in both quantities. As such, Figs. 6 to 8 are appropriate for fixed aperture analysis where the focal length is varied. If the focal length is held constant with the aperture diameter as a variable, the curves look quite different. Those graphs are provided in Sec. 7.

As illustrated in Fig. 9, straight lines4 originating at the origin represent constant range. Table 1 provides the required F-number for Fλ/d=2 for various detector sizes. Each LWIR combination, d=5μm with F/1 optics or d=6μm with F/1.2 optics, provides the same range. Likewise, each MWIR combination provides the same range. In the detector-limited region, the MWIR and LWIR ranges are equal. In the optics-limited region, the MWIR range is greater by the ratio of wavelengths under high signal-to-noise ratio conditions.

Fig. 9

Fλ-d space. Straight lines represent constant range and constant NEDT. There are an infinite number of combinations that provide the same range.

OE_51_9_096401_f009.png

Table 1

Required F-number for Fλ/d=2. Real optics usually has F>1.

d (μm)MWIRLWIR
21.0
2.51.25
31.33
52.51.0
63.01.2
126.02.4
157.53.0
178.53.4
20104.0
2512.55.0

6.

NEDT

The NEDT is a widely used measure of thermal imaging system sensitivity. For photon detectors, it can be calculated from first principles.8 It is routinely measured.9 Its value depends upon a myriad of parameters. Here, two different charge well capacities are considered, 6 million and 12 million electrons. These capacities are possible though careful design by expanding the well in the z-direction. The integration time, tINT, is variable and arbitrarily selected to maintain 50 percent well capacity, however, other values such 35 percent could have been used. The maximum integration time is limited by the frame rate. Assuming 60 Hz operation and allowing for readout time, the maximum integration time is set at 12 ms. The spectral response of the MWIR detector is 3.6 to 5.1 μm. The CO2 notch cold filter transmission at 4.2 μm is included in τFILTER(λ). The response of the LWIR detector is spectrally flat from 8 to 12 μm. For both, the quantum efficiency, η, is 0.8 and the optical transmission, τOPTICS, is 0.8 with no spectral features.

The number8 of photoelectrons generated by the background at temperature TB is

Eq. (11)

nPHOTOELECTRON=[λ1λ2η4τOPTICSτFILTER(λ)Mq(λ,TB)dλ](dF)2tINT,
where Mq(λ,T) is Planck’s blackbody photon flux equation. As the background temperature decreases, the photon flux decreases. The integration time must increase to compensate for this flux reduction to maintain a fixed well fill. A small change between target and background, Mq(λ,TT)Mq(λ,TB), is approximated8 by the thermal derivative multiplied by the target ΔT. The signal-to-noise ratio is

Eq. (12)

SNR=[λ1λ2η4τOPTICSτFILTER(λ)Mq(λ,TB)Tdλ](dF)2tINTΔTnSYS,
where nSYS is the noise standard deviation with units of rms electrons. It includes photoelectron shot noise, dark current shot noise, fixed pattern noise, read noise, and quantization noise. Assuming photoelectron shot noise dominates, using Poisson statistics where the variance equals the mean, setting SNR=1, solving for ΔT and calling the solution the NEDT provides

Eq. (13)

NEDT=Fd1tINT2ητOPTICSλ1λ2τFILTER(λ)Mq(λ,TB)dλλ1λ2τFILTER(λ)Mq(λ,TB)Tdλ.

The NEDT is independent of F/d if the integration time changes to maintain a fixed well fill. This occurs when tINT<12ms. For a particular waveband, the NEDT is constant with Fλ/d. Referring to Fig. 9, lines originating from the origin also represent constant NEDT for any specific background temperature.

Figure 10 provides the integration time as a function of background temperature for a typical MWIR system with 17 μm detectors. When the temperature decreases to 35°C for the 6Me well or 22.9°C for the 12Me well, the maximum integration time is reached. The NEDT is plotted in Fig. 11. The larger well permits a longer integration time and therefore, a lower NEDT. The difference between the wells is a factor of 2. Therefore, at any specific background temperature, the difference in integrations times is a factor of 2 and the difference in NEDT is 2.

Fig. 10

MWIR integration time as a function of TB. Fλ/d=0.235 The horizontal line at 4 ms represents maximum desired value during panning.

OE_51_9_096401_f010.png

Fig. 11

MWIR NEDT as a function of TB. Fλ/d=0.235.

OE_51_9_096401_f011.png

The scarcity of photons in the MWIR makes this spectral region less desirable for low background temperature operation. As illustrated in Fig. 12 and by Eq. (13), the NEDT is inversely proportional to d when F and tINT are fixed. This competes with the desire to have small detectors.

Fig. 12

MWIR NEDT as a function of detector size for different TB for 12Me well. The curves start at d=2μm, Fλ/d=2, and become horizontal when tINT<12ms.

OE_51_9_096401_f012.png

Figure 13 illustrates MWIR NEDT as a function of Fλ/d. The NEDT is constant when tINT<12ms. Once the maximum integration time is reached, the NEDT increases. Most current detector sizes are greater than 17 μm and Fλ/d is typically less than 0.5. Thus, the NEDT variation with TB has been less objectionable so far. There are an abundance of photons in the LWIR and tINT is always less than 12 ms. Figure 14 illustrated the LWIR variation in NEDT with TB. The seemingly high LWIR NEDT values are caused by the extremely short integration times of tens of microseconds to a few milliseconds depending upon Fλ/d and the background temperature.

Fig. 13

MWIR NEDT for 12Me well. The vertical line at Fλ/d=0.235 corresponds to Figs. 10 and 11 values.

OE_51_9_096401_f013.png

Fig. 14

LWIR NEDT for all Fλ/d values.

OE_51_9_096401_f014.png

7.

System Design

There are two different system design approaches. The first is fixed array format and the second is fixed chip size. With fixed format, as the detector size decreases, the chip size decreases. The focal length must decrease to maintain the FOV. With fixed chip size, as the detector size decreases, the number of detectors increases and the FOV remains constant.

7.1.

Fixed Array Format

Generally, search and detection are performed in the WFOV with identification performed in the NFOV. WFOV for tactical systems and, especially, in ground combat systems ranges from 10 deg to 40 deg. Changing the FOV is achieved by inserting a lens in the optical train or employing zoom optics. Using the small angle approximation, the ratio of WFOV to NFOV is simply the ratio of focal lengths. Practically, the FOV ratio should be about 3 to 6. If the ratio is greater, additional optics should be considered to create a medium FOV or a series of interim FOVs.

Aperture size is constrained by the platform. Typical aperture sizes on fighter aircraft, helicopters, and tanks are 6 inches for long range acquisition. Typical aperture sizes on small arms, dismount sights, and small scout systems are about 3 inches for short range acquisition. The NFOV will always use the large aperture. The WFOV requires a shorter focal length. Ideally, the F-numbers should remain constant when switching FOVs to maintain the same contrast. This results in a smaller WFOV aperture.

Another choice is different F-numbers for WFOV and NFOV. This is known as a dual F-number system. For maximum search and detection range the F-number should approach F/1 to maximize the signal as indicated by Eq. (11). For maximum identification ranges, Fλ/d should approach 2 as illustrated in Fig. 7. Dual or variable F-numbers provide a performance enhancement10 over a dual FOV, single F-number system. A dual FOV system is mechanically less robust due to moving lenses. A variable, dual F-number, cold shield in the cryogenic space presents an even more challenging design.10

Assume the target contrast and target size is the same in both bands, atmospheric transmission is unity, and no noise is present. Using Eq. (10), the range is proportional to (D/Vλ)FOM. NVThermIP documentation7 recommends that the task difficulty parameter, V, be 2.7 for detection and 18.8 for identification. In the detector-limited region, the FOM is proportional to Fλ/d and the range is inversely proportional to the FOV as illustrated in Fig. 15. For fixed FOVs, the detection range is 18.8/2.7 or approximately 7 times greater than the identification range. This is offset by having the WFOV approximately 7 times the NFOV size. Small FOVs generally operate in the optics-limited region as illustrated in Fig. 16. In the optics-limited region, FOM10.3 and range is proportional to 10.3(D/Vλ).

Fig. 15

Relative LWIR WFOV detection range for a 512×512 array. V=2.7. In the detector-limited region, range is independent of aperture size.

OE_51_9_096401_f015.png

Fig. 16

Relative LWIR NFOV identification range for a 512×512 array. V=18.8.

OE_51_9_096401_f016.png

7.2.

Fixed Chip Size

A more interesting approach considers a fixed chip size. Representative sizes are 25 mm for long range acquisition systems and 12.5 mm for short range acquisition systems. A 2 μm MWIR detector will have 12.5k×12.5k pixels and a 5 μm LWIR detector will have 5k×5k pixels on a 25 mm chip. The detector count is one-half that for the 12.5 mm array.

The full focal plane would be mapped onto the display for the WFOV. In the NFOV, the central 512 pixels would be displayed. This FOV switch is performed entirely in software and, in fact, continuous zoom can be implemented electronically. Moving optics is not required to change FOV and dual F-number cold shielding is not necessary. The WFOV to NFOV ratio is simply N/512.

7.3.

Practical Considerations (MWIR or LWIR)

The best wavelength band for any given task at hand depends upon the atmospheric transmission, atmospheric turbulence, background temperature, scene conditions, and target contrast. Some situations suggest a MWIR solution and others suggest a LWIR solution. It is impossible to satisfy all requirements. Various scenarios are briefly listed below.

7.3.1.

Atmospheric transmission

In a humid environment, the atmospheric transmission is higher in the MWIR. As a result, many maritime and naval application sensors are MWIR. A cold, dry environment has a higher transmission in the LWIR. Systems designed by Nordic countries usually operate in the LWIR.

In the detector-limited region, the range is independent of wavelength. This means that MWIR and LWIR systems should provide the same range if the NEDTs are equal. However, when using NVThermIP, MWIR, and LWIR provide different ranges because the atmospheric conditions are different. Here, the atmospheric conditions are the primary performance discriminator and not the basic camera design.

7.3.2.

Atmospheric turbulence

Imaging through turbulence degrades11 MWIR performance more than LWIR range performance. For ground-to-ground applications, turbulence effects are larger than for air-to-ground and air-to-air applications.

7.3.3.

Cold weather

As illustrated in Fig. 12, MWIR suffers significant performance degradation12 in cold environments. There is an abundance of photons in the LWIR so that the NEDT does not increase at low temperatures. At very cold temperatures, the identification range provided by a MWIR imager can be significantly less than that of a LWIR imager.

7.3.4.

Dirty battlefield

Historically, target acquisition systems for ground applications were LWIR to view through dirty battlefield conditions. Hot targets such as burning barrels, burning tanks, fires, and exhausts cause detector saturation and blooming. They also create veiling glare in the optical system. Due to a shift in Planck’s blackbody curve towards shorter wavelengths, hot target effects are an order of magnitude worse in MWIR than in LWIR. Under these conditions, a MWIR sensor can be rendered useless13 while a LWIR sensor can still be used to view the battlefield.

Combat obscurant smokes are somewhat transparent in the infrared. Experiments and analysis show that smoke14 does not degrade LWIR performance and degrades MWIR performance in a small to moderate, but not devastating, way. Smoke does not eliminate the MWIR long range identification advantage. Overall, there are a number of circumstances where ground forces, and to some extent aviation, rely on LWIR in dirty battlefield conditions where it is too risky to depend on a MWIR-only sensor.

7.3.5.

Integration time

Sensor motion, which occurs during panning and pilotage, increases image blur. Field studies15 have shown that image quality degrades when the integration time is greater than 4 ms when there is significant sensor motion. In the LWIR, the integration time is less than 4 ms for all background temperatures, 70°C to 50°C. This is not true in the MWIR where there is a scarcity of photons. As illustrated in Fig. 17, this small integration time only exists for small Fλ/d ratios. This suggests MWIR should not be used for pilotage or panning if Fλ/d>0.4.

Fig. 17

Maximum Fλ/d for 50% well fill. The horizontal line at 0.235 corresponds to Fig. 10.

OE_51_9_096401_f017.png

7.3.6.

Range performance

The range predictions illustrated in Fig. 7 do not include atmospheric transmission or the NEDT. Section 6 listed factors that affect the NEDT. Using NVThermIP, ranges were predicted for a 0.79-inch fixed aperture MWIR sensor. The 512×512 array contains 17 μm detectors. The integration time and performance parameter,8 D*, were varied to obtain the NEDT in Fig. 13 at the NVThermIP default background temperature of 27°C. The FOV and focal length were varied to obtain various Fλ/d values. Since the graph is a function of Fλ/d, choosing a larger aperture, such as 6 inches, affects the focal length and FOV, but the range remains constant. The other variables were target ΔT=2°C, SCNTMP=2°C, and VIDENTIFICATION=18.8. The atmospheric transmission was approximated by Beer’s law to avoid spectral transmission effects. Transmission per km, τ, was set at 0.7 to approximate poor weather and 0.85 for average weather conditions. The ranges are illustrated in Fig. 18. Equation (10) predictions were compared to the transparent atmosphere, τ=1, case. The difference, less than 8 percent, is believed due to system magnification16 issues. The predicted range with a real atmosphere, such as mid-latitude summer or subartic winter, can be quite different due to spectral transmission variations in the various environments.

Fig. 18

Range predictions for real targets and real atmospheric conditions.

OE_51_9_096401_f018.png

7.4.

Dual Band (MWIR+LWIR) Imager

The dual-band imager configuration optimizes many of the scenarios listed in Sec. 7.3 and also takes advantage of the increased MWIR range for high Fλ/d ratios as illustrated in Fig. 8. Generally, the LWIR is used for search and detection and the MWIR for identification. These ranges are illustrated in Figs. 15 and 19. It could also be a dual F-number system. These bands can be used separately in a manner similar to two independent sensors that are used one at a time depending on the conditions and task that is favorable for a particular band. During adverse conditions such as cold weather, panning, and the dirty battlefield, the LWIR system is used exclusively. The LWIR ranges are illustrated in Figs. 15 and 16.

Fig. 19

Relative MWIR NFOV identification range for a 512×512 array. V=18.8.

OE_51_9_096401_f019.png

Comparing Figs. 16 and 19, MWIR range performance is 2.5 times that of a LWIR system in the optics-limited region. This is simply the ratio of wavelengths, 10/4. When adding atmospheric transmission to the calculation, the range performance is nearly double17 that of LWIR system with an equivalent aperture. In the detector-limit region, the ranges are the same.

7.5.

Uncooled Sensors

The strong noise dependence on F-number forces uncooled devices3 to be designed with F/1 optics. Uncooled detectors usually operate in the LWIR region. Therefore, to obtain Fλ/d=2 with F=1, the detectors must be 5 μm.

8.

Discussion

Based upon MTF theory, supported by sampling theory, and TTP range predictions, the desired detector sizes are 2 μm in the MWIR and 5 μm in the LWIR when coupled with F/1 optics when the signal-to-noise ratio is high.

There is a scarcity of photons in the MWIR. As a result, the NEDT increases dramatically as the ambient temperature decreases. Although MTF theory suggests a good design point is Fλ/d=2, larger detectors should be used in the MWIR to minimize the increased cold weather NEDT. As illustrated in Fig. 12, a detector size of 2.5 μm gives a reasonable NETD of 43 mK with F/1 optics at a background temperature of 10°C. Now, Fλ/d=1.6. Below 10°C, detector outputs could be binned or grouped to reduce the NEDT. Binning creates a larger effective detector size, reduces Fλ/d, and this reduces range at cold temperatures. This suggests that LWIR is the band of choice in a cold weather environment.

The selection of 2.5 and 5 μm detectors were based upon F/1 optics. It is much easier to design and fabricate an F/1.2 system. This increases the minimum detector size to 3 μm in the MWIR and 6 μm in the LWIR. Various combinations are provided in Table 1.

What does this mean for dual band focal planes? Ideally, one would desire a 2.5 μm (or 3 μm) MWIR detector and a 5 μm (or 6 μm) LWIR detector on the same focal plane. A conceptual architecture would provide four MWIR detectors for every larger LWIR detector in a sandwich configuration.

9.

Conclusions

The Fλ/d approach is applicable to all imaging systems. It is a good metric that describes performance of all systems ranging from detector-limited to optics-limited operation. It is a good approach when the signal-to-noise ratio is high. This occurs with high atmospheric transmission, good target contrast, and good background temperatures resulting in good apparent target contrast. With F/1 optics, the smallest useful detector size is 2 μm in the MWIR and 5 μm in the LWIR. With challenging signal-to-noise conditions and more realistic F/1.2 optics, the smallest useful detector size is 3 μm in the MWIR and 6 μm in the LWIR.

In the detector-limited region, range is inversely proportional to the FOV. In the optics-limited region, range is proportional to the aperture diameter.

An exciting approach is to fabricate a large chip with many detectors. Now variable FOVs are possible with the same optics. This provides a single system optimized both for target detection and target identification. The constant chip size and smaller detector approach provides a number of advantages over current system designs. It provides long range diffraction-limited target identification at low F-number commensurate with past system of larger apertures. It provides instant NFOV to WFOV switching or continuous zoom controlled by software with no moving optics. It also provides a physically smaller imager than current high F-number systems.

There are many benefits to approaching these detector sizes with low F-number optics to include less expensive detectors, no need for dual FOV or continuous zoom optics, and no need for dual F-number optics. Our approach provides the smallest volume and lowest weight imager with maximum range performance. While this paper focused on infrared design, the approach applies to all imaging sensors.

Notes

*Night vision and electronic sensors directorate (NVESD) released a beta version of NV-IPM at the SPIE Defense, Security and Sensing Symposium held 23 to 27 April 2012. The final version is expected to be released by the end of 2012.

References

1. 

B. TeaneyJ. Reynolds, “Next generation imager performance model,” Proc. SPIE, 7662 76620F (2010). http://dx.doi.org/10.1117/12.850876 PSISDG 0277-786X Google Scholar

2. 

R. D. Fiete, “Image quality and λFN/ρ for remote sensing,” Opt. Eng., 38 (7), 1229 –1240 (1999). http://dx.doi.org/10.1117/1.602169 OPENEI 0892-354X Google Scholar

3. 

G. C. Holst, “Imaging system performance based upon Fλ/d,” Opt. Eng., 46 (10), 103204 (2007). http://dx.doi.org/10.1117/1.2790066 OPENEI 0892-354X Google Scholar

4. 

R. G. Driggerset al., “Infrared detector size: how low should you go?,” Opt. Eng., 51 (6), 063202 (2012). http://dx.doi.org/10.1117/1.OE.51.6.063202 OPENEI 0892-354X Google Scholar

5. 

P. ThorneH. WellerL. G. Hipwood, “12 μm pixel pitch development for 3-side buttable megapixel MW FPAs,” Proc. SPIE, 8353 83532J (2012). http://dx.doi.org/10.1117/12.919075 PSISDG 0277-786X Google Scholar

6. 

M. Vuillermetet al., “Status of MCT focal plane arrays in France,” Proc. SPIE, 8353 83532K (2012). http://dx.doi.org/10.1117/12.921868 PSISDG 0277-786X Google Scholar

7. 

R. H. Vollmerhausenet al., “The targeting task performance (TTP) metric, a new model for predicting target acquisition performance,” (2005). Google Scholar

8. 

G. C. Holst, Electro-Optical Imaging System Performance, 5th ed.JCD Publishing Company, Winter Park, FL (2008). Google Scholar

9. 

G. C. Holst, Testing and Evaluation of Infrared Imaging Systems, 3rd ed.JCD Publishing Company, Winter Park, FL (2008). Google Scholar

10. 

R. G. Driggerset al., “Performance benefit of dual F-number in MWIR infrared systems,” in Military Sensing Symposium, (2007). Google Scholar

11. 

P. RichardsonR. Driggers, “Turbulence effects on 3rd generation FLIR performance,” Proc. SPIE, 6207 620706 (2006). http://dx.doi.org/10.1117/12.665836 PSISDG 0277-786X Google Scholar

12. 

V. Hodgkinet al., “Modeling of IR sensor performance in cold weather,” Proc. SPIE, 6207 620708 (2006). http://dx.doi.org/10.1117/12.664436 PSISDG 0277-786X Google Scholar

13. 

N. SupolaJ. SonstroemJ. Vizgaitis, “Dual band MW/LW focal plane array and integrated dewar cooler assembly electrical and optical responses to high flux targets,” in 2008 Meeting on the Military Sensing Symposia Specialty Group on Detectors, (2008). Google Scholar

14. 

D. Tomkinsonet al., “Combat smokes in the Mid-wave and Long-wave infrared,” in 2006 Parallel Meetings of the Military Sensing Symposia (MSS) Specialty Groups on Passive Sensors; Camouflage, Concealment, and Deception; and Materials, (2006). Google Scholar

15. 

B. Milleret al., “Detector integration time issues associated with FLIR performance,” Proc. SPIE, 6207 620704 (2006). http://dx.doi.org/10.1117/12.665854 PSISDG 0277-786X Google Scholar

16. 

B. P. TeaneyJ. Fanning, “Effect of image magnification on target acquisition performance,” Proc. SPIE, 6941 (2008). http://dx.doi.org/10.1117/12.779191 PSISDG 0277-786X Google Scholar

17. 

R. G. Driggerset al., “Third generation FLIR performance as a separable MWIR/LWIR target acquisition sensor,” in Military Sensing Symposium, (2005). Google Scholar

Biography

OE_51_9_096401_d001.png

Gerald C. Holst is president of JCD Publishing Company and a consultant for imaging system analysis and testing. He has chaired the SPIE conference Infrared Imaging Systems: Design, Analysis, Modeling and Testing since 1989. He is author of over 30 journal articles and 6 books (published by SPIE and/or JCD Publishing). He is a member of OSA and IEEE and is a SPIE Fellow.

OE_51_9_096401_d002.png

Ronald G. Driggers was appointed to the Senior Executive Service as the superintendent of the Optical Sciences Division at the Naval Research Laboratory in 2008. He currently manages the efforts of more than 200 scientists and engineers and over $100M in research and development programs. Previously, he was the director of the Modeling and Simulation Division at the U.S. Army’s Night Vision and Electronic Sensors Directorate (NVESD).

© 2012 Society of Photo-Optical Instrumentation Engineers (SPIE) 0091-3286/2012/$25.00 © 2012 SPIE
Gerald C. Holst and Ronald G. Driggers "Small detectors in infrared system design," Optical Engineering 51(9), 096401 (13 September 2012). https://doi.org/10.1117/1.OE.51.9.096401
Published: 13 September 2012
Lens.org Logo
CITATIONS
Cited by 69 scholarly publications.
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Sensors

Mid-IR

Long wavelength infrared

Modulation transfer functions

Infrared sensors

Infrared radiation

Signal to noise ratio

Back to Top