We developed a 300,000-pixel ultrahigh-speed CCD with a maximum frame rate of 2,000,000 frames per second. The
shooting speed of the CCD was possible by directly connecting CCD memories, which record video images, to the
photodiodes of individual pixels. The simultaneous parallel recording operation of all pixels results in the ultimate frame
rate. We analyzed a voltage wave pattern in the equivalent circuit model of the ultrahigh-speed CCD by using a SPICE
simulator to estimate the maximum frame rate. The pixel area was consisted of 410 and 720 pixels in the vertical and
horizontal and divided into 8 blocks for parallel driving. An equivalent circuit of one block was constructed from an RC
circuit with 410 × 90 pixels. The voltage wave pattern at the final stage of an equivalent circuit was calculated when a
square wave pulse was input. Results showed that the square wave pulse became blunt when the driving speed was
increased. After estimation, we designed the layout of the new ultrahigh-speed CCD V6 and fabricated the device.
Results of an image capturing experiment indicated a saturation signal level of 100% that was maintained up to 300,000
frames per second. A saturation signal level of 50% was observed in 1,000,000 frames per second and of 13% in
2,000,000 frames per second. We showed that the maximum frame rate is dependent on a drop of the saturation signal
level resulting from the driving voltage wave pattern becoming blunt.
A structure for backside illuminated ultrahigh-speed charge coupled devices (CCDs) designed to improve the light
sensitivity was investigated. The structure's shooting speed of 1 million frames/second was made possible by directly
connecting CCD memories, which record video images, to the photodiodes of individual pixels. The simultaneous
parallel recording operation of all pixels results in the highest possible frame rate. Because back-side illumination
enables a fill factor of 100% and a quantum efficiency of 60%, sensitivity ten or more times that of front-side
illumination can be achieved. Applying backside illumination to ultrahigh-speed CCDs can thus solve the problem of a
lack of incident light. An n- epitaxial layer/p- epitaxial layer/p+ substrate structure was created to collect electrons
generated at the back side traveling to the collection gate. When a photon reaches the deep position near the CCD
memory in the p-well, an electron generated by photoelectric conversion directly mixes into the CCD memory. This
mixing creates noise, making it necessary to reduce the reach of the incident light. Setting the thickness of a double
epitaxial layer to 30 μm, however, will inhibit the generation of this noise. A potential profile for the n-/p-/p+ structure
was calculated using a three-dimensional semiconductor device simulator. The transit time from electron generation to
arrival at the collection gate was also calculated. The concentrations of the n- and p- epitaxial layers were optimized to
minimize transit time, which was ultimately 1.5 ns. This value is adaptive to a frame rate of 100 million frames/second.
Charge transfer simulation of a part of the pixel was conducted to confirm the smooth transfer of electrons without their
staying too long in one place.
We developed an ultrahigh-speed color video camera that operates at 1,000,000 fps (frames per second) and had capacity to store 288 frame memories.
In 2005, we developed an ultrahigh-speed, high-sensitivity portable color camera with a 300,000-pixel single CCD (ISIS-V4: In-situ Storage Image Sensor, Version 4). Its ultrahigh-speed shooting capability of 1,000,000 fps was made possible by directly connecting CCD storages, which record video images, to the photodiodes of individual pixels. The number of consecutive frames was 144. However, longer capture times were demanded when the camera was used during imaging experiments and for some television programs.
To increase ultrahigh-speed capture times, we used a beam splitter and two ultrahigh-speed 300,000-pixel CCDs. The beam splitter was placed behind the pick up lens. One CCD was located at each of the two outputs of the beam splitter. The CCD driving unit was developed to separately drive two CCDs, and the recording period of the two CCDs was sequentially switched. This increased the recording capacity to 288 images, an increase of a factor of two over that of conventional ultrahigh-speed camera.
A problem with the camera was that the incident light on each CCD was reduced by a factor of two by using the beam splitter. To improve the light sensitivity, we developed a microlens array for use with the ultrahigh-speed CCDs. We simulated the operation of the microlens array in order to optimize its shape and then fabricated it using stamping technology. Using this microlens increased the light sensitivity of the CCDs by an approximate factor of two.
By using a beam splitter in conjunction with the microlens array, it was possible to make an ultrahigh-speed color video camera that has 288 frame memories but without decreasing the camera's light sensitivity.
A feasibility study is presented for an image sensor capable of image capturing at 100 Mega-frames per second (Mfps). The basic structure of the sensor is the backside-illuminated ISIS, the in-situ storage image sensor, with slanted linear CCD memories, which has already achieved 1 Mfps with very high sensitivity. There are many potential technical barriers to further increase the frame rate up to 100 Mfps, such as traveling time of electrons within a pixel, Resistive-Capacitive (RC) delay in driving voltage transfer, heat generation, heavy electro-magnetic noises, etc. For each of the barriers, a countermeasure is newly proposed and the technical and practical possibility is examined mainly by simulations. The new technical proposals include a special wafer with n and p double epitaxial layers with smoothly changing doping profiles, a design method with curves, the thunderbolt bus lines, and digitalnoiseless image capturing by the ISIS with solely sinusoidal driving voltages. It is confirmed that the integration of these technologies is very promising to realize a practical image sensor with the ultra-high frame rate.
In order to investigate the unsteady flow field around a spiked body in supersonic flow, time-resolved color schlieren
visualization was applied using a high-speed video camera which could take up to 1 000 000 frames per second at full
frame resolution. Conically and spherically tipped spikes of six different lengths could be attached at the center of the
model and their effect on the flow unsteadiness was visually observed. The obtained images revealed in great detail the
interaction between the incoming free stream flow and the high-pressure region near the model base, which could make
its presence known upstream at the tip of the spike by means of displacing the boundary layer on the spike and
subsequently inducing a large-scale instability of the flow.
We are advancing the development of ultrahigh-speed, high-sensitivity CCDs for broadcast use that are capable of capturing smooth slow-motion videos in vivid colors even where lighting is limited, such as at professional baseball games played at night. We have already developed a 300,000 pixel, ultrahigh-speed CCD, and a single CCD color camera that has been used for sports broadcasts and science programs using this CCD. However, there are cases where even higher sensitivity is required, such as when using a telephoto lens during a baseball broadcast or a high-magnification microscope during science programs. This paper provides a summary of our experimental development aimed at further increasing the sensitivity of CCDs using the light-collecting effects of a microlens array.
KEYWORDS: Cameras, Charge-coupled devices, CCD cameras, Signal processing, Digital signal processing, Video, Field programmable gate arrays, Image processing, Photodiodes, Eye
We have developed an ultrahigh-speed, high-sensitivity portable color camera with a new 300,000-pixel single CCD.
The 300,000-pixel CCD, which has four times the number of pixels of our initial model, was developed by seamlessly
joining two 150,000-pixel CCDs. A green-red-green-blue (GRGB) Bayer filter is used to realize a color camera with the
single-chip CCD. The camera is capable of ultrahigh-speed video recording at up to 1,000,000 frames/sec, and small
enough to be handheld. We also developed a technology for dividing the CCD output signal to enable parallel, highspeed
readout and recording in external memory; this makes possible long, continuous shots up to 1,000 frames/second.
As a result of an experiment, video footage was imaged at an athletics meet. Because of high-speed shooting, even
detailed movements of athletes' muscles were captured. This camera can capture clear slow-motion videos, so it enables
previously impossible live footage to be imaged for various TV broadcasting programs.
This paper presents further results of an ongoing experimental and numerical investigation into the unsteady process of
blast wave reflection from straight smooth surfaces. It is shown that basic blast wave phenomena such as the transition
from regular to irregular wave reflection can be adequately and conveniently studied in a laboratory environment by
using small charges with masses in the milligram range. While the laboratory scale generally provides greater
accessibility, it also imposes more stringent conditions on the diagnostics than the large-scale environment. The paper
reviews the previously found considerable discrepancies between numerical and experimental results for the location xtr
of the transition from regular to irregular wave reflection. These are caused by the initially minuscule size and gradual
growth of the Mach stem and the limited resolution of the recording material. Different techniques are used to improve
the accuracy of the experimental determination of the transition point, and a new combination of modern high-speed
photography with the traditional soot technique is shown to be the most promising tool for this purpose.
We are developing an ultrahigh-speed, high-sensitivity broadcast camera that is capable of capturing clear, smooth slow-motion videos even where lighting is limited, such as at professional baseball games played at night. In earlier work, we developed an ultrahigh-speed broadcast color camera1) using three 80,000-pixel ultrahigh-speed, highsensitivity CCDs2). This camera had about ten times the sensitivity of standard high-speed cameras, and enabled an entirely new style of presentation for sports broadcasts and science programs. Most notably, increasing the pixel count is crucially important for applying ultrahigh-speed, high-sensitivity CCDs to HDTV broadcasting. This paper provides a summary of our experimental development aimed at improving the resolution of CCD even further: a new ultrahigh-speed high-sensitivity CCD that increases the pixel count four-fold to 300,000 pixels.
An image sensor for an ultra-high-speed video camera was developed. The maximum frame rate, the pixel count and the number of consecutive frames are 1,000,000 fps, 720 x 410 (= 295,200) pixels, and 144 frames. A micro lens array will be attached on the chip, which increases the fill factor to about 50%. In addition to the ultra-high-speed image capturing operation to store image signals in the in-situ storage area adjacent to each pixel, standard parallel readout operation at 1,000 fps for full frame readout is also introduced with sixteen readout taps, for which the image signals are transferred to and stored in a storage device with a large capacity equipped outside the sensor. The aspect ratio of the frame is about 16 : 9, which is equal to that of the HDTV format. Therefore, a video camera with four sensors of the ISIS-V4, which are arranged to form the Bayer’s color filter array, realizes an ultra-high-speed video camera of a semi-HDTV format.
We developed an ultrahigh-speed, high-sensitivity, color camera that captures moving images of phenomena too fast to be perceived by the human eye. The camera operates well even under restricted lighting conditions. It incorporates a special CCD device that is capable of ultrahigh-speed shots while retaining its high sensitivity. Its ultrahigh-speed shooting capability is made possible by directly connecting CCD storages, which record video images, to photodiodes of individual pixels. Its large photodiode area together with the low-noise characteristic of the CCD contributes to its high sensitivity. The camera can clearly capture events even under poor light conditions, such as during a baseball game at night. Our camera can record the very moment the bat hits the ball.
We propose a novel integration of compression and sensing in order to enhance performance of the image sensor. By integrating compression function on the sensor plane, the image signal that has to be readout from the sensor is significantly reduced. Thus, the integration can consequently increase the pixel rate of the sensor. The compression scheme we make use of is conditional replenishment that detects and encodes moving areas. In this paper, we discuss design and implementation of two architectures for on sensor compression. One is pixel parallel approach and the other is column parallel approach. We describe and compare both approaches.
NHK led the world in developing a high-sensitivity Super-HARP pickup tube using the avalanche multiplication effect. The authors have now developed an improved version (2/3- inch, with electromagnetic focusing and electromagnetic deflection) which is eight times more sensitive and has much better lag characteristics. The handy New Super-HARP color camera which uses this newly-developed pickup tube has higher sensitivity than human vision (2000 lux, F/110 equivalent), negligible low lag, and a limiting resolution of over 700 TV lines. It will be a powerful tool in emergency news gathering at night, the production of scientific programs, and other applications.
KEYWORDS: Sensors, Image compression, Image sensors, Image processing, Prototyping, Signal processing, CMOS sensors, Analog electronics, Signal to noise ratio, Very large scale integration
In this paper, we propose a novel image sensor which compresses image signal on the sensor plane. Since image signal is compressed on the sensor plane by making use of the parallel nature of image signals, the amount of signal read out from the sensor can be significantly reduced. Thus, the proposed sensor can be potentially applied to high pixel rate cameras and processing systems which require very high speed imaging or very high resolution real time imaging. The very high bandwidth is the fundamental limitation to the feasibility of those high pixel rate sensors and processing systems. Conditional replenishment is employed for the compression algorithm. In each pixel, current pixel value is compared to that in the last replenished frame. The value and the address of the pixel is extracted and coded if the magnitude of the difference is greater than a threshold. Analog circuits have been designed both for processing in each pixel and for controlling entire data rate. A first prototype of a VLSI chip has been fabricated. Some results of experiments obtained by using the first prototype are shown in this paper.
An ultra-sensitive underwater super-HARP color TV camera has been developed. The characteristics -- spectral response, lag, etc. -- of the super-HARP tube had to be designed for use underwater because the propagation of light in water is very different from that in air, and also depends on the light's wavelength. The tubes have new electrostatic focusing and magnetic deflection functions and are arranged in parallel to miniaturize the camera. A deep sea robot (DOLPHIN 3K) was fitted with this camera and used for the first sea test in Sagami Bay, Japan. The underwater visual information was clear enough to promise significant improvements in both deep sea surveying and safety. It was thus confirmed that the Super- HARP camera is very effective for underwater use.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.