High-speed vision with a 3D-stacked SPAD image sensor

Istvan Gyongy; Germán Mora Martín; Alex Turpin; Alice Ruget; Abderrahim Halimi; Robert Henderson; Jonathan Leach

doi:10.1117/12.2586883

12 April 2021 High-speed vision with a 3D-stacked SPAD image sensor

Istvan Gyongy, Germán Mora Martín, Alex Turpin, Alice Ruget, Abderrahim Halimi, Robert Henderson, Jonathan Leach

Proceedings Volume 11721, Advanced Photon Counting Techniques XV; 1172105 (2021) https://doi.org/10.1117/12.2586883
Event: SPIE Defense + Commercial Sensing, 2021, Online Only

Abstract

3D sensing devices are becoming increasingly prevalent in robotics, self-driving cars, human-computer interfaces, as well as consumer electronics. Recent years have seen single-photon avalanche diodes (SPADs) emerging as one of the key technologies underlying 3D time-of-flight sensors, with the capability to capture accurate 3D depth maps in a range of environmental conditions, and with low computational overhead. In particular, direct ToF SPADs (dToF), which measure the return time of back-scattered laser pulses, form the backbone of many automotive LIDAR systems. We here consider an advanced direct ToF SPAD imager with a 3D-stacked structure, integrating significant photon processing. The device generates photon timing histograms in-pixel, resulting in a maximum throughput of 100's of giga photons per second. This advance enables 3D frames to be captured at rates in excess of 1000 frames per second, even under high ambient light levels. By exploiting the re-configurable nature of the sensor, higher resolution intensity (photon counting) data may be obtained in alternate frames, and depth upscaled accordingly. We present a compact SPAD camera based on the sensor, enabling high-speed object detection and classification in both indoor and outdoor environments. The results suggest a significant potential in applications requiring fast situational awareness.

Conference Presentation

Citation Download Citation

Istvan Gyongy, Germán Mora Martín, Alex Turpin, Alice Ruget, Abderrahim Halimi, Robert Henderson, and Jonathan Leach "High-speed vision with a 3D-stacked SPAD image sensor", Proc. SPIE 11721, Advanced Photon Counting Techniques XV, 1172105 (12 April 2021); https://doi.org/10.1117/12.2586883

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available