Presentation
7 December 2022 Efficient generation of photo-realistic SPAD data for 3D imaging and ranging
Stirling Scholes, German Mora-Martin, Alice Ruget, Feng Zhu, Phil Soan, Istvan Gyongy, Jonathan Leach
Author Affiliations +
Abstract
The recent development of single-photon avalanche diode (SPADs) arrays as imaging sensors with both picosecond binning capabilities and single photon sensitivity has led to the rapid development of time-of-flight imaging systems however, simulations of SPAD systems outside of the Poisson regime remain rare. Here we present a model for SPAD systems which combines single photon counting statistics with computational parallelization which together enable the efficient generation of photo-realistic SPAD data. We confirm the accuracy of out model by experimental verification. Further, we apply this simulator to the problem of drone identification, orientation, and, segmentation. The proliferation of semi-autonomous aerial multi-copters i.e. drones, has raised concerns over the ability of existing aerial detection systems to accurately characterize such vehicles. Here, we fuse the 3D imaging of SPAD sensors with the classification capabilities of a bespoke convolutional neural network (CNN) into a system capable of determining drone pose in flight. To overcome the lack of publicly available training data we generate a photo-realistic dataset to enable the training of our network. After training, we are able to predict the roll, pitch, and yaw of the several different drone types with an accuracy greater than 90%.
Conference Presentation
© (2022) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Stirling Scholes, German Mora-Martin, Alice Ruget, Feng Zhu, Phil Soan, Istvan Gyongy, and Jonathan Leach "Efficient generation of photo-realistic SPAD data for 3D imaging and ranging", Proc. SPIE 12274, Emerging Imaging and Sensing Technologies for Security and Defence VII, 1227405 (7 December 2022); https://doi.org/10.1117/12.2639975
Advertisement
Advertisement
KEYWORDS
Ranging

Imaging systems

Systems modeling

Data modeling

Single photon

Picosecond phenomena

Sensors

Back to Top