FPGA-based lens undistortion and image rectification for stereo vision applications

Christina Junger; Albrecht Heß; Maik Rosenberger; Gunther Notni

doi:10.1117/12.2530692

17 September 2019 FPGA-based lens undistortion and image rectification for stereo vision applications

Christina Junger, Albrecht Heß, Maik Rosenberger, Gunther Notni

Author Affiliations +

Proceedings Volume 11144, Photonics and Education in Measurement Science 2019; 1114416 (2019) https://doi.org/10.1117/12.2530692
Event: Joint TC1 - TC2 International Symposium on Photonics and Education in Measurement Science 2019, 2019, Jena, Germany

Abstract

Lens undistortion and image rectification is a commonly used pre-processing, e.g. for active or passive stereo vision to reduce the complexity of the search for matching points. The undistortion and rectification is implemented in a field programmable gate array (FPGA). The algorithm is performed pixel by pixel. The challenges of the implementation are the synchronisation of the data streams and the limited memory bandwidth. Due to the memory constraints, the algorithm utilises a pre-computed lossy compression of the rectification maps by a ratio of eight. The compressed maps occupy less space by ignoring the pixel indexes, sub-sampling both maps, and reducing repeated information in a row by forming differences to adjacent pixels. Undistorted and rectified images are calculated once without and once with the compressed transformation map. The deviation between the different computed images is minimal and negligible. The functionality of the hardware module, the decompression algorithm and the processing pipeline are described. The algorithm is validated on a Xilinx Zynq-7020 SoC. The stereo setup has a baseline with 46 mm and non-converged optical axis between the cameras. The cameras are configured at 1.3 Mpix @ 60 fps and distortion correction and rectification is performed in real time during image capture. With a camera resolution of 1280 pixels × 960 pixels and a maximum vertical shift of ± 20 pixels, the efficient hardware implementation utilizes 12 % of available block RAM resources.

Citation Download Citation

Christina Junger, Albrecht Heß, Maik Rosenberger, and Gunther Notni "FPGA-based lens undistortion and image rectification for stereo vision applications", Proc. SPIE 11144, Photonics and Education in Measurement Science 2019, 1114416 (17 September 2019); https://doi.org/10.1117/12.2530692

Access the abstract

PROCEEDINGS
8 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY