Hardware acceleration of lucky-region fusion (LRF) algorithm for high-performance real-time video processing

Tyler Browning; Christopher Jackson; Furkan Cayci; Gary W. Carhart; J. Jiang Liu; Fouad Kiamilev

doi:10.1117/12.2085864

4 June 2015 Hardware acceleration of lucky-region fusion (LRF) algorithm for high-performance real-time video processing

Tyler Browning, Christopher Jackson, Furkan Cayci, Gary W. Carhart, J. Jiang Liu, Fouad Kiamilev

Author Affiliations +

Proceedings Volume 9451, Infrared Technology and Applications XLI; 94512G (2015) https://doi.org/10.1117/12.2085864
Event: SPIE Defense + Security, 2015, Baltimore, MD, United States

Abstract

"Lucky-region" fusion (LRF) is a synthetic imaging technique that has proven successful in enhancing the quality of images distorted by atmospheric turbulence. The LRF algorithm extracts sharp regions of an image obtained from a series of short exposure frames from fast, high-resolution image sensors, and fuses the sharp regions into a final, improved image. In our previous research, the LRF algorithm had been implemented on CPU and field programmable gate array (FPGA) platforms. The CPU did not have sufficient processing power to handle real-time processing of video. Last year, we presented a real-time LRF implementation using an FPGA. However, due to the slow register-transfer level (RTL) development and simulation time, it was difficult to adjust and discover optimal LRF settings such as Gaussian kernel radius and synthetic frame buffer size. To overcome this limitation, we implemented the LRF algorithm on an off-the-shelf graphical processing unit (GPU) in order to take advantage of built-in parallelization and significantly faster development time. Our initial results show that the unoptimized GPU implementation has almost comparable turbulence mitigation to the FPGA version. In our presentation, we will explore optimization of the LRF algorithm on the GPU to achieve higher performance results, and adding new performance capabilities such as image stabilization.

Citation Download Citation

Tyler Browning, Christopher Jackson, Furkan Cayci, Gary W. Carhart, J. Jiang Liu, and Fouad Kiamilev "Hardware acceleration of lucky-region fusion (LRF) algorithm for high-performance real-time video processing", Proc. SPIE 9451, Infrared Technology and Applications XLI, 94512G (4 June 2015); https://doi.org/10.1117/12.2085864

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available