High-efficiency 3D Gaussian splatting rendering assisted by event signal sampling

Xuan Zuo; Jiayu Yang; Yuqi Han

doi:10.1117/12.3036997

22 November 2024 High-efficiency 3D Gaussian splatting rendering assisted by event signal sampling

Xuan Zuo, Jiayu Yang, Yuqi Han

Author Affiliations +

Proceedings Volume 13239, Optoelectronic Imaging and Multimedia Technology XI; 132390I (2024) https://doi.org/10.1117/12.3036997
Event: SPIE/COS Photonics Asia, 2024, Nantong, Jiangsu, China

Abstract

3D Gaussian Splatting has marked a significant milestone in novel view synthesis, particularly in the real-time level rendering speed. Despite its remarkable contributions, this technique encounters substantial challenges when reconstructing dynamic scenes due to motion blur, which leads to inaccurate point clouds and low-resolution vision performance. To address this issue, this paper proposes an event camera assisting 3D Gaussian Splatting generation, which provides high-accuracy vision cues for reliable motion description. Because moving objects attract more attention, the entire scene is rendered at different precision scales. Specifically, the proposed solution provides a detailed rendering of the space captured by the event camera and reduces its rendering accuracy for static backgrounds. Our comparative experiments demonstrate that the adoption of event camera imagery significantly improves the fidelity of the novel view synthesis, thereby enhancing the overall reconstruction quality in dynamic scenes.

(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.

Citation Download Citation

Xuan Zuo, Jiayu Yang, and Yuqi Han "High-efficiency 3D Gaussian splatting rendering assisted by event signal sampling", Proc. SPIE 13239, Optoelectronic Imaging and Multimedia Technology XI, 132390I (22 November 2024); https://doi.org/10.1117/12.3036997

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

;

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
8 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Cameras

Reconstruction algorithms

3D modeling

3D image processing

Motion blur

Image quality

Volume rendering

Keywords/Phrases

Search In:

Publication Years