Content-based 3D mosaics for dynamic urban scenes

Zhigang Zhu; Hao Tang; George Wolberg; Jeffery R. Layne

doi:10.1117/12.664200

9 May 2006 Content-based 3D mosaics for dynamic urban scenes

Zhigang Zhu, Hao Tang, George Wolberg, Jeffery R. Layne

Proceedings Volume 6229, Intelligent Computing: Theory and Applications IV; 62290M (2006) https://doi.org/10.1117/12.664200
Event: Defense and Security Symposium, 2006, Orlando (Kissimmee), Florida, United States

Abstract

We propose a content-based 3D mosaic (CB3M) representation for long video sequences of 3D and dynamic scenes captured by a camera on a mobile platform. The motion of the camera has a dominant direction of motion (as on an airplane or ground vehicle), but 6 DOF motion is allowed. In the first step, a set of parallel-perspective (pushbroom) mosaics with varying viewing directions is generated to capture both the 3D and dynamic aspects of the scene under the camera coverage. In the second step, a segmentation-based stereo matching algorithm is applied to extract parametric representations of the color, structure and motion of the dynamic and/or 3D objects in urban scenes where a lot of planar surfaces exist. Multiple pairs of stereo mosaics are used for facilitating reliable stereo matching, occlusion handling, accurate 3D reconstruction and robust moving target detection. We use the fact that all the static objects obey the epipolar geometry of pushbroom stereo, whereas an independent moving object either violates the epipolar geometry if the motion is not in the direction of sensor motion or exhibits unusual 3D structures. The CB3M is a highly compressed visual representation for a very long video sequence of a dynamic 3D scene. More importantly, the CB3M representation has object contents of both 3D and motion. Experimental results are given for the CB3M construction for both simulated and real video sequences to show the accuracy and effectiveness of the representation.

Citation Download Citation

Zhigang Zhu, Hao Tang, George Wolberg, and Jeffery R. Layne "Content-based 3D mosaics for dynamic urban scenes", Proc. SPIE 6229, Intelligent Computing: Theory and Applications IV, 62290M (9 May 2006); https://doi.org/10.1117/12.664200

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
12 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Cameras

Video

3D acquisition

Visualization

Target detection

3D video compression

Video compression

Show All Keywords

Keywords/Phrases

Search In:

Publication Years