3D model generation using unconstrained motion of a hand-held video camera

C. Baker; C. Debrunner; M. Whitehorn

doi:10.1117/12.650765

26 January 2006 3D model generation using unconstrained motion of a hand-held video camera

C. Baker, C. Debrunner, M. Whitehorn

Proceedings Volume 6056, Three-Dimensional Image Capture and Applications VII; 60560A (2006) https://doi.org/10.1117/12.650765
Event: Electronic Imaging 2006, 2006, San Jose, California, United States

Abstract

We have developed a shape and structure capture system which constructs accurate, realistic 3D models from video imagery taken with a single freely moving handheld camera. Using an inexpensive off the shelf acquisition system such as a hand-held video camera, we demonstrate the feasibility of fast and accurate generation of these 3D models at a very low cost. In our approach the operator freely moves the camera within some very simple constraints. Our process identifies and tracks high interest image features and computes the relative pose of the camera based on those tracks. Using a RANSAC-like approach we solve for the camera pose and 3D structure based on a homography or essential matrix. Once we have the pose for many frames in the sequence we perform correlation-based stereo to obtain dense point clouds. After these point clouds are computed we integrate them into an octree. By replacing the points in a particular cell with statistics representing the point distribution we can efficiently store the computed model. While being efficient, the integration technique also enables filtering based on occupancy counts which eliminates many stereo outliers and results in an aesthetic viewable 3D model. In this paper we describe our approach in detail as well as show reconstructed results of a synthetic room, an empty room, a lightly furnished room, and an experimental vehicle.

Citation Download Citation

C. Baker, C. Debrunner, and M. Whitehorn "3D model generation using unconstrained motion of a hand-held video camera", Proc. SPIE 6056, Three-Dimensional Image Capture and Applications VII, 60560A (26 January 2006); https://doi.org/10.1117/12.650765

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available