Shape from shading (SFS) has been studied for decades; nevertheless, its overly simple assumptions and its ill-conditioning
have resulted in infrequent use in real applications. Price et al. recently developed an iterative scheme named shape from
motion and shading (SFMS) that models both shape and reflectance of an unknown surface simultaneously. SFMS
produces a fairly accurate, dense 3D reconstruction from each frame of a pharyngeal endoscopic video, albeit with
inconsistency between the 3D reconstructions of different frames. We present a comprehensive study of the SFMS scheme
and several improvements to it: (1) We integrate a deformable registration method into the iterative scheme and use the
fusion of multiple surfaces as a reference surface to guide the next iteration’s reconstruction. This can be interpreted as
incorporating regularity of a frame’s reconstruction with that of temporally nearby frames. (2) We show that the reflectance
model estimation is crucial and very sensitive to noise in the data. Moreover, even when the surface reflection is not
assumed to be Lambertian, the reflectance model estimation function in SFMS is still overly simple for endoscopy of
human tissue. By removing outlier pixels, by preventing unrealistic BRDF estimation, and by reducing the falloff speed
of illumination in SFS to account for the effect of multiple bouncing of the light, we improve the reconstruction accuracy.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.