Computing dense disparity fields from large-baseline stereo is a difficult problem because of long-range correspondences involved. A typical solution to this problem is to use optical flow or block matching methods implemented over a hierarchy of resolutions. However, these approaches cannot easily cope with disparity discontinuities. Recently, we have proposed a novel approach that combines feature matching and Delaunay triangulation. In this approach, first feature points are extracted using intensity corner detector, and then corresponding feature-point pairs are found using cross-correlation. These two steps result in a reliable but sparse map of disparity vectors. In order to compute a dense disparity field, the third step involves Delaunay triangulation followed by disparity interpolation based on an affine (planar) model. The
resulting disparity fields are continuous everywhere, and thus are not realistic; typical stereo image pairs exhibit disparity discontinuities at object boundaries. To address this problem, in the past we subdivided some Delaunay triangles into smaller ones. Although this approach has significantly improved the rendition
of disparity discontinuities, it did not always work reliably. In this paper, we propose an adaptive interpolation over Delaunay triangles. As before, the interpolation is distance-dependent, i.e., accounts for Euclidian distance between the position of disparity under interpolation and three vertices of a triangle. The
distance-dependent weights, however, are now additionally adapted so that the interpolated, pixel-based disparities within each triangle afford discontinuities. The new method has been applied to natural
stereoscopic images. The resulting dense disparity fields exhibit clear, although subtle, discontinuities at object boundaries, and are more realistic than disparity fields obtained by the prior approach.
This paper describes a method for establishing dense correspondence between two images in a video sequence (motion) or in a stereo pair (disparity) in case of large displacements. In order to deal with large-amplitude motion or disparity fields, multi-resolution techniques such as blocks matching and optical flow have been used in the past. Although quite successful, these techniques cannot easily cope with motion/disparity discontinuities as they do not explicitly exploit image structure. Additionally, their computational complexity is high; block matching requires examination of numerous vector candidates while optical flow-based techniques are iterative. In this paper, we propose a new approach that addresses both issues. The approach combines feature matching with Delaunay triangulation, and thus reliable long-range correspondences result while the computational complexity is not high (sparse representation). In the proposed approach, feature points are found first using a simple intensity corner detector. Then, correspondence pairs between two images are found by maximizing cross-correlation over a small window. Finally, the Delaunay triangulation is applied to the resulting points, and a dense vector field is computed by planar interpolation over Delaunay triangles. The resulting vector field is continuous everywhere, and thus does not reflect motion or depth discontinuities at object boundaries. In order to improve the rendition of such discontinuities, we propose to further divide Delaunay triangles whenever the displacement vectors within a triangle do not allow good intensity match. The approach has been extensively tested on stereoscopic images in the context of intermediate view reconstruction where the quality of estimated disparity fields is critical for final image rendering. The first results are very encouraging as the reconstructed images are of high quality, especially at object boundaries, and the computational complexity is lower than that of multi- resolution block matching.
This paper presents a fast approach to the problem of velocity field estimation with Markov random fields. First, we propose to estimate the unknown velocity field by using a joint Markov random field through a convex markovian model which is called the energy function. Secondly, the estimated velocity field is determined explicitly by calculating the minimum of this energy function. The result obtained are compared in terms of CPU time and estimation quality to those obtained with the ICM.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.