Non local mean method has been widely used to fill the holes in the depth image based rendering system. For selected candidate patches, the weighting coefficient is very important for filling effect. In this paper, we select the optimal candidate patches depending on color, gradient and depth information. In order to obtain more appropriate weighting coefficient for each candidate patches, namely soft weighting, we constructed an equation sets between the valid pixels in the hole and the corresponding pixels in each candidate patches. The weighting coefficient is computed by the Orthogonal Matching Pursuit method (OMP), namely soft weighting. Finally, we combine the weight of several best matching patches to fill the holes. The results show that the proposed method has a better robustness and performance for filling hole in DIBR systems than other holes filling based on algorithms.
Depth image based rendering (DIBR) is the most widely used technology among synthesis algorithms. Hole filling is a challenge in producing desirable synthesized images. In this paper, we propose an enhanced non local mean based hole filling method. Color, gradient and depth information is combined to select the optimal candidate patches. The missing information from holes is then formed by aggregating multiple candidate patches. Furthermore, an efficient invalid pixel classification method based on their chararcteristics is proposed to divide invalid pixels into three types, and use different methods to fill them, and reduce the computational load of the hole filling unit. The results show that the proposed method has a better robustness and performance for hole filling in DIBR systems than other hole filling based on algorithms.
Disparity refinement based on a regression model continues to be challenging for specified function with a weak generalization ability. An invalid disparity refinement method to improve the quality of the disparity map is proposed. This method includes two committed steps: outliers disparity removal and redefinition of invalid pixels. To obtain a more accurate initial disparity map, removal of outliers based on Chauvenet’s criterion method is proposed, using the distribution of disparity values on a segmentation region. Then, the least square support vector machine model is applied to every horizontal line of the obtained initial disparity map to model the valid disparity values, corresponding image color values, and co-ordinates of pixels. Finally, invalid pixels are redefined by the regression model. Experimental results demonstrate that the dense disparity maps of the proposed method show superior performance compared with current state-of-the-art methods.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.