Patch-based inpainting is widely used in interactive photo editing scenarios. It iteratively fills the target region by searching the candidate from the source region. However, the high computational cost is a long-lasting concern that prevents users from seeing instant results, bringing limitation to its further application. In this paper, we present a novel instant inpainting technique based on a multi-scale framework, pushing the speed to an unprecedented interactive level (around seconds). Our key insights are that filling process becomes very efficient at low scale. Also, scale changes do not significantly affect the match correspondence, allowing the source-target match correspondence to be quickly collected at low scale, and to be delivered as a priori to higher scales. At high scale, thanks to the built-in coherence in natural images, we propose a mechanism named propagation optimization to further fine-tune the match correspondence based on prior, eliminating the side effects caused by scale recovery. Experiments demonstrate that our method is 10-300 times faster while keeping the same image quality as previous works did. We believe our work contributes a new strategy to real-time application of image inpainting techniques.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.