Keypoint-based static object removal from photographs

Alexandr Volkov; Valeria Efimova; Viacheslav Shalamov; Andrey Filchenkov

doi:10.1117/12.2587036

4 January 2021 Keypoint-based static object removal from photographs

Alexandr Volkov, Valeria Efimova, Viacheslav Shalamov, Andrey Filchenkov

Proceedings Volume 11605, Thirteenth International Conference on Machine Vision; 116050O (2021) https://doi.org/10.1117/12.2587036
Event: Thirteenth International Conference on Machine Vision, 2020, Rome, Italy

Abstract

When taking photos of historical buildings and landmarks, one can often encounter more modern and less attractive objects blocking the view (poles, electricity cables, road signs, and others). Photographers strive to take the unobstructed shot, without random objects popping up in the image. However, they avoid deleting unwanted objects with inpainting or exemplar-based methods, because it can introduce notable artefacts. We propose a new algorithm for removing large static objects such as road signs, sitting people, and parked cars from a photograph keeping its originality and unique details. We do not use artificial patterns to fill covered regions, only two shots taken from different angles. Usually, removing long thin objects such as road sign poles cause image deformations, but our approach avoids this. For comparison, we created a dataset from “Caltech Buildings” and “Kaggle Architecture” Datasets and added road signs, cars, and other objects to photos. We compared our approach with state-of-the-art methods such as Deep Image Prior, Gated Convolution, and the Region Filling by block sampling. The real photographs of historical building demonstrate the effectiveness of our algorithm. Code and example images are available on GitHub¹.

Citation Download Citation

Alexandr Volkov, Valeria Efimova, Viacheslav Shalamov, and Andrey Filchenkov "Keypoint-based static object removal from photographs", Proc. SPIE 11605, Thirteenth International Conference on Machine Vision, 116050O (4 January 2021); https://doi.org/10.1117/12.2587036

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available