Poster + Presentation + Paper
10 October 2020 High resolution video inpainting based on spatial structure and temporal edge information
Author Affiliations +
Conference Poster
Abstract
Video inpainting is a very challenging task. Directly using the image inpainting method to repair the damaged video leads to the inter-frame contents flicker due to temporal discontinuities. In this paper, we introduce spatial structure and temporal edge information guided video inpainting model to repair the missing regions in high-resolution video. The model uses a convolutional neural network with residual blocks to fix up the missing contents in intra-frame according to spatial structure. At the same time, temporal edge of reference frame is introduced in the temporal domain, which has a large guiding effect on improving the texture and reducing the inter-frame flicker. We train the model with regular and irregular masks on the YouTube high resolution video datasets, and the trained model is qualitatively and quantitatively evaluated on the test set, and the results show our method is superior to the previous methods.
Conference Presentation
© (2020) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Dezhi Bo, Ran Ma, Keke Wang, Kai Li, and Ping An "High resolution video inpainting based on spatial structure and temporal edge information", Proc. SPIE 11550, Optoelectronic Imaging and Multimedia Technology VII, 1155018 (10 October 2020); https://doi.org/10.1117/12.2574393
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Video

Spatial resolution

Temporal resolution

Video processing

Convolutional neural networks

Data modeling

Back to Top