Presentation + Paper
4 October 2023 On the performance of video super-resolution algorithms for HTTP-based adaptive streaming applications
Author Affiliations +
Abstract
Recent years have seen tremendous growth and advancement in the field of super-resolution algorithms for both images and videos. Such algorithms are mainly based on deep learning technologies and are primarily used for upsampling lower resolution images and videos, often outperforming existing traditional upsampling algorithms. Using such advanced upscaling algorithms on the client side can result in significant bandwidth and storage savings as the client can simply request lower-resolution images/videos and then upscale them to the required (higher) display resolution. However, the performance analysis of such proposed algorithms has been limited to a few datasets which are not representative of modern-era adaptive bitrate video streaming applications. Also, many times they only consider scaling artefacts, and hence their performance when considering typical compression artefacts is not known. In this paper, we evaluate the performance of such AI-based upscaling algorithms on different datasets considering a typical adaptive streaming system. Different content types, video compression standards and renditions are considered. Our results indicate that the performance of video upsampling algorithms measured objectively in terms of PSNR and SSIM is insignificant compared to traditional upsampling algorithms. However, more detailed analysis in terms of other advanced quality metrics as well as subjective tests are required for a comprehensive evaluation.
Conference Presentation
(2023) Published by SPIE. Downloading of the abstract is permitted for personal use only.
Nabajeet Barman, Yuriy Reznik, and Maria Martini "On the performance of video super-resolution algorithms for HTTP-based adaptive streaming applications", Proc. SPIE 12674, Applications of Digital Image Processing XLVI, 126740X (4 October 2023); https://doi.org/10.1117/12.2677618
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Video

Video compression

Video coding

Super resolution

Back to Top