Real-time content-aware video retargeting for tunnel vision assistance

Thomas Knack; Andreas Savakis

doi:10.1117/12.2003862

7 March 2013 Real-time content-aware video retargeting for tunnel vision assistance

Thomas Knack, Andreas Savakis

Proceedings Volume 8667, Multimedia Content and Mobile Devices; 86670N (2013) https://doi.org/10.1117/12.2003862
Event: IS&T/SPIE Electronic Imaging, 2013, Burlingame, California, United States

Abstract

Image and video retargeting technologies are effective means of resizing media for aspect ratio constrained applications. In this paper, a real-time video retargeting model is proposed for smartphone implementation and potential application to low vision assistance for individuals with tunnel vision. Seam carving is a content-aware retargeting operator which defines 8-connected horizontal or vertical paths, or seams of pixels. The optimality of these seams is based on a specific energy function. Seam removal permits changes in the aspect ratio while simultaneously preserving important regions. This paper introduces a video retargeting model that incorporates spatial and temporal considerations to preserve visual integrity. Face detection masks and salience maps are used to achieve more comprehensive results. Additionally, formulation of a novel temporal coherence measure is presented that allows for retargeting on streaming video in real-time. Integration of the model with a mobile platform emphasizes its portability.

Citation Download Citation

Thomas Knack and Andreas Savakis "Real-time content-aware video retargeting for tunnel vision assistance", Proc. SPIE 8667, Multimedia Content and Mobile Devices, 86670N (7 March 2013); https://doi.org/10.1117/12.2003862

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available