Use of collateral text in understanding photos in documents

Rohini K. Srihari

doi:10.1117/12.169469

25 February 1994 Use of collateral text in understanding photos in documents

Rohini K. Srihari

Proceedings Volume 2103, 22nd AIPR Workshop: Interdisciplinary Computer Vision: Applications and Changing Needs; (1994) https://doi.org/10.1117/12.169469
Event: 22nd Applied Imagery Pattern Recognition Workshop, 1993, Washington, DC, United States

Abstract

This research explores the interaction of textural and photographic information in document understanding. Specifically, it presents a computational model whereby textural captions are used as collateral information in the interpretation of the corresponding photographs. The final understanding of the picture and caption reflects a consolidation of the information obtained from each of the two sources and can thus be used in intelligent information retrieval tasks. The problem of performing general-purpose vision without a-priori knowledge is very difficult at best. The concept of using collateral information in scene understanding has been explored in systems that use general scene context in the task of object identification. The work described here extends this notion by incorporating picture specific information. A multistage system PICTION, which uses captions to identify humans in an accompanying photograph, is described. This provides a computationally less expensive alternative to traditional methods of face recognition. It does not require a prestored database of face models for all people to be identified. A key component of the system is the utilization of spatial and characteristic constraints (derived from the caption) in labeling face candidates (generated by a face locator).

Citation Download Citation

Rohini K. Srihari "Use of collateral text in understanding photos in documents", Proc. SPIE 2103, 22nd AIPR Workshop: Interdisciplinary Computer Vision: Applications and Changing Needs, (25 February 1994); https://doi.org/10.1117/12.169469

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available