Computational assessment of visual search strategies in volumetric medical images

Gezheng Wen; Avigael Aizenman; Trafton Drew; Jeremy M. Wolfe; Tamara Miner Haygood; Mia K. Markey

doi:10.1117/1.JMI.3.1.015501

6 January 2016 Computational assessment of visual search strategies in volumetric medical images

Gezheng Wen, Avigael Aizenman, Trafton Drew, Jeremy M. Wolfe, Tamara Miner Haygood, Mia K. Markey

Author Affiliations +

Journal of Medical Imaging, Vol. 3, Issue 1, 015501 (January 2016). https://doi.org/10.1117/1.JMI.3.1.015501

Abstract

When searching through volumetric images [e.g., computed tomography (CT)], radiologists appear to use two different search strategies: “drilling” (restrict eye movements to a small region of the image while quickly scrolling through slices), or “scanning” (search over large areas at a given depth before moving on to the next slice). To computationally identify the type of image information that is used in these two strategies, 23 naïve observers were instructed with either “drilling” or “scanning” when searching for target T’s in 20 volumes of faux lung CTs. We computed saliency maps using both classical two-dimensional (2-D) saliency, and a three-dimensional (3-D) dynamic saliency that captures the characteristics of scrolling through slices. Comparing observers’ gaze distributions with the saliency maps showed that search strategy alters the type of saliency that attracts fixations. Drillers’ fixations aligned better with dynamic saliency and scanners with 2-D saliency. The computed saliency was greater for detected targets than for missed targets. Similar results were observed in data from 19 radiologists who searched five stacks of clinical chest CTs for lung nodules. Dynamic saliency may be superior to the 2-D saliency for detecting targets embedded in volumetric images, and thus “drilling” may be more efficient than “scanning.”

Citation Download Citation

Gezheng Wen, Avigael Aizenman, Trafton Drew, Jeremy M. Wolfe, Tamara Miner Haygood, and Mia K. Markey "Computational assessment of visual search strategies in volumetric medical images," Journal of Medical Imaging 3(1), 015501 (6 January 2016). https://doi.org/10.1117/1.JMI.3.1.015501

Published: 6 January 2016

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available