Automatic analysis of online image data for law enforcement agencies by concept detection and instance search

Maaike H. T. de Boer; Henri Bouma; Maarten C. Kruithof; Frank B. ter Haar; Noëlle M. Fischer; Laurens K. Hagendoorn; Bart Joosten; Stephan Raaijmakers

doi:10.1117/12.2277970

5 October 2017 Automatic analysis of online image data for law enforcement agencies by concept detection and instance search

Maaike H. T. de Boer, Henri Bouma, Maarten C. Kruithof, Frank B. ter Haar, Noëlle M. Fischer, Laurens K. Hagendoorn, Bart Joosten, Stephan Raaijmakers

Author Affiliations +

Proceedings Volume 10441, Counterterrorism, Crime Fighting, Forensics, and Surveillance Technologies; 104410H (2017) https://doi.org/10.1117/12.2277970
Event: SPIE Security + Defence, 2017, Warsaw, Poland

Abstract

The information available on-line and off-line, from open as well as from private sources, is growing at an exponential rate and places an increasing demand on the limited resources of Law Enforcement Agencies (LEAs). The absence of appropriate tools and techniques to collect, process, and analyze the volumes of complex and heterogeneous data has created a severe information overload. If a solution is not found, the impact on law enforcement will be dramatic, e.g. because important evidence is missed or the investigation time is too long. Furthermore, there is an uneven level of capabilities to deal with the large volumes of complex and heterogeneous data that come from multiple open and private sources at national level across the EU, which hinders cooperation and information sharing. Consequently, there is a pertinent need to develop tools, systems and processes which expedite online investigations. In this paper, we describe a suite of analysis tools to identify and localize generic concepts, instances of objects and logos in images, which constitutes a significant portion of everyday law enforcement data. We describe how incremental learning based on only a few examples and large-scale indexing are addressed in both concept detection and instance search. Our search technology allows querying of the database by visual examples and by keywords. Our tools are packaged in a Docker container to guarantee easy deployment on a system and our tools exploit possibilities provided by open source toolboxes, contributing to the technical autonomy of LEAs.

Conference Presentation

Citation Download Citation

Maaike H. T. de Boer, Henri Bouma, Maarten C. Kruithof, Frank B. ter Haar, Noëlle M. Fischer, Laurens K. Hagendoorn, Bart Joosten, and Stephan Raaijmakers "Automatic analysis of online image data for law enforcement agencies by concept detection and instance search", Proc. SPIE 10441, Counterterrorism, Crime Fighting, Forensics, and Surveillance Technologies, 104410H (5 October 2017); https://doi.org/10.1117/12.2277970

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available