Multi-sensor information extraction and combination in a large harbor surveillance experiment

Judith Dijk; Sebastiaan P. van den Broek; Richard J. M. den Hollander; Jan Baan; Johan-Martijn ten Hove; Dirk Oorbeek

doi:10.1117/12.2604163

12 September 2021 Multi-sensor information extraction and combination in a large harbor surveillance experiment

Judith Dijk, Sebastiaan P. van den Broek, Richard J. M. den Hollander, Jan Baan, Johan-Martijn ten Hove, Dirk Oorbeek

Proceedings Volume 11870, Artificial Intelligence and Machine Learning in Defense Applications III; 1187007 (2021) https://doi.org/10.1117/12.2604163
Event: SPIE Security + Defence, 2021, Online Only

Abstract

Surveillance is an important task during naval operations. This task can be performed with a combination of different sensors, including camera systems and radar. To obtain a consistent operational picture of possible threats in the vicinity of a ship, the information from the different sensors need to be combined into one overview image, in which all information related to one object is assigned to this object. In this paper, we present a new dataset for maritime surveillance applications and show two examples of combining information from different sensors. We have recorded data with several camera systems, automatic identification system (AIS) and radar in the Rotterdam Harbor. From all sensors we can obtain tracking information from the different objects. We present a method to associate the tracks and describe how snippets of the ships in the cameras can be used to enrich the information of the objects. Next to that, we show the combined information from AIS and imagery.

Conference Presentation

Citation Download Citation

Judith Dijk, Sebastiaan P. van den Broek, Richard J. M. den Hollander, Jan Baan, Johan-Martijn ten Hove, and Dirk Oorbeek "Multi-sensor information extraction and combination in a large harbor surveillance experiment", Proc. SPIE 11870, Artificial Intelligence and Machine Learning in Defense Applications III, 1187007 (12 September 2021); https://doi.org/10.1117/12.2604163

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available