Presentation + Paper
30 September 2024 Multimodal network model with localization and semantic segmentation for morphological identification of sea turtles
Karen Ortiz Ruiz, Mireya Saraí García-Vázquez, Alejandro Álvaro Ramírez-Acosta
Author Affiliations +
Abstract
The individual identification of sea turtles through manual and semi-automated methods, such as those used in current photo-identification algorithms like WildID, Hotspotter, and I3S-Pattern, requires images of acceptable quality. This process involves analyzing the geometric morphology of the facial and dorsal scales, where users must manually select the region of interest. However, this methodology faces challenges due to the inherent natural variability of these species and the morphological changes that occur over time. In image processing, automatic semantic segmentation techniques accurately delineate specific areas within images. This enables the detection, identification, and differentiation of objects through pixel-level analysis and visual pattern recognition, highlighting contours and specific object characteristics. In this work, we propose an artificial intelligence model and deep learning approach designed for the individual identification of sea turtles using multiple convolutional neural networks. By integrating the Segment Anything Model (SAM) for image content segmentation into specialized scenarios such as sea turtle identification, this includes automating the semantic segmentation of regions of interest in sea turtle images, as well as edge detection and multimodal text comprehension using Contrastive Language-Image Pre-training models. The individual identification is based on the geometric morphology of the facial scales, shell, as well as the fins and neck of sea turtles. This approach allows for precise and detailed identification by leveraging the unique anatomical features of each specimen. The results obtained demonstrate high performance in terms of precision, supported by the evaluation of metrics such as precision and sensitivity. These metrics provide a quantitative measure of the model's ability to accurately identify individuals.
Conference Presentation
(2024) Published by SPIE. Downloading of the abstract is permitted for personal use only.
Karen Ortiz Ruiz, Mireya Saraí García-Vázquez, and Alejandro Álvaro Ramírez-Acosta "Multimodal network model with localization and semantic segmentation for morphological identification of sea turtles", Proc. SPIE 13136, Optics and Photonics for Information Processing XVIII, 1313604 (30 September 2024); https://doi.org/10.1117/12.3028453
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Image segmentation

Biometrics

Semantics

Anatomy

Object detection

Artificial intelligence

Animals

Back to Top