Presentation + Paper
2 April 2024 Enhancing hierarchical transformers for whole brain segmentation with intracranial measurements integration
Author Affiliations +
Abstract
Whole brain segmentation with Magnetic Resonance Imaging (MRI) enables the non-invasive measurement of brain regions, including Total Intracranial Volume (TICV) and Posterior Fossa Volume (PFV). Enhancing the existing whole brain segmentation methodology to incorporate intracranial measurements offers a heightened level of comprehensiveness in the analysis of brain structures. Despite its potential, the task of generalizing deep learning techniques for intracranial measurements faces data availability constraints due to limited manually annotated atlases encompassing whole brain and TICV/PFV labels. In this paper, we are enhancing the hierarchical transformer UNesT for whole brain segmentation to achieve segmenting whole brain with 133 classes and TICV/PFV simultaneously. To address the problem of data scarcity, the model is first pretrained on 4859 T1-weighted (T1w) 3D volumes sourced from eight different sites. These volumes are processed through a multiatlas segmentation pipeline for label generation, while TICV/PFV labels are unavailable. Subsequently, the model is finetuned with 45 T1w 3D volumes from Open Access Series Imaging Studies (OASIS) where both 133 whole brain classes and TICV/PFV labels are available. We evaluate our method with Dice Similarity Coefficients (DSC). We show that our model is able to conduct precise TICV/PFV estimation while maintaining the 132 brain regions performance at a comparable level.
Conference Presentation
© (2024) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Xin Yu, Yucheng Tang, Qi Yang, Ho Hin Lee, Shunxing Bao, Yuankai Huo, and Bennett A. Landman "Enhancing hierarchical transformers for whole brain segmentation with intracranial measurements integration", Proc. SPIE 12930, Medical Imaging 2024: Clinical and Biomedical Imaging, 129300K (2 April 2024); https://doi.org/10.1117/12.3009084
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Brain

Image segmentation

Transformers

Neuroimaging

3D modeling

Brain mapping

Magnetic resonance imaging

Back to Top