Paper
14 March 2022 Self-attention technology in image segmentation
Fude Cao, Xueyun Lu
Author Affiliations +
Abstract
Although the traditional Convolutional neural network is applied to image segmentation successfully, it has some limitations. That's the context information of the long-range on the image is not well captured. With the success of the introduction of self-attentional mechanisms in the field of natural language processing (NLP), people have tried to introduce the attention mechanism in the field of computer vision. It turns out that self-attention can really solve this long-range dependency problem. This paper is a summary on the application of self-attention to image segmentation in the past two years. And we think about whether the self-attention module in this field can replace convolution operation in the future. The answer to this review is yes, so it is recommended that the focus of future research be on the self-attention module
© (2022) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
Fude Cao and Xueyun Lu "Self-attention technology in image segmentation", Proc. SPIE 12165, International Conference on Intelligent Traffic Systems and Smart City (ITSSC 2021), 1216511 (14 March 2022); https://doi.org/10.1117/12.2628135
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Image segmentation

Convolution

Expectation maximization algorithms

Neural networks

Computer vision technology

Convolutional neural networks

Back to Top