Weakly supervised semantic segmentation using constrained multi-image model and saliency prior

Mingjun Yu; Zheng Han; Pingquan Wang; Xiaoyan Jia

doi:10.1117/12.2503022

9 August 2018 Weakly supervised semantic segmentation using constrained multi-image model and saliency prior

Mingjun Yu, Zheng Han, Pingquan Wang, Xiaoyan Jia

Proceedings Volume 10806, Tenth International Conference on Digital Image Processing (ICDIP 2018); 108065Y (2018) https://doi.org/10.1117/12.2503022
Event: Tenth International Conference on Digital Image Processing (ICDIP 2018), 2018, Shanghai, China

Abstract

Building a graph model use the whole training set and solved by graph cut based algorithm is a common method in weak supervision semantic segmentation task, such as Multi-Image Model (MIM). It has two disadvantages: one is the parameter number of model increased rapidly with the scale growth of training set, which limited applied to large-scale data. Another is lack of use structure information in image internal. To solve above problems, we proposed a Constrained Multi-Image Model (CMIM) that training model with a part of the training data which acquired by our entropy based algorithm. It's made up of some components and each is a smaller graph. So, The CMIM can parallel or serial training and weaken the memory limit. To utilize the context information, we bring the saliency of image to unary potential in energy function. At first, we segment images to superpixels and extract the semantic texton forest (STF) feature. Then construct a conditional random fields (CRF) in the superpixel set from selected images. The data potential learned from STF featrue and saliency of superpixels. Finally, the labeling of superpixels converted to CRF optimization problem which can efficiency solved by alpha expansion algorithm. Experiments on the MSRC21 dataset show that the CMIM algorithm achieves accuracy comparable with some previous influential weakly-supervised segmentation algorithms.

Citation Download Citation

Mingjun Yu, Zheng Han, Pingquan Wang, and Xiaoyan Jia "Weakly supervised semantic segmentation using constrained multi-image model and saliency prior", Proc. SPIE 10806, Tenth International Conference on Digital Image Processing (ICDIP 2018), 108065Y (9 August 2018); https://doi.org/10.1117/12.2503022

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available