A deep interactive segmentation method with user interaction-based attention module and polar transformation

Jee-Young Sun; Sang-Won Lee; Ye-Won Kim; Bo-Sang Kim; Sung-Jea Ko

doi:10.1117/12.2556671

31 January 2020 A deep interactive segmentation method with user interaction-based attention module and polar transformation

Jee-Young Sun, Sang-Won Lee, Ye-Won Kim, Bo-Sang Kim, Sung-Jea Ko

Author Affiliations +

Proceedings Volume 11433, Twelfth International Conference on Machine Vision (ICMV 2019); 114331B (2020) https://doi.org/10.1117/12.2556671
Event: Twelfth International Conference on Machine Vision, 2019, Amsterdam, Netherlands

Abstract

Interactive segmentation that extracts a specific foreground selected by the user input is widely employed in many user-interactive applications such as image editing and ground-truth labeling. In general, most interactive segmentation methods iteratively refine the previously obtained result using additional user interactions because they often produce unsatisfactory results with a single user input. A recently developed convolutional neural network (CNN)-based interactive segmentation method called deep interactive object selection has achieved high segmentation accuracy with fewer user interactions than earlier non-CNN-based approaches. However, the computational efficiency of deep interactive object selection deteriorates due to the repetitive feature extraction stage for each user interaction. Furthermore, the deep interactive object selection requires graph cut as a post-processing step to refine the boundary segments. To solve this problem, this paper presents a deep CNN-based interactive segmentation method employing an effective and simple user interaction-based attention module that does not require the repetitive feature extraction. In addition, we adopt Cartesian to polar coordinate transformation to further improve the segmentation performance. Experimental results demonstrate that the proposed interactive segmentation method is superior to the conventional ones in terms of segmentation accuracy and computational efficiency.

Citation Download Citation

Jee-Young Sun, Sang-Won Lee, Ye-Won Kim, Bo-Sang Kim, and Sung-Jea Ko "A deep interactive segmentation method with user interaction-based attention module and polar transformation", Proc. SPIE 11433, Twelfth International Conference on Machine Vision (ICMV 2019), 114331B (31 January 2020); https://doi.org/10.1117/12.2556671

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

;

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
8 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Image segmentation

Distributed interactive simulations

Feature extraction

Computer vision technology

Convolutional neural networks

Machine vision

Stars

Show All Keywords

Keywords/Phrases

Search In:

Publication Years