Occlusion aware unsupervised learning of optical flow from video

Jianfeng Li; Junqiao Zhao; Shuangfu Song; Tiantian Feng

doi:10.1117/12.2588381

4 January 2021 Occlusion aware unsupervised learning of optical flow from video

Jianfeng Li, Junqiao Zhao, Shuangfu Song, Tiantian Feng

Proceedings Volume 11605, Thirteenth International Conference on Machine Vision; 116050T (2021) https://doi.org/10.1117/12.2588381
Event: Thirteenth International Conference on Machine Vision, 2020, Rome, Italy

Abstract

In this paper, we proposed an unsupervised learning method for estimating the optical flow between video frames, especially to solve the occlusion problem. Occlusion is caused by the movement of an object or the movement of the camera, defined as when certain pixels are visible in one video frame but not in adjacent frames. Due to the lack of pixel correspondence between frames in the occluded area, incorrect photometric loss calculation can mislead the optical flow training process. In the video sequence, we found that the occlusion in the forward (t→t+1) and backward (t→t-1) frame pairs are usually complementary. That is, pixels that are occluded in subsequent frames are often not occluded in the previous frame and vice versa. Therefore, by using this complementarity, a new weighted loss is proposed to solve the occlusion problem. Our method achieves competitive optical flow accuracy compared to the baseline and some supervised methods on KITTI and Sintel benchmarks.

Citation Download Citation

Jianfeng Li, Junqiao Zhao, Shuangfu Song, and Tiantian Feng "Occlusion aware unsupervised learning of optical flow from video", Proc. SPIE 11605, Thirteenth International Conference on Machine Vision, 116050T (4 January 2021); https://doi.org/10.1117/12.2588381

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available