Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3388770.3407409acmconferencesArticle/Chapter ViewAbstractPublication PagessiggraphConference Proceedingsconference-collections
poster

Unsupervised Learning of Visual Representations by Solving Shuffled Long Video-Frames Temporal Order Prediction

Published: 17 August 2020 Publication History

Abstract

There is lots of hidden information behind the sequential data and their sequences. We proposed a model for learning visual representation by solving order prediction task. We concatenated the frame pairs, instead of concatenating the feature pairs. This concatenation makes it possible to apply a 3D-CNN to extract features from the frame pairs. Also, we proposed a new grouping, which have achieved 80 percent accuracy on average. We have modified the shuffled video clips order prediction task to the shuffled frame order prediction, by selecting a frame from each clip, by random. Then this task was solved by applying our model.

Supplementary Material

VTT File (3388770.3407409.vtt)
MP4 File (3388770.3407409.mp4)
Presentation video

References

[1]
Hsin-Ying Lee, Jia-Bin Huang, Maneesh Singh, and Ming-Hsuan Yang. 2017. Unsupervised representation learning by sorting sequences. ICCV (2017), 667–676.
[2]
Ishan Misra, C. Lawrence Zitnick, and Martial Hebert. 2016. Shuffle and Learn: Unsupervised Learning Using Temporal Order Verification. ECCV 2016 (2016), 527–544.
[3]
Rodrigo Santa Cruz, Basura Fernando, Anoop Cherian, and Stephen Gould. 2017. Deeppermnet: Visual permutation learning. CVPR (2017).
[4]
Khurram Soomro, Amir Roshan Zamir, and M Shah. 2012. A dataset of 101 human action classes from videos in the wild. CRCV (2012).
[5]
Dejing Xu, Jun Xiao, Zhou Zhao, Jian Shao, Di Xie, and Yueting Zhuang. 2019. Self-Supervised Spatiotemporal Learning via Video Clip Order Prediction. CVPR (2019).

Cited By

View all
  • (2024)Self-Supervised Representation Learning for Knee Injury Diagnosis From Magnetic Resonance DataIEEE Transactions on Artificial Intelligence10.1109/TAI.2023.32998835:4(1613-1623)Online publication date: Apr-2024
  • (2021)Interpretive self-supervised pre-trainingProceedings of the Twelfth Indian Conference on Computer Vision, Graphics and Image Processing10.1145/3490035.3490273(1-9)Online publication date: 19-Dec-2021

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGGRAPH '20: ACM SIGGRAPH 2020 Posters
August 2020
118 pages
ISBN:9781450379731
DOI:10.1145/3388770
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 17 August 2020

Check for updates

Qualifiers

  • Poster
  • Research
  • Refereed limited

Conference

SIGGRAPH '20
Sponsor:

Acceptance Rates

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)12
  • Downloads (Last 6 weeks)3
Reflects downloads up to 11 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Self-Supervised Representation Learning for Knee Injury Diagnosis From Magnetic Resonance DataIEEE Transactions on Artificial Intelligence10.1109/TAI.2023.32998835:4(1613-1623)Online publication date: Apr-2024
  • (2021)Interpretive self-supervised pre-trainingProceedings of the Twelfth Indian Conference on Computer Vision, Graphics and Image Processing10.1145/3490035.3490273(1-9)Online publication date: 19-Dec-2021

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

HTML Format

View this article in HTML Format.

HTML Format

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media