research-article

ThumbReels: query sensitive web video previews based on temporal, crowdsourced, semantic tagging

Authors:

Barnaby Craggs,

Myles Kilgallon Scott,

Jason AlexanderAuthors Info & Claims

CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 1217 - 1220

https://doi.org/10.1145/2556288.2557249

Published: 26 April 2014 Publication History

Get Access

Abstract

During online search, the user's expectations often differ from those of the author. This is known as the "intention gap" and is particularly problematic when searching for and discriminating between online video content. An author uses description and meta-data tags to label their content, but often cannot predict alternate interpretations or appropriations of their work. To address this intention gap, we present ThumbReels, a concept for query-sensitive video previews generated from crowdsourced, temporally defined semantic tagging. Further, we supply an open-source tool that supports on-the-fly temporal tagging of videos, whose output can be used for later search queries. A first user study validates the tool and concept. We then present a second study that shows participants found ThumbReels to better represent search terms than contemporary preview techniques.

References

[1]

Christel, M. G. Evaluation and user studies with respect to video summarization and browsing. Multimedia Content Analysis, Management, and Retrieval (Jan. 2006), 60730M--60730M-15.

Google Scholar

[2]

Christel, M. G., Winkler, D. B., and Taylor, C. R. Improving Access to a Digital Video Library. In Proc. Interact 1997, Chapman & Hall, Ltd (1997).

Digital Library

Google Scholar

[3]

Estellés-Arolas, E., and Gonzalez-Ladron-de Guevara, F. Towards an integrated crowdsourcing definition. Journal of Information Science 38, 2 (Apr. 2012), 189--200.

Digital Library

Google Scholar

[4]

Halpin, H., Robu, V., and Shepherd, H. The complex dynamics of collaborative tagging. Proc Int. Conf. on World Wide Web (2007), 211--220.

Digital Library

Google Scholar

[5]

Haubold, A., and Natsev, A. Web-based information content and its application to concept-based video retrieval. In Proc. Content-based Image and Video Retrieval, ACM Press (2008).

Digital Library

Google Scholar

[6]

Liu, C., Huang, Q., and Jiang, S. Query sensitive dynamic web video thumbnail generation. In 18th IEEE International Conference on Image Processing (ICIP) (2011), 2449--2452.

Crossref

Google Scholar

[7]

Marchetti, A., Tesconi, M., and Ronzano, F. Semkey: A semantic collaborative tagging system. Workshop on Tagging and Metadata for Social Information Organization at WWW (2007), 8--12.

Google Scholar

[8]

Steiner, T., Verborgh, R., Van de Walle, R., Hausenblas, M., and Vallés, J. G. Crowdsourcing event detection in YouTube video. Proc. Detection, Representation, and Exploitation of Events in the Semantic Web (2011), 58--67.

Google Scholar

[9]

Yamamoto, D., Masuda, T., Ohira, S., and Nagao, K. Video Scene Annotation Based on Web Social Activities. IEEE Multimedia 15, 3 (2008), 22--32.

Digital Library

Google Scholar

Cited By

View all

Endo STakegawa YFunaki AMatsumura KHirata KIgarashi T(2021)Construction of a Switching Support System for Live Broadcast of Oral PresentationJournal of Information Processing10.2197/ipsjjip.29.20629(206-214)Online publication date: 2021
https://doi.org/10.2197/ipsjjip.29.206
Aameri BGrüninger M(2019)A Representation Theorem for Change through Composition of ActivitiesACM Transactions on Computational Logic10.1145/332912120:4(1-31)Online publication date: 26-Jul-2019
https://dl.acm.org/doi/10.1145/3329121
Hurst WCarvalhal B(2018)Mobile Interface Design for Online Movie Databases – Comparing Active Exploration With Standard UI Designs2018 IEEE International Conference on Multimedia & Expo Workshops (ICMEW)10.1109/ICMEW.2018.8551578(1-6)Online publication date: Jul-2018
https://doi.org/10.1109/ICMEW.2018.8551578
Show More Cited By

Index Terms

ThumbReels: query sensitive web video previews based on temporal, crowdsourced, semantic tagging
1. Human-centered computing

Recommendations

Crowdsourced semantics with semantic tagging: "Don't just tag it, LexiTag it!"
CrowdSem'13: Proceedings of the 1st International Conference on Crowdsourcing the Semantic Web - Volume 1030

Free form tagging was one of the most useful contributions of "Web2.0" toward the problem of content management and discovery on the web. Semantic tagging is a more recent but much less successful innovation borne of frustration at the limitations of ...
From MPEG-7 user interaction tools to hanging basket models: bridging the gap

The content---user gap is the difference between the limited range of content-relevant preferences that may be expressed using the MPEG-7 user interaction tools and the much wider range of metadata that may be represented using the MPEG-7 content tools. ...
Semantic thumbnails: a novel method for summarizing document collections
SIGDOC '04: Proceedings of the 22nd annual international conference on Design of communication: The engineering of quality documentation

The concept of thumbnails is common in image representation. A thumbnail is a highly compressed version of an image that provides a small, yet complete visual representation to the human eye. We propose the adaptation of the concept of thumbnails to the ...

Comments

Information & Contributors

Information

Published In

CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

April 2014

4206 pages

ISBN:9781450324731

DOI:10.1145/2556288

General Chairs:
Matt Jones
Swansea University, Wales, UK
,
Philippe Palanque
Université Paul Sabatier, France
,
Program Chairs:
Albrecht Schmidt
University of Stuttgart, Germany
,
Tovi Grossman
Autodesk Research, Canada

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 April 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '14

Sponsor:

SIGCHI

CHI '14: CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2014

Ontario, Toronto, Canada

Acceptance Rates

CHI '14 Paper Acceptance Rate 465 of 2,043 submissions, 23%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
345
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)0

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

View all

Endo STakegawa YFunaki AMatsumura KHirata KIgarashi T(2021)Construction of a Switching Support System for Live Broadcast of Oral PresentationJournal of Information Processing10.2197/ipsjjip.29.20629(206-214)Online publication date: 2021
https://doi.org/10.2197/ipsjjip.29.206
Aameri BGrüninger M(2019)A Representation Theorem for Change through Composition of ActivitiesACM Transactions on Computational Logic10.1145/332912120:4(1-31)Online publication date: 26-Jul-2019
https://dl.acm.org/doi/10.1145/3329121
Hurst WCarvalhal B(2018)Mobile Interface Design for Online Movie Databases – Comparing Active Exploration With Standard UI Designs2018 IEEE International Conference on Multimedia & Expo Workshops (ICMEW)10.1109/ICMEW.2018.8551578(1-6)Online publication date: Jul-2018
https://doi.org/10.1109/ICMEW.2018.8551578
Baraldi LGrana CCucchiara R(2017)Recognizing and Presenting the Storytelling Video Structure With Deep Multimodal NetworksIEEE Transactions on Multimedia10.1109/TMM.2016.264487219:5(955-968)Online publication date: 1-May-2017
https://dl.acm.org/doi/10.1109/TMM.2016.2644872
Ferracani APezzatini DBertini MDel Bimbo AKender JSmith JLuo JBoll SHsu W(2016)Item-Based Video RecommendationProceedings of the 2016 ACM on International Conference on Multimedia Retrieval10.1145/2911996.2912066(351-354)Online publication date: 6-Jun-2016
https://dl.acm.org/doi/10.1145/2911996.2912066
Baraldi LGrana CCucchiara RKender JSmith JLuo JBoll SHsu W(2016)Scene-driven Retrieval in Edited Videos using Aesthetic and Semantic Deep FeaturesProceedings of the 2016 ACM on International Conference on Multimedia Retrieval10.1145/2911996.2912012(23-29)Online publication date: 6-Jun-2016
https://dl.acm.org/doi/10.1145/2911996.2912012
Choi JKim C(2016)A framework for automatic static and dynamic video thumbnail extractionMultimedia Tools and Applications10.1007/s11042-015-2909-675:23(15975-15991)Online publication date: 1-Dec-2016
https://dl.acm.org/doi/10.1007/s11042-015-2909-6
Huang YMa CWang HItoh TBottoni PTakahashi S(2015)Exploring the Benefits of Text and Sketch in Video Retrieval of Complex QueriesProceedings of the 8th International Symposium on Visual Information Communication and Interaction10.1145/2801040.2801063(115-120)Online publication date: 24-Aug-2015
https://dl.acm.org/doi/10.1145/2801040.2801063

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Crowdsourced semantics with semantic tagging: "Don't just tag it, LexiTag it!"

From MPEG-7 user interaction tools to hanging basket models: bridging the gap

Semantic thumbnails: a novel method for summarizing document collections