research-article

Annotating and navigating tourist videos

Authors:

Ying-Qing XuAuthors Info & Claims

GIS '10: Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems

Pages 260 - 269

https://doi.org/10.1145/1869790.1869828

Published: 02 November 2010 Publication History

Abstract

Due to the rapid increase in video capture technology, more and more tourist videos are captured every day, creating a challenge for organization and association with metadata. In this paper, we present a novel system for annotating and navigating tourist videos. Placing annotations in a video is difficult because of the need to track the movement of the camera. Navigation of a regular video is also challenging due to the sequential nature of the media. To overcome these challenges, we introduce a system for registering videos to geo-referenced 3D models and analyzing the video contents. We also introduce a novel scheduling algorithm for showing annotations in video. We show results in automatically annotated videos and in a map-based application for browsing videos. Our user study indicates the system is very useful.

References

[1]

S. A. Ay, R. Zimmermann, and S. H. Kim. Viewable scene modeling for geospatial video search. ACM International Conference on Multimedia, pages 309--318, 2008.

Digital Library

[2]

R. E. Bellman. Dynamic programming. Princeton University Press, 1957.

Digital Library

[3]

B. Chen, G. Ramos, E. Ofek, M. Cohen, S. Drucker, and D. Nister. Interactive techniques for registering images to digital terrain and building models. Technical report, Microsoft Research, 2008.

[4]

L. Cheong and H. Huo. Shot change detection using scenebased constraint. Multimedia Tools and Applications, 2001.

Digital Library

[5]

P. L. Cho. 3D organization of 2D urban imagery. Applied Image Pattern Recognition Workshop, 0:3--8, 2007.

Digital Library

[6]

B. Epshtein, E. Ofek, Y. Wexler, and P. Zhang. Hierarchical photo organization using geo-relevance. In ACM International Symposium on Advances in Geographic Information Systems, pages 1--7, New York, NY, USA, 2007. ACM.

Digital Library

[7]

Google. Google Maps. http://maps.google.com.

[8]

W. Heng and K. Ngan. An object-based shot boundary detection using edge tracing and tracking. Journal of Visual Communication and Image Representation, 2001.

Digital Library

[9]

J. Kopf, B. Neubert, B. Chen, M. Cohen, D. Cohen-Or, O. Deussen, M. Uyttendaele, and D. Lischinski. Deep photo: Model-based photograph enhancement and viewing. ACM Trans. on Graphics (Proceedings of SIGGRAPH Asia 2008), 2008.

Digital Library

[10]

M. Kroepfl, Y. Wexler, and E. Ofek. Efficiently locating photographs in many panoramas. submitted to ACM GIS 2010, 2010.

Digital Library

[11]

D. G. Lowe. Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vision, 60(2):91--110, 2004.

Digital Library

[12]

Q. Luan, S. M. Drucker, J. Kopf, Y.-Q. Xu, and M. F. Cohen. Annotating gigapixel images. In ACM Symposium on User Interface Software and Technology, 2008.

Digital Library

[13]

Microsoft. Bing Maps. http://maps.bing.com/.

[14]

H. Nicolas, A. Manury, J. Benois-Pineau, W. Dupuy, and D. Barba. Grouping video shots into scenes based on 1D mosaic descriptors. Proc. Intl. Conf. on Image Proc., 2004.

[15]

S. Pongnumkul, J. Wang, and M. Cohen. Creating map-based storyboards for browsing tour videos. In ACM symposium on User Interface Software and Technology, pages 13--22, New York, NY, USA, 2008. ACM.

Digital Library

[16]

T. Rattenbury and M. Naaman. Methods for extracting place semantics from Flickr tags. ACM Trans. on Web, 3(1):1--30, 2009.

Digital Library

[17]

I. Simon, N. Snavely, and S. M. Seitz. Scene summarization for online image collections. IEEE International Conference on Computer Vision, 2007.

[18]

N. Snavely, S. M. Seitz, and R. Szeliski. Photo tourism: exploring photo collections in 3D. In ACM SIGGRAPH 2006 Papers, pages 835--846, New York, NY, USA, 2006.

Digital Library

[19]

K. Toyama, R. Logan, and A. Roseway. Geographic location tags on digital images. ACM International Conference on Multimedia, 2003.

Digital Library

Cited By

Wei XShi XWang L(2022)Label Guidance based Object Locating in Virtual Reality2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR55827.2022.00060(441-449)Online publication date: Oct-2022
https://doi.org/10.1109/ISMAR55827.2022.00060
Jia JElezovikj SFan HYang SLiu JGuo WTan CLing H(2020)Semantic-aware label placement for augmented reality in street viewThe Visual Computer10.1007/s00371-020-01939-wOnline publication date: 2-Aug-2020
https://doi.org/10.1007/s00371-020-01939-w
Li GLiu YWang YMikami KPan ZAdcock MThalmann DYang XItamiya TWu E(2018)An empirical evaluation of labelling method in augmented realityProceedings of the 16th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry10.1145/3284398.3284422(1-9)Online publication date: 2-Dec-2018
https://dl.acm.org/doi/10.1145/3284398.3284422
Show More Cited By

Index Terms

Annotating and navigating tourist videos
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision

Recommendations

Using temporal video annotation as a navigational aid for video browsing
UIST '10: Adjunct proceedings of the 23nd annual ACM symposium on User interface software and technology

Video is a complex information space that requires advanced navigational aids for effective browsing. The increasing number of temporal video annotations offers new opportunities to provide video navigation according to a user's needs. We present a ...
Annotating Objects and Relations in User-Generated Videos
ICMR '19: Proceedings of the 2019 on International Conference on Multimedia Retrieval

Understanding the objects and relations between them is indispensable to fine-grained video content analysis, which is widely studied in recent research works in multimedia and computer vision. However, existing works are limited to evaluating with ...
A Video Annotation Tool Using Vision-based AR Technology
CW '12: Proceedings of the 2012 International Conference on Cyberworlds

In this paper, we present a video annotation tool using vision-based Augmented Reality (AR) technology. We apply AR technology and computer vision method for making videos with 3D annotations such as image textures, video clips, 3D objects and 3D text. ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

GIS '10: Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems

November 2010

566 pages

ISBN:9781450304283

DOI:10.1145/1869790

General Chairs:
Divyakant Agrawal
University of California at Santa Barbara
,
Pusheng Zhang
Microsoft Corporation
,
Program Chairs:
Amr El Abbadi
University of California, Santa Barbara
,
Mohamed Mokbel
University of Minnesota

Copyright © 2010 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGSPATIAL: ACM Special Interest Group on Spatial Information

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 November 2010

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

GIS '10

Sponsor:

SIGSPATIAL

GIS '10: 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems

November 2 - 5, 2010

California, San Jose

Acceptance Rates

Overall Acceptance Rate 257 of 1,238 submissions, 21%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
309
Total Downloads

Downloads (Last 12 months)12
Downloads (Last 6 weeks)0

Reflects downloads up to 23 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Wei XShi XWang L(2022)Label Guidance based Object Locating in Virtual Reality2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR55827.2022.00060(441-449)Online publication date: Oct-2022
https://doi.org/10.1109/ISMAR55827.2022.00060
Jia JElezovikj SFan HYang SLiu JGuo WTan CLing H(2020)Semantic-aware label placement for augmented reality in street viewThe Visual Computer10.1007/s00371-020-01939-wOnline publication date: 2-Aug-2020
https://doi.org/10.1007/s00371-020-01939-w
Li GLiu YWang YMikami KPan ZAdcock MThalmann DYang XItamiya TWu E(2018)An empirical evaluation of labelling method in augmented realityProceedings of the 16th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry10.1145/3284398.3284422(1-9)Online publication date: 2-Dec-2018
https://dl.acm.org/doi/10.1145/3284398.3284422
Wang WChiou CHuang CChung PHuang W(2018)Spatiotemporal Coherence-Based Annotation Placement for Surveillance VideosIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2016.262934028:3(787-801)Online publication date: Mar-2018
https://doi.org/10.1109/TCSVT.2016.2629340
Fritze HDegbelo ABrüggentisch TKray C(2017)Feature-centric ranking algorithms for georeferenced video searchProceedings of the 25th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems10.1145/3139958.3139976(1-10)Online publication date: 7-Nov-2017
https://dl.acm.org/doi/10.1145/3139958.3139976
Yin YLiu ZZimmermann R(2017)Geographic information use in weakly-supervised deep learning for landmark recognition2017 IEEE International Conference on Multimedia and Expo (ICME)10.1109/ICME.2017.8019376(1015-1020)Online publication date: Jul-2017
https://doi.org/10.1109/ICME.2017.8019376
Yin YWang GZimmermann RAli MNewsam SRenz MTrajcevski GRavada S(2016)Automatic geographic metadata correction for sensor-rich video sequencesProceedings of the 24th ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems10.1145/2996913.2997015(1-10)Online publication date: 31-Oct-2016
https://dl.acm.org/doi/10.1145/2996913.2997015
Zhang LHong RNie LHong C(2016)A Biologically Inspired Automatic System for Media Quality AssessmentIEEE Transactions on Automation Science and Engineering10.1109/TASE.2015.241822313:2(894-902)Online publication date: Apr-2016
https://doi.org/10.1109/TASE.2015.2418223
Yin YSeo BZimmermann R(2015)Content vs. ContextACM Transactions on Multimedia Computing, Communications, and Applications10.1145/270028711:3(1-21)Online publication date: 5-Feb-2015
https://dl.acm.org/doi/10.1145/2700287
Yin YYu YZimmermann R(2015)On Generating Content-Oriented Geo Features for Sensor-Rich Outdoor Video SearchIEEE Transactions on Multimedia10.1109/TMM.2015.245804217:10(1760-1772)Online publication date: Oct-2015
https://doi.org/10.1109/TMM.2015.2458042
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten