research-article

Retrieving geo-location of videos with a divide & conquer hierarchical multimodal approach

Authors:

Michele Trevisiol,

Jonathan Delhumeau,

Guillaume GravierAuthors Info & Claims

ICMR '13: Proceedings of the 3rd ACM conference on International conference on multimedia retrieval

Pages 1 - 8

https://doi.org/10.1145/2461466.2461468

Published: 16 April 2013 Publication History

Abstract

This paper presents a strategy to identify the geographic location of videos. First, it relies on a multi-modal cascade pipeline that exploits the available sources of information, namely the user's upload history, his social network and a visual-based matching technique. Second, we present a novel divide & conquer strategy to better exploit the tags associated with the input video. It pre-selects one or several geographic area of interest of higher expected relevance and performs a deeper analysis inside the selected area(s) to return the coordinates most likely to be related to the input tags. The experiments were conducted as part of the MediaEval 2012 Placing Task. Our approach, which differs significantly from the other submitted techniques, achieves the best results on this benchmark when considering the same amount of external information, i.e. when not using any gazetteers nor any other kind of external information.

References

[1]

J. Choi, G. Friedland, V. Ekambaram, and K. Ramchandran. The 2012 ICSI/Berkeley Video Location Estimation System. In MediaEval, 2012.

[2]

D. Crandall, L. Backstrom, D. Huttenlocher, and J. Kleinberg. Mapping the World's Photos. In WWW, 2009.

Digital Library

[3]

J. Hays and A. A. Efros. IM 2 GPS : estimating geographic information from a single image. In CVPR, 2008.

[4]

H. Jégou and O. Chum. Negative evidences and co-occurrences in image retrieval: the benefit of PCA and whitening. In ECCV, Oct. 2012.

[5]

H. Jégou, M. Douze, and C. Schmid. Product quantization for nearest neighbor search. PAMI, 33(1), Jan. 2011.

Digital Library

[6]

H. Jégou, F. Perronnin, M. Douze, J. Sánchez, P. Pérez, and C. Schmid. Aggregating local image descriptors into compact codes. PAMI, Sep. 2012.

Digital Library

[7]

P. Kelm, S. Schmiedeke, and T. Sikora. How Spatial Segmentation improves the Multimodal. In MediaEval, 2012.

[8]

O. V. Laere, S. Schockaert, and J. Quinn. Ghent and Cardiff University at the 2012 Placing Task. In MediaEval, 2012.

[9]

L. Li, J. Almeida, and D. Pedronette. A Multimodal Approach for Video Geocoding. In MediaEval, 2012.

[10]

J. Luo, D. Joshi, J. Yu, and A. Gallagher. Geotagging in multimedia and computer vision--a survey. Multimedia Tools Appl., 51(1), Jan. 2011.

Digital Library

[11]

C. D. Manning, P. Raghavan, and H. Schütze. Introduction to Information Retrieval. Cambridge University Press, 2008.

[12]

N. O'Hare and V. Murdock. Modeling locations with social media. Information Retrieval, Apr. 2012.

Digital Library

[13]

O. A. B. Penatti, L. T. Li, J. Almeida, and R. da S. Torres. A Visual Approach for Video Geocoding using Bag-of-Scenes. In ICMR, 2012.

Digital Library

[14]

A. Popescu and N. Ballas. CEA LIST's Participation at MediaEval 2012 Placing Task. In MediaEval, 2012.

[15]

A. Rae and P. Kelm. Working Notes for the Placing Task at MediaEval 2012. In MediaEval, 2012.

[16]

P. Serdyukov, V. Murdock, and R. van Zwol. Placing flickr photos on a map. In SIGIR, May 2009.

Digital Library

[17]

H. M. Sergieh, G. Gianini, M. Döller, H. Kosch, E. Egyed-Zsigmond, and J.-M. Pinon. Geo-based Automatic Image Annotation. In ICMR, 2012.

Digital Library

[18]

B. Sigurbjörnsson and R. van Zwol. Flickr tag recommendation based on collective knowledge. In WWW, 2008.

Digital Library

[19]

J. Whissell and C. Clarke. Improving document clustering using Okapi BM25 feature weighting. Information Retrieval, 14, 2011.

Digital Library

Cited By

Warch DStellbauer PNeis P(2024)Advanced Techniques for Geospatial Referencing in Online Media RepositoriesFuture Internet10.3390/fi1603008716:3(87)Online publication date: 1-Mar-2024
https://doi.org/10.3390/fi16030087
Tahmasebzadeh GHakimov SEwerth RMüller-Budack E(2023)Multimodal Geolocation Estimation of News PhotosAdvances in Information Retrieval10.1007/978-3-031-28238-6_14(204-220)Online publication date: 2-Apr-2023
https://dl.acm.org/doi/10.1007/978-3-031-28238-6_14
Armitage JKacupaj ETahmasebzadeh GSwati Maleshkova MEwerth RLehmann Jd'Aquin MDietze SHauff CCurry ECudre Mauroux P(2020)MLMProceedings of the 29th ACM International Conference on Information & Knowledge Management10.1145/3340531.3412783(2967-2974)Online publication date: 19-Oct-2020
https://dl.acm.org/doi/10.1145/3340531.3412783
Show More Cited By

Index Terms

Retrieving geo-location of videos with a divide & conquer hierarchical multimodal approach
1. Information systems
  1. Information retrieval
    1. Document representation

Recommendations

Multimodal geo-tagging in social media websites using hierarchical spatial segmentation
LBSN '12: Proceedings of the 5th ACM SIGSPATIAL International Workshop on Location-Based Social Networks

These days the sharing of photographs and videos is very popular in social networks. Many of these social media websites such as Flickr, Facebook and Youtube allows the user to manually label their uploaded videos with geo-information using a interface ...
Location and the web (LocWeb 2008)
WWW '08: Proceedings of the 17th international conference on World Wide Web

The World Wide Web has become the world's largest networked information resource, but references to geographical locations remain unstructured and typically implicit in nature. This lack of explicit spatial knowledge within the Web makes it difficult to ...
Platial or Locational Data? Toward the Characterization of Social Location Sharing
HICSS '15: Proceedings of the 2015 48th Hawaii International Conference on System Sciences

Sharing "location" information on social media became commonplace since the advent of smartphones. Location-based social networks introduced a derivative form of Volunteered Geographic Information (VGI) known as Social Location Sharing (SLS). It ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICMR '13: Proceedings of the 3rd ACM conference on International conference on multimedia retrieval

April 2013

362 pages

ISBN:9781450320337

DOI:10.1145/2461466

General Chairs:
Ramesh Jain
University of California, Irvine, USA
,
Balakrisknan Prabhakaran
University of Texas at Dallas, USA
,
Program Chairs:
Marcel Worring
University of Amsterdam, The Netherlands
,
John Smith
IBM Research, New York, USA
,
Tat-Seng Chua
National University of Singapore

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 April 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICMR'13

Sponsor:

SIGMM

ICMR'13: International Conference on Multimedia Retrieval

April 16 - 20, 2013

Texas, Dallas, USA

Acceptance Rates

ICMR '13 Paper Acceptance Rate 38 of 96 submissions, 40%;

Overall Acceptance Rate 254 of 830 submissions, 31%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
278
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 30 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Warch DStellbauer PNeis P(2024)Advanced Techniques for Geospatial Referencing in Online Media RepositoriesFuture Internet10.3390/fi1603008716:3(87)Online publication date: 1-Mar-2024
https://doi.org/10.3390/fi16030087
Tahmasebzadeh GHakimov SEwerth RMüller-Budack E(2023)Multimodal Geolocation Estimation of News PhotosAdvances in Information Retrieval10.1007/978-3-031-28238-6_14(204-220)Online publication date: 2-Apr-2023
https://dl.acm.org/doi/10.1007/978-3-031-28238-6_14
Armitage JKacupaj ETahmasebzadeh GSwati Maleshkova MEwerth RLehmann Jd'Aquin MDietze SHauff CCurry ECudre Mauroux P(2020)MLMProceedings of the 29th ACM International Conference on Information & Knowledge Management10.1145/3340531.3412783(2967-2974)Online publication date: 19-Oct-2020
https://dl.acm.org/doi/10.1145/3340531.3412783
Jiang SMin WMei S(2019)Hierarchy-Dependent Cross-Platform Multi-View Feature Learning for Venue Category PredictionIEEE Transactions on Multimedia10.1109/TMM.2018.287683021:6(1609-1619)Online publication date: 22-May-2019
https://dl.acm.org/doi/10.1109/TMM.2018.2876830
Choi JLarson MLi XLi KFriedland GHanjalic AIonescu BSebe NFeng JLarson MLienhart RSnoek C(2017)The Geo-Privacy Bonus of Popular Photo EnhancementsProceedings of the 2017 ACM on International Conference on Multimedia Retrieval10.1145/3078971.3080543(84-92)Online publication date: 6-Jun-2017
https://dl.acm.org/doi/10.1145/3078971.3080543
Kordopatis-Zilos GPapadopoulos SKompatsiaris I(2017)Geotagging Text Content With Language Models and Feature MiningProceedings of the IEEE10.1109/JPROC.2017.2688799105:10(1971-1986)Online publication date: Oct-2017
https://doi.org/10.1109/JPROC.2017.2688799
Kordopatis-Zilos GPapadopoulos SKompatsiaris YThomee BBorth DBernd J(2016)In-depth Exploration of Geotagging Performance using Sampling Strategies on YFCC100MProceedings of the 2016 ACM Workshop on Multimedia COMMONS10.1145/2983554.2983558(3-10)Online publication date: 16-Oct-2016
https://dl.acm.org/doi/10.1145/2983554.2983558
Schedl MZhou F(2016)Fusing Web and Audio Predictors to Localize the Origin of Music Pieces for Geospatial RetrievalAdvances in Information Retrieval10.1007/978-3-319-30671-1_24(322-334)Online publication date: 2016
https://doi.org/10.1007/978-3-319-30671-1_24
Yin YZhang LZimmermann RHauptmann ANgo CXue XJiang YSnoek CVasconcelos N(2015)Exploiting Spatial Relationship between Scenes for Hierarchical Video GeotaggingProceedings of the 5th ACM on International Conference on Multimedia Retrieval10.1145/2671188.2749354(363-370)Online publication date: 22-Jun-2015
https://dl.acm.org/doi/10.1145/2671188.2749354
Kordopatis-Zilos GPapadopoulos SKompatsiaris Y(2015)Geotagging Social Media Content with a Refined Language Modelling ApproachIntelligence and Security Informatics10.1007/978-3-319-18455-5_2(21-40)Online publication date: 2015
https://doi.org/10.1007/978-3-319-18455-5_2
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents