research-article

Finding locations of flickr resources using language models and similarity search

Authors:

Olivier Van Laere,

Steven Schockaert,

Bart DhoedtAuthors Info & Claims

ICMR '11: Proceedings of the 1st ACM International Conference on Multimedia Retrieval

Article No.: 48, Pages 1 - 8

https://doi.org/10.1145/1991996.1992044

Published: 18 April 2011 Publication History

Abstract

We present a two-step approach to estimate where a given photo or video was taken, using only the tags that a user has assigned to it. In the first step, a language modeling approach is adopted to find the area which most likely contains the geographic location of the resource. In the subsequent second step, a precise location is determined within the area that was found to be most plausible. The main idea of this step is to compare the multimedia object under consideration with resources from the training set, for which the exact coordinates are known, and which were taken in that area. Our final estimation is then determined as a function of the coordinates of the most similar among these resources. Experimental results show this two-step approach to improve substantially over either language models or similarity search alone.

References

[1]

S. Ahern, M. Naaman, R. Nair, and J. H.-I. Yang. World explorer: visualizing aggregate data from unstructured text in geo-referenced collections. In Proceedings of the 7th ACM/IEEE-CS Joint Conference on Digital Libraries, pages 1--10, 2007.

Digital Library

[2]

M. Ames and M. Naaman. Why we tag: motivations for annotation in mobile and online media. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pages 971--980, 2007.

Digital Library

[3]

D. J. Crandall, L. Backstrom, D. Huttenlocher, and J. Kleinberg. Mapping the world's photos. In Proceedings of the 18th International Conference on World Wide Web, pages 761--770, 2009.

Digital Library

[4]

M. L. et al. Automatic tagging and geotagging in video collections and communities. In Proc. ACM ICMR, 2011.

Digital Library

[5]

M. Goodchild. Citizens as sensors: the world of volunteered geography. GeoJournal, 69:211--221, 2007.

[6]

J. H. Hays and A. A. Efros. IM2GPS: Estimating geographic information from a single image. In Proc. Computer Vision and Pattern Recognition, 2008.

[7]

L. Hollenstein and R. Purves. Exploring place through user-generated content: Using Flickr to describe city cores. Journal of Spatial Information Science, 1(1):21--48, 2010.

[8]

L. Kennedy and M. Naaman. Generating diverse and representative image search results for landmarks. In Proceeding of the 17th International Conference on World Wide Web, pages 297--306, 2008.

Digital Library

[9]

E. Moxley, J. Kleban, and B. Manjunath. Spirittagger: a geo-aware tag suggestion tool mined from Flickr. In Proceeding of the 1st ACM International Conf. on Multimedia Information Retrieval, pages 24--30, 2008.

Digital Library

[10]

A. Popescu and I. Kanellos. Creating visual summaries for geographic regions. In IR+SN Workshop (at ECIR), 2009.

[11]

T. Rattenbury and M. Naaman. Methods for extracting place semantics from flickr tags. ACM Transactions on the Web, 3(1):1--30, 2009.

Digital Library

[12]

P. Schmitz. Inducing ontology from Flickr tags. In Proceedings of the Collaborative Web Tagging Workshop, pages 210--214, 2006.

[13]

S. Schockaert and M. De Cock. Neighborhood restrictions in geographic IR. In Proc. ACM SIGIR, pages 167--174, 2007.

Digital Library

[14]

P. Serdyukov, V. Murdock, and R. van Zwol. Placing Flickr photos on a map. In Proc. ACM SIGIR, pages 484--491, 2009.

Digital Library

[15]

F. Wilske. Approximation of neighborhood boundaries using collaborative tagging systems. In Proceedings of the GI-Days, pages 179--187, 2008.

[16]

F. Wu and D. Weld. Automatically refining the Wikipedia infobox ontology. In Proceeding of the 17th International Conference on World Wide Web, pages 635--644, 2008.

Digital Library

[17]

C. Zhai and J. Lafferty. A study of smoothing methods for language models applied to information retrieval. ACM Transactions on Information Systems, 22(2):179--214, 2004.

Digital Library

Cited By

Glistrup MRudinac SJónsson B(2022)Urban Image Geo-Localization Using Open Data on Public SpacesProceedings of the 19th International Conference on Content-based Multimedia Indexing10.1145/3549555.3549589(50-56)Online publication date: 14-Sep-2022
Fox ELeidig J(2022)Digital Library ApplicationsundefinedOnline publication date: 10-Mar-2022
Kordopatis-Zilos GGalopoulos PPapadopoulos SKompatsiaris ICheng WKankanhalli MWang MChu WLiu JWorring M(2021)Leveraging EfficientNet and Contrastive Learning for Accurate Global-scale Location EstimationProceedings of the 2021 International Conference on Multimedia Retrieval10.1145/3460426.3463644(155-163)Online publication date: 24-Aug-2021
Show More Cited By

Index Terms

Finding locations of flickr resources using language models and similarity search
1. Applied computing
  1. Computers in other domains
    1. Digital libraries and archives
2. Information systems
  1. Information systems applications
    1. Digital libraries and archives

Recommendations

Georeferencing Flickr photos using language models at different levels of granularity: An evidence based approach

The topic of automatically assigning geographic coordinates to Web 2.0 resources based on their tags has recently gained considerable attention. However, the coordinates that are produced by automated techniques are necessarily variable, since not all ...
Detecting geographic locations from web resources
GIR '05: Proceedings of the 2005 workshop on Geographic information retrieval

The rapid pervasion of the web into users' daily lives has put much importance on capturing location-specific information on the web, due to the fact that most human activities occur locally around where a user is located. This is especially true in the ...
Georeferencing Wikipedia Documents Using Data from Social Media Sources

Social media sources such as Flickr and Twitter continuously generate large amounts of textual information (tags on Flickr and short messages on Twitter). This textual information is increasingly linked to geographical coordinates, which makes it ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICMR '11: Proceedings of the 1st ACM International Conference on Multimedia Retrieval

April 2011

512 pages

ISBN:9781450303361

DOI:10.1145/1991996

General Chairs:
Francesco G. B. De Natale
University of Trento, Italy
,
Alberto Del Bimbo
University of Florence, Italy
,
Program Chairs:
Alan Hanjalic
University of Amsterdam, Netherlands
,
B. S. Manjunath
University of California, Santa Barbara
,
Shin'ichi Satoh
NII, Japan

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 18 April 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICMR'11

Sponsor:

SIGMM

ICMR'11: International Conference on Multimedia Retrieval

April 18 - 20, 2011

Trento, Italy

Acceptance Rates

Overall Acceptance Rate 254 of 830 submissions, 31%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

44
Total Citations
View Citations
300
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 11 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Glistrup MRudinac SJónsson B(2022)Urban Image Geo-Localization Using Open Data on Public SpacesProceedings of the 19th International Conference on Content-based Multimedia Indexing10.1145/3549555.3549589(50-56)Online publication date: 14-Sep-2022
Fox ELeidig J(2022)Digital Library ApplicationsundefinedOnline publication date: 10-Mar-2022
Kordopatis-Zilos GGalopoulos PPapadopoulos SKompatsiaris ICheng WKankanhalli MWang MChu WLiu JWorring M(2021)Leveraging EfficientNet and Contrastive Learning for Accurate Global-scale Location EstimationProceedings of the 2021 International Conference on Multimedia Retrieval10.1145/3460426.3463644(155-163)Online publication date: 24-Aug-2021
Yan MJing NZhong ZWu YEmrouznejad AXu Z(2019)Geographical Entity Community Mining Based on Spatial and Semantic AssociationProceedings of the 3rd International Conference on Computer Science and Application Engineering10.1145/3331453.3361652(1-6)Online publication date: 22-Oct-2019
Yan MZhong ZJing NWu Y(2019)Method for Calculating Geographic Entity Relevance Based on Spatial and Semantic Association2019 International Conference on Data Mining Workshops (ICDMW)10.1109/ICDMW.2019.00076(490-496)Online publication date: Nov-2019
Zhang XWang SLi ZMa S(2018)Landmark Image Retrieval by Jointing Feature Refinement and Multimodal Classifier LearningIEEE Transactions on Cybernetics10.1109/TCYB.2017.271279848:6(1682-1695)Online publication date: Jun-2018
Blandfort PKarayil TBorth DDengel AAlameda-Pineda XRedi MSoleymani MSebe NChang SGosling S(2017)Image Captioning in the WildProceedings of the Workshop on Multimodal Understanding of Social, Affective and Subjective Attributes10.1145/3132515.3132522(21-29)Online publication date: 27-Oct-2017
Kordopatis-Zilos GPapadopoulos SKompatsiaris I(2017)Geotagging Text Content With Language Models and Feature MiningProceedings of the IEEE10.1109/JPROC.2017.2688799105:10(1971-1986)Online publication date: Oct-2017
Kordopatis-Zilos GPapadopoulos SKompatsiaris YThomee BBorth DBernd J(2016)In-depth Exploration of Geotagging Performance using Sampling Strategies on YFCC100MProceedings of the 2016 ACM Workshop on Multimedia COMMONS10.1145/2983554.2983558(3-10)Online publication date: 16-Oct-2016
Spyrou EMylonas P(2016)A survey on Flickr multimedia research challengesEngineering Applications of Artificial Intelligence10.1016/j.engappai.2016.01.00651:C(71-91)Online publication date: 1-May-2016
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents