short-paper

Panorama to Panorama Matching for Location Recognition

Authors:

Giorgos Tolias,

Yannis Avrithis,

Ondřej ChumAuthors Info & Claims

ICMR '17: Proceedings of the 2017 ACM on International Conference on Multimedia Retrieval

Pages 392 - 396

https://doi.org/10.1145/3078971.3079033

Published: 06 June 2017 Publication History

Abstract

Location recognition is commonly treated as visual instance retrieval on "street view" imagery. The dataset items and queries are panoramic views, i.e. groups of images taken at a single location. This work introduces a novel panorama-to-panorama matching process, either by aggregating features of individual images in a group or by explicitly constructing a larger panorama. In either case, multiple views are used as queries. We reach near perfect location recognition on a standard benchmark with only four query views.

References

[1]

R. Arandjelović, P. Gronat, A. Torii, T. Pajdla, and J. Sivic. NetVLAD: CNN architecture for weakly supervised place recognition. In CVPR, 2016.

[2]

R. Arandjelovic and A. Zisserman. Multiple queries for large scale specific object retrieval. In BMVC, 2012.

[3]

R. Arandjelovic and A. Zisserman. Dislocation: Scalable descriptor distinctiveness for location recognition. In ACCV, 2014.

[4]

A. Babenko and V. Lempitsky. Aggregating deep convolutional features for image retrieval. In ICCV, 2015.

[5]

A. Babenko, A. Slesarev, A. Chigorin, and V. Lempitsky. Neural codes for image retrieval. In ECCV, 2014.

[6]

M. Brown and D. G. Lowe. Automatic panoramic image stitching using invariant features. IJCV, 74:59--73, 2007.

Digital Library

[7]

S. Cao and N. Snavely. Graph-based discriminative learning for location recognition. In CVPR, 2013.

Digital Library

[8]

M. Cummins and P. Newman. Fab-map: Appearance-based place recognition and mapping using a learned visual vocabulary model. In ICML, 2010.

Digital Library

[9]

A. Gordo, J. Almazan, J. Revaud, and D. Larlus. Deep image retrieval: Learning global representations for image search. ECCV, 2016.

[10]

P.-H. Gosselin, N. Murray, H. Jégou, and F. Perronnin. Revisiting the fisher vector for fine-grained classification. Pattern recognition letters, 49, 2014.

Digital Library

[11]

J. Hays and A. A. Efros. Im2gps: estimating geographic information from a single image. In CVPR, 2008.

[12]

A. Irschara, C. Zach, J.-M. Frahm, and H. Bischof. From structure-from-motion point clouds to fast location recognition. In CVPR, 2009.

[13]

A. Iscen, L. Amsaleg, and T. Furon. Scaling group testing similarity search. In ICMR, 2016.

Digital Library

[14]

A. Iscen, T. Furon, V. Gripon, M. Rabbat, and H. Jégou. Memory vectors for similarity search in high-dimensional spaces. IEEE Trans. Big Data, 2017.

[15]

A. Iscen, G. Tolias, Y. Avrithis, T. Furon, and O. Chum. Efficient diffusion on region manifolds: Recovering small objects with compact cnn representations. In CVPR, 2017.

[16]

H. Jégou and A. Zisserman. Triangulation embedding and democratic kernels for image search. In CVPR, June 2014.

Digital Library

[17]

Y. Kalantidis, C. Mellina, and S. Osindero. Cross-dimensional weighting for aggregated deep convolutional features. In ECCVW, 2016.

[18]

A. Kendall, M. Grimes, and R. Cipolla. Posenet: A convolutional network for real-time 6-dof camera relocalization. In ICCV, 2015.

Digital Library

[19]

Y. Li, N. Snavely, D. Huttenlocher, and P. Fua. Worldwide pose estimation using 3d point clouds. In ECCV, 2012.

Digital Library

[20]

F. Radenović, G. Tolias, and O. Chum. CNN image retrieval learns from BoW: Unsupervised fine-tuning with hard examples. ECCV, 2016.

[21]

C. R. Rao and S. K. Mitra. Generalized inverse of a matrix and its applications. In Sixth Berkeley Symposium on Mathematical Statistics and Probability, 1972.

[22]

A. S. Razavian, J. Sullivan, S. Carlsson, and A. Maki. Visual instance retrieval with deep convolutional networks. ITE Transactions on Media Technology and Applications, 4, 2016.

[23]

T. Sattler, M. Havlena, K. Schindler, and M. Pollefeys. Large-scale location recognition and the geometric burstiness problem. In CVPR, 2016.

[24]

T. Sattler, B. Leibe, and L. Kobbelt. Improving image-based localization by active correspondence search. In ECCV, 2012.

Digital Library

[25]

G. Schindler, M. Brown, and R. Szeliski. City-scale location recognition. In CVPR, 2007.

[26]

M. Shi, Y. Avrithis, and H. Jégou. Early burst detection for memory-efficient image retrieval. In CVPR, 2015.

[27]

R. Sicre and H. Jégou. Memory vectors for particular object retrieval with multiple queries. In ICMR, 2015.

Digital Library

[28]

G. Tolias, Y. Avrithis, and H. Jégou. To aggregate or not to aggregate: Selective match kernels for image search. In ICCV, December 2013.

Digital Library

[29]

G. Tolias, R. Sicre, and H. Jégou. Particular object retrieval with integral max-pooling of cnn activations. ICLR, 2016.

[30]

A. Torii, R. Arandjelovic, J. Sivic, M. Okutomi, and T. Pajdla. 24/7 place recognition by view synthesis. In CVPR, 2015.

[31]

A. Torii, J. Sivic, and T. Pajdla. Visual localization by linear combination of image descriptors. In ICCVW, 2011.

[32]

A. Torii, J. Sivic, T. Pajdla, and M. Okutomi. Visual place recognition with repetitive structures. In CVPR, 2013.

Digital Library

[33]

W. Zhang and J. Kosecka. Image based localization in urban environments. In 3DPVT, 2006.

Digital Library

Cited By

Gao SYang KShi HWang KBai J(2022)Review on Panoramic Imaging and Its Applications in Scene UnderstandingIEEE Transactions on Instrumentation and Measurement10.1109/TIM.2022.321667571(1-34)Online publication date: 2022
https://doi.org/10.1109/TIM.2022.3216675
Orhan SGuerrero JBastanlar Y(2022)Semantic Pose Verification for Outdoor Visual Localization with Self-supervised Contrastive Learning2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)10.1109/CVPRW56347.2022.00444(3988-3997)Online publication date: Jun-2022
https://doi.org/10.1109/CVPRW56347.2022.00444
Orhan SBastanlar Y(2021)Efficient Search in a Panoramic Image Database for Long-term Visual Localization2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW)10.1109/ICCVW54120.2021.00198(1727-1734)Online publication date: Oct-2021
https://doi.org/10.1109/ICCVW54120.2021.00198
Show More Cited By

Index Terms

Panorama to Panorama Matching for Location Recognition
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision tasks
        Visual content-based indexing and retrieval
2. Information systems
  1. Information retrieval
    1. Specialized information retrieval
      1. Multimedia and multimodal retrieval
        Image search

Recommendations

Location recognition using prioritized feature matching
ECCV'10: Proceedings of the 11th European conference on Computer vision: Part II

We present a fast, simple location recognition and image localization method that leverages feature correspondence and geometry estimated from large Internet photo collections. Such recovered structure contains a significant amount of useful information ...
Runtime Baseline Adjustment for Stereo Panorama
CW '08: Proceedings of the 2008 International Conference on Cyberworlds

A stereo panorama consists of a pair of panoramic images, where one panorama is for the left eye, and the other panorama is for the right eye. The disparity between two panoramas provides parallax which enables stereo sense to the viewer. A stereo ...
Panorama light-field imaging
SIGGRAPH '12: ACM SIGGRAPH 2012 Posters

We present a first approach towards panorama light-field imaging. By converting overlapping sub-light-fields into individual focal stacks, computing a panoramic focal stack from them, and converting the panoramic focal stack back into a panoramic light ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICMR '17: Proceedings of the 2017 ACM on International Conference on Multimedia Retrieval

June 2017

524 pages

ISBN:9781450347013

DOI:10.1145/3078971

General Chairs:
Bogdan Ionescu
University Politehnica of Bucharest, Romania
,
Nicu Sebe
University of Trento, Italy
,
Program Chairs:
Jiashi Feng
National University of Singapore, Singapore
,
Martha Larson
Radboud University & Delft University of Technology, The Netherlands
,
Rainer Lienhart
University of Augsburg, Germany
,
Cees Snoek
University of Amsterdam & Qualcomm Research Netherlands, The Netherlands

Copyright © 2017 ACM.

Publication rights licensed to ACM. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of a national government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

Sponsors

SIGMM: ACM Special Interest Group on Multimedia

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 June 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Funding Sources

ERC-CZ

Conference

ICMR '17

Sponsor:

SIGMM

ICMR '17: International Conference on Multimedia Retrieval

June 6 - 9, 2017

Bucharest, Romania

Acceptance Rates

ICMR '17 Paper Acceptance Rate 33 of 95 submissions, 35%;

Overall Acceptance Rate 254 of 830 submissions, 31%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

18
Total Citations
View Citations
298
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)1

Reflects downloads up to 10 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Gao SYang KShi HWang KBai J(2022)Review on Panoramic Imaging and Its Applications in Scene UnderstandingIEEE Transactions on Instrumentation and Measurement10.1109/TIM.2022.321667571(1-34)Online publication date: 2022
https://doi.org/10.1109/TIM.2022.3216675
Orhan SGuerrero JBastanlar Y(2022)Semantic Pose Verification for Outdoor Visual Localization with Self-supervised Contrastive Learning2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)10.1109/CVPRW56347.2022.00444(3988-3997)Online publication date: Jun-2022
https://doi.org/10.1109/CVPRW56347.2022.00444
Orhan SBastanlar Y(2021)Efficient Search in a Panoramic Image Database for Long-term Visual Localization2021 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW)10.1109/ICCVW54120.2021.00198(1727-1734)Online publication date: Oct-2021
https://doi.org/10.1109/ICCVW54120.2021.00198
Zhang CBudvytis ILiwicki SCipolla R(2021)Lifted Semantic Graph Embedding for Omnidirectional Place Recognition2021 International Conference on 3D Vision (3DV)10.1109/3DV53792.2021.00147(1401-1410)Online publication date: Dec-2021
https://doi.org/10.1109/3DV53792.2021.00147
Weng LGouet-Brunet VSoheilian B(2021)Semantic signatures for large-scale visual localizationMultimedia Tools and Applications10.1007/s11042-020-08992-680:15(22347-22372)Online publication date: 1-Jun-2021
https://dl.acm.org/doi/10.1007/s11042-020-08992-6
Fang YYang KCheng RSun LWang K(2020)A Panoramic Localizer Based on Coarse-to-Fine Descriptors for Navigation AssistanceSensors10.3390/s2015417720:15(4177)Online publication date: 27-Jul-2020
https://doi.org/10.3390/s20154177
Vukotić VChappelier VFuron T(2020)Are Classification Deep Neural Networks Good for Blind Image Watermarking?Entropy10.3390/e2202019822:2(198)Online publication date: 8-Feb-2020
https://doi.org/10.3390/e22020198
Fang YWang KCheng RYang K(2020)CFVL: A Coarse-to-Fine Vehicle Localizer with Omnidirectional Perception across Severe Appearance Variations2020 IEEE Intelligent Vehicles Symposium (IV)10.1109/IV47402.2020.9304612(1885-1891)Online publication date: 19-Oct-2020
https://dl.acm.org/doi/10.1109/IV47402.2020.9304612
Jin SGao YChen L(2020)Improved Deep Distance Learning for Visual Loop Closure Detection in Smart CityPeer-to-Peer Networking and Applications10.1007/s12083-019-00861-w13:4(1260-1271)Online publication date: 6-May-2020
https://doi.org/10.1007/s12083-019-00861-w
Imbriaco RSebastian CBondarev Ede With P(2019)Towards accurate camera geopositioning by image matchingEleventh International Conference on Machine Vision (ICMV 2018)10.1117/12.2522999(74)Online publication date: 15-Mar-2019
https://doi.org/10.1117/12.2522999
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents