Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article
Free access

Building Rome in a day

Published: 01 October 2011 Publication History

Abstract

We present a system that can reconstruct 3D geometry from large, unorganized collections of photographs such as those found by searching for a given city (e.g., Rome) on Internet photo-sharing sites. Our system is built on a set of new, distributed computer vision algorithms for image matching and 3D reconstruction, designed to maximize parallelism at each stage of the pipeline and to scale gracefully with both the size of the problem and the amount of available computation. Our experimental results demonstrate that it is now possible to reconstruct city-scale image collections with more than a hundred thousand images in less than a day.

References

[1]
Agarwal, S., Snavely, N., Seitz, S.M., Szeliski, R. Bundle adjustment in the large. In ECCV (2), volume 6312 of Lecture Notes in Computer Science (2010). K. Daniilidis, P. Maragos, and N. Paragios, eds. Springer, Berlin, Germany, 29--42.
[2]
Antone, M.E., Teller, S.J. Scalable extrinsic calibration of omnidirectional image networks. Int. J. Comput. Vis. 49, 2--3 (2002), 143--174.
[3]
Arya, S., Mount, D.M., Netanyahu, N.S., Silverman, R., Wu, A.Y. An optimal algorithm for approximate nearest neighbor searching fixed dimensions. J. ACM 45, 6 (1998), 891--923.
[4]
Chen, Y., Davis, T.A., Hager, W.W., Rajamanickam, S. Algorithm 887: CHOLMOD, supernodal sparse Cholesky factorization and update/ downdate. ACM Trans. Math. Softw. 35, 3 (2008), 1--14.
[5]
Chum, O., Philbin, J., Sivic, J., Isard, M., Zisserman, A. Total recall: Automatic query expansion with a generative feature model for object retrieval. In ICCV (2007), IEEE, 1--8.
[6]
Fischler, M.A., Bolles, R.C. Random sample consensus: A paradigm for model fitting with application to image analysis and automated cartography. Commun. Assoc. Comp. Mach. 24 (1981), 381--395.
[7]
Frahm, J.-M., Georgel, P.F., Gallup, D., Johnson, T., Raguram, R., Wu, C., Jen, Y.-H., Dunn, E., Clipp, B., Lazebnik, S. Building Rome on a cloudless day. In ECCV (4), volume 6314 of Lecture Notes in Computer Science (2010). K. Daniilidis, P. Maragos, and N. Paragios, eds. Springer, Berlin, Germany, 368--381.
[8]
Früh, C., Zakhor, A. An automated method for large-scale, ground-based city model acquisition. Int. J. Comput. Vis. 60, 1 (2004), 5--24.
[9]
Furukawa, Y., Curless, B., Seitz, S.M., Szeliski, R. Towards internet-scale multi-view stereo. In CVPR (2010), IEEE, 1434--1441.
[10]
Hartley, R.I., Zisserman, A. Multiple View Geometry in Computer Vision. Cambridge University Press, Cambridge, U.K., 2003.
[11]
Jones, K. A statistical interpretation of term specificity and its application in retrieval. J. Doc. 60, 5 (2004), 493--502.
[12]
Karypis, G., Kumar, V. A fast and high quality multilevel scheme for partitioning irregular graphs. SIAM J. Sci. Comput. 20, 1 (1998), 359--392.
[13]
Lowe, D. Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60, 2 (2004), 91--110.
[14]
Nistér, D., Stewénius, H. Scalable recognition with a vocabulary tree. In CVPR (2) (2006), IEEE Computer Society, 2161--2168.
[15]
Pollefeys, M., Nister, D., Frahm, J., Akbarzadeh, A., Mordohai, P., Clipp, B., Engels, C., Gallup, D., Kim, S., Merrell, P. et al. Detailed real-time urban 3d reconstruction from video. IJCV 78, 2 (2008), 143--167.
[16]
Schindler, G., Brown, M., Szeliski, R. City-scale location recognition. In CVPR (2007), IEEE Computer Society.
[17]
Sivic, J., Zisserman, A. Video Google: A text retrieval approach to object matching in videos. In ICCV (2003), 1470--1477.
[18]
Snavely, N., Seitz, S.M., Szeliski, R. Photo Tourism: Exploring photo collections in 3d. ACM Trans. Graph. 25, 3 (2006), 835--846.
[19]
Snavely, N., Seitz, S.M., Szeliski, R. Skeletal graphs for efficient structure from motion. In CVPR (2008), IEEE Computer Society.
[20]
Triggs, B., McLauchlan, P., Hartley, R.I., Fitzgibbon, A. Bundle adjustment---A modern synthesis. In Vision Algorithms '99 (1999), 298--372.
[21]
Zebedin, L., Bauer, J., Karner, K.F., Bischof, H. Fusion of feature-and area-based information for urban buildings modelling from aerial imagery. In ECCV (4), volume 5305 of Lecture Notes in Computer Science (2008). D.A. Forsyth, P.H.S. Torr, and A. Zisserman, eds. Springer, Berlin, Germany, 873--886.

Cited By

View all
  • (2024)Bridging Formal Shape Models and Deep Learning: A Novel Fusion for Understanding 3D ObjectsSensors10.3390/s2412387424:12(3874)Online publication date: 15-Jun-2024
  • (2024)Building Better Models: Benchmarking Feature Extraction and Matching for Structure from Motion at Construction SitesRemote Sensing10.3390/rs1616297416:16(2974)Online publication date: 14-Aug-2024
  • (2024)End-to-End Framework for the Automatic Matching of Omnidirectional Street Images and Building Data and the Creation of 3D Building ModelsRemote Sensing10.3390/rs1611185816:11(1858)Online publication date: 23-May-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Communications of the ACM
Communications of the ACM  Volume 54, Issue 10
October 2011
126 pages
ISSN:0001-0782
EISSN:1557-7317
DOI:10.1145/2001269
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 October 2011
Published in CACM Volume 54, Issue 10

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Research-article
  • Popular
  • Refereed

Funding Sources

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)1,281
  • Downloads (Last 6 weeks)117
Reflects downloads up to 18 Aug 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Bridging Formal Shape Models and Deep Learning: A Novel Fusion for Understanding 3D ObjectsSensors10.3390/s2412387424:12(3874)Online publication date: 15-Jun-2024
  • (2024)Building Better Models: Benchmarking Feature Extraction and Matching for Structure from Motion at Construction SitesRemote Sensing10.3390/rs1616297416:16(2974)Online publication date: 14-Aug-2024
  • (2024)End-to-End Framework for the Automatic Matching of Omnidirectional Street Images and Building Data and the Creation of 3D Building ModelsRemote Sensing10.3390/rs1611185816:11(1858)Online publication date: 23-May-2024
  • (2024)GeoViewMatch: A Multi-Scale Feature-Matching Network for Cross-View Geo-Localization Using Swin-Transformer and Contrastive LearningRemote Sensing10.3390/rs1604067816:4(678)Online publication date: 14-Feb-2024
  • (2024)Towards Real-Time 3D Terrain Reconstruction from Aerial ImageryGeographies10.3390/geographies40100054:1(66-82)Online publication date: 29-Jan-2024
  • (2024)Photogrammetric Measurement of Grassland Fire Spread: Techniques and Challenges with Low-Cost Unmanned Aerial VehiclesDrones10.3390/drones80702828:7(282)Online publication date: 22-Jun-2024
  • (2024)Generation of Virtual Ground Control Points Using a Binocular CameraDrones10.3390/drones80501958:5(195)Online publication date: 12-May-2024
  • (2024)Improving Target Geolocation Accuracy with Multi-View Aerial Images in Long-Range Oblique PhotographyDrones10.3390/drones80501778:5(177)Online publication date: 30-Apr-2024
  • (2024)Generating Panoramic Top-view Images along Railway Tracks using Forward-facing Train Footage沿線設備の保守省力化のための列車前方映像を用いた線路周辺の長尺な俯瞰画像生成手法IEEJ Transactions on Industry Applications10.1541/ieejias.144.60144:3(60-69)Online publication date: 1-Mar-2024
  • (2024)Aberration aware feature detection and descriptionOptics Express10.1364/OE.52893232:14(24688)Online publication date: 21-Jun-2024
  • Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Digital Edition

View this article in digital edition.

Digital Edition

Magazine Site

View this article on the magazine site (external)

Magazine Site

Get Access

Login options

Full Access

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media