Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/1978942.1979146acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

PhotoCity: training experts at large-scale image acquisition through a competitive game

Published: 07 May 2011 Publication History

Abstract

Large-scale, ground-level urban imagery has recently developed as an important element of online mapping tools such as Google's Street View. Such imagery is extremely valuable in a number of potential applications, ranging from augmented reality to 3D modeling, and from urban planning to monitoring city infrastructure. While such imagery is already available from many sources, including Street View and tourist photos on photo-sharing sites, these collections have drawbacks related to high cost, incompleteness, and accuracy. A potential solution is to leverage the community of photographers around the world to collaboratively acquire large-scale image collections. This work explores this approach through PhotoCity, an online game that trains its players to become "experts" at taking photos at targeted locations and in great density, for the purposes of creating 3D building models. To evaluate our approach, we ran a competition between two universities that resulted in the submission of over 100,000 photos, many of which were highly relevant for the 3D modeling task at hand. Although the number of players was small, we found that this was compensated for by incentives that drove players to become experts at photo collection, often capturing thousands of useful photos each.

References

[1]
Google Building Maker. http://sketchup.google.com/3dwh/buildingmaker.html.
[2]
Google SketchUp. http://sketchup.google.com/.
[3]
OpenStreetMap. http://www.openstreetmap.org/.
[4]
Wikimapia. http://www.wikimapia.org/.
[5]
Wikipedia. http://www.wikipedia.org/.
[6]
S. Agarwal, N. Snavely, I. Simon, S. M. Seitz, and R. Szeliski. Building Rome in a day. International Conference on Computer Vision, 2009.
[7]
C. Baber, J. Cross, T. Khaleel, and R. Beale. Location-based photography as sense-making. In BCS-HCI '08: Proceedings of the 22nd British HCI Group Annual Conference on People and Computers, pages 133--140, Swinton, UK, UK, 2008. British Computer Society.
[8]
M. Bell, S. Reeves, B. Brown, S. Sherwood, D. MacMillan, J. Ferguson, and M. Chalmers. Eyespy: supporting navigation through play. In CHI '09: Proceedings of the 27th international conference on Human factors in computing systems, pages 123--132, New York, NY, USA, 2009. ACM.
[9]
S. Cooper, F. Khatib, A. Treuille, J. Barbero, J. Lee, M. Beenen, A. Leaver-Fay, D. Baker, Z. Popovic, and F. Players. Predicting protein structures with a multiplayer online game. Nature, 466(7307):756--760, August 2010.
[10]
D. Crandall, L. Backstrom, D. Huttenlocher, and J. Kleinberg. Mapping the world's photos. In Proc. Int. World Wide Web Conf., 2009.
[11]
P. E. Debevec, C. J. Taylor, and J. Malik. Modeling and rendering architecture from photographs: A hybrid geometry- and image-based approach. In SIGGRAPH Conf. Proc., pages 11--20, 1996.
[12]
J.-M. Frahm, P. Georgel, D. Gallup, T. Johnson, R. Raguram, C. Wu, Y.-H. Jen, E. Dunn, B. Clipp, S. Lazebnik, and M. Pollefeys. Building Rome on a cloudless day. In Proc. European Conf. on Computer Vision, 2010.
[13]
Y. Furukawa and J. Ponce. Accurate camera calibration from multi-view stereo and bundle adjustment. Int. J. Comput. Vision, 84(3):257--268, 2009.
[14]
A. Irschara, C. Zach, and H. Bischof. Towards wiki-based dense city modeling. pages 1--8, oct. 2007.
[15]
L. Kennedy, M. Naaman, S. Ahern, R. Nair, and T. Rattenbury. How Flickr helps us make sense of the world: Context and content in community-contributed media collections. In Proc. Int. Conf. on Multimedia, 2007.
[16]
L. Nan, A. Sharf, H. Zhang, D. Cohen-Or, and B. Chen. Smartboxes for interactive urban reconstruction. In SIGGRAPH Conf. Proc., 2010.
[17]
T. Quack, B. Leibe, and L. V. Gool. World-scale mining of objects and events from community photo collections. In Proc. Int. Conf. on Content-based Image and Video Retrieval, pages 47--56, 2008.
[18]
B. C. Russell, A. Torralba, K. P. Murphy, and W. T. Freeman. LabelMe: A database and web-based tool for image annotation. Int. J. of Computer Vision, 77(1-3):157--173, 2008.
[19]
I. Simon, N. Snavely, and S. M. Seitz. Scene summarization for online image collections. In Proc. Int. Conf. on Computer Vision, 2007.
[20]
S. N. Sinha, D. Steedly, R. Szeliski, M. Agrawala, and M. Pollefeys. Interactive 3d architectural modeling from unordered photo collections. In SIGGRAPH Asia Conf. Proc., 2008.
[21]
N. Snavely, S. M. Seitz, and R. Szeliski. Photo tourism: Exploring photo collections in 3d. In SIGGRAPH Conference Proceedings, pages 835--846, New York, NY, USA, 2006. ACM Press.
[22]
K. Tuite, N. Snavely, D. Hsiao, A. M. Smith, and Z. Popovic. Reconstructing the world in 3d: Bringing games with a purpose outdoors. In FDG '10: Proceedings of the 5th International Conference on Foundations of Digital Games, Monterey, CA, USA, 2010. ACM Press.
[23]
N. A. Van House. Flickr and public image-sharing: distant closeness and photo exhibition. In CHI '07: CHI '07 extended abstracts on Human factors in computing systems, pages 2717--2722, New York, NY, USA, 2007. ACM.
[24]
L. von Ahn and L. Dabbish. Labeling images with a computer game. In CHI '04: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 319--326, New York, NY, USA, 2004. ACM.
[25]
R. C. Zeleznik, K. P. Herndon, and J. F. Hughes. Sketch: An interface for sketching 3d scenes. In SIGGRAPH Conf. Proc., pages 163--170, 1996.

Cited By

View all
  • (2025)A partitioning Monte Carlo approach for consensus tasks in crowdsourcingExpert Systems with Applications10.1016/j.eswa.2024.125559262(125559)Online publication date: Mar-2025
  • (2024)Day-to-Night Street View Image Generation for 24-Hour Urban Scene Auditing Using Generative AIJournal of Imaging10.3390/jimaging1005011210:5(112)Online publication date: 7-May-2024
  • (2023)Case Study on Student Behavior of Barrier Image Collection through GamingProceedings of the 35th Australian Computer-Human Interaction Conference10.1145/3638380.3638425(159-165)Online publication date: 2-Dec-2023
  • Show More Cited By

Index Terms

  1. PhotoCity: training experts at large-scale image acquisition through a competitive game
          Index terms have been assigned to the content through auto-classification.

          Recommendations

          Comments

          Information & Contributors

          Information

          Published In

          cover image ACM Conferences
          CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
          May 2011
          3530 pages
          ISBN:9781450302289
          DOI:10.1145/1978942
          Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

          Sponsors

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          Published: 07 May 2011

          Permissions

          Request permissions for this article.

          Check for updates

          Author Tags

          1. 3d modeling
          2. crowdsourcing
          3. data collection
          4. games with a purpose
          5. photography
          6. real-world games

          Qualifiers

          • Research-article

          Conference

          CHI '11
          Sponsor:

          Acceptance Rates

          CHI '11 Paper Acceptance Rate 410 of 1,532 submissions, 27%;
          Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

          Upcoming Conference

          CHI 2025
          ACM CHI Conference on Human Factors in Computing Systems
          April 26 - May 1, 2025
          Yokohama , Japan

          Contributors

          Other Metrics

          Bibliometrics & Citations

          Bibliometrics

          Article Metrics

          • Downloads (Last 12 months)20
          • Downloads (Last 6 weeks)0
          Reflects downloads up to 02 Feb 2025

          Other Metrics

          Citations

          Cited By

          View all
          • (2025)A partitioning Monte Carlo approach for consensus tasks in crowdsourcingExpert Systems with Applications10.1016/j.eswa.2024.125559262(125559)Online publication date: Mar-2025
          • (2024)Day-to-Night Street View Image Generation for 24-Hour Urban Scene Auditing Using Generative AIJournal of Imaging10.3390/jimaging1005011210:5(112)Online publication date: 7-May-2024
          • (2023)Case Study on Student Behavior of Barrier Image Collection through GamingProceedings of the 35th Australian Computer-Human Interaction Conference10.1145/3638380.3638425(159-165)Online publication date: 2-Dec-2023
          • (2023)Tirtha - An Automated Platform to Crowdsource Images and Create 3D Models of Heritage SitesProceedings of the 28th International ACM Conference on 3D Web Technology10.1145/3611314.3615904(1-15)Online publication date: 9-Oct-2023
          • (2023)A Method of Crowdsourced Task Request Optimization for 3D Reconstruction in Urban Space2023 IEEE 12th Global Conference on Consumer Electronics (GCCE)10.1109/GCCE59613.2023.10315307(623-624)Online publication date: 10-Oct-2023
          • (2023)A comprehensive survey on mobile crowdsensing systemsJournal of Systems Architecture10.1016/j.sysarc.2023.102952142(102952)Online publication date: Sep-2023
          • (2023)Crowdsourcing as a Future Collaborative Computing ParadigmMobile Crowdsourcing10.1007/978-3-031-32397-3_1(3-32)Online publication date: 21-Apr-2023
          • (2022)Heritage and Repeat Photography: Techniques, Management, Applications, and PublicationsHeritage10.3390/heritage50402205:4(4267-4305)Online publication date: 18-Dec-2022
          • (2022)ReCapture: AR-Guided Time-lapse PhotographyProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545641(1-14)Online publication date: 29-Oct-2022
          • (2022)CrowdOS: A Ubiquitous Operating System for Crowdsourcing and Mobile Crowd SensingIEEE Transactions on Mobile Computing10.1109/TMC.2020.301575021:3(878-894)Online publication date: 1-Mar-2022
          • Show More Cited By

          View Options

          Login options

          View options

          PDF

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader

          Figures

          Tables

          Media

          Share

          Share

          Share this Publication link

          Share on social media