Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/2809695.2809702acmconferencesArticle/Chapter ViewAbstractPublication PagessensysConference Proceedingsconference-collections
research-article

Rise of the Indoor Crowd: Reconstruction of Building Interior View via Mobile Crowdsourcing

Published: 01 November 2015 Publication History

Abstract

Crowdsourcing is a technology with the potential to revolutionize large-scale data gathering in an extremely cost-effective manner. It provides an unprecedented means of collecting data from the physical world, particularly through the use of modern smartphones, which are equipped with high-resolution cameras and various micro-electrical sensors. In this paper, we address the critical task of reconstructing the indoor interior view of a building from crowdsourced data. We propose, design, and prototype IndoorCrowd2D, a smartphone-empowered crowdsourcing system for indoor scene reconstruction. We first formulate the problem via trackable models and then employ a divide and conquer approach to address the inherently incomplete, opportunistic, and noisy crowdsourced data. By utilizing the image information and sensory data in a coordinated way, our system demonstrates high result-accuracy, as well as allows a gradual build-up procedure of the hallway skeleton. Our evaluation result shows that IndoorCrowd2D achieves a precision around 85%, a 100% recall and a F-score around 95% for reconstructing college buildings from 1,151 datasets uploaded by 25 users. This reveals that our image and sensor hybrid method is more robust to overcome errors and outliers as compared to image-only method.

References

[1]
S. Agarwal, Y. Furukawa, N. Snavely, I. Simon, B. Curless, S. M. Seitz, and R. Szeliski. Building rome in a day. Communications of the ACM, 54(10):105--112, 2011.
[2]
M. Alzantot and M. Youssef. Crowdinside: automatic construction of indoor floorplans. In SIGSPATIAL GIS, 2012.
[3]
C. Arth, D. Wagner, M. Klopschitz, A. Irschara, and D. Schmalstieg. Wide area localization on mobile phones. In ISMAR, 2009.
[4]
H. Bay, T. Tuytelaars, and L. Van Gool. Surf: Speeded up robust features. In ECCV, 2006.
[5]
Y. Bok, Y. Hwang, and I. S. Kweon. Accurate motion estimation and high-precision 3d reconstruction by sensor fusion. In Robotics and Automation, 2007.
[6]
J.-Y. Bouguet. Pyramidal implementation of the affine lucas kanade feature tracker description of the algorithm.
[7]
G. Bradski. Opencv. Dr. Dobb's Journal of Software Tools, 2000.
[8]
M. Brown and D. G. Lowe. Automatic panoramic image stitching using invariant features. International Journal of Computer Vision, 74(1):59--73, 2007.
[9]
S. Chen, M. Li, K. Ren, and C. Qiao. Crowdmap: Accurate reconstruction of indoor floor plan from crowdsourced sensor-rich videos. In ICDCS, 2015.
[10]
K. Chintalapudi, A. Padmanabha Iyer, and V. N. Padmanabhan. Indoor localization without the pain. In Mobicom, 2010.
[11]
J. Chon and H. Cha. Lifemap: A smartphone-based context provider for location-based services. IEEE Pervasive Computing, (2):58--67, 2011.
[12]
J. Coughlan and A. Yuille. Manhattan world: Compass direction from a single image by bayesian inference. In ICCV, 1999.
[13]
M. F. Fallon, H. Johannsson, J. Brookshire, S. Teller, and J. J. Leonard. Sensor fusion for flexible human-portable building-scale mapping. In IROS, 2012.
[14]
A. Furlan, S. Miller, D. G. Sorrenti, L. Fei-Fei, and S. Savarese. Free your camera: 3d indoor scene understanding from arbitrary camera motion. In BMVC, 2013.
[15]
Y. Furukawa, B. Curless, S. M. Seitz, and R. Szeliski. Manhattan-world stereo. In CVPR, 2009.
[16]
Y. Furukawa, B. Curless, S. M. Seitz, and R. szeliski. Reconstructing building interiors from images. In ICCV, 2009.
[17]
Y. Furukawa, B. Curless, S. M. Seitz, and R. Szeliski. Towards internet-scale multi-view stereo. In CVPR, 2010.
[18]
Y. Furukawa and J. Ponce. Accurate, dense, and robust multiview stereopsis. PAMI, 32(8):1362--1376, 2010.
[19]
R. Gao, M. Zhao, T. Ye, F. Ye, Y. Wang, K. Bian, T. Wang, and X. Li. Jigsaw: Indoor floor plan reconstruction via mobile crowdsensing. In MobiCom, 2014.
[20]
GoogleStreetView. https://www.google.com/maps/views/streetview.
[21]
Y. Jiang et al. Hallway based automatic indoor floorplan construction using room fingerprints. In Ubicomp, 2013.
[22]
S. H. Kim and others. Key frame selection algorithms for automatic generation of panoramic images from crowdsourced geo-tagged videos. In WWGIS. 2014.
[23]
H. Liu, Y. Gan, J. Yang, S. Sidhom, Y. Wang, Y. Chen, and F. Ye. Push the limit of wifi based localization for smartphones. In Mobicom, 2012.
[24]
T. Liu et al. Indoor localization and visualization using a human-operated backpack system. In IPIN, 2010.
[25]
H. C. Longuet-Higgins and K. Prazdny. The interpretation of a moving retinal image. Biological Sciences, 208(1173):385--397, 1980.
[26]
R. A. Newcombe et al. Kinectfusion: Real-time dense surface mapping and tracking. In ISMAR, 2011.
[27]
D. Philipp et al. Mapgenie: Grammar-enhanced indoor map construction from crowd-sourced data. In PerCom, 2014.
[28]
ProjectTango. https://www.google.com/atap/projecttango.
[29]
A. Rai, K. K. Chintalapudi, V. N. Padmanabhan, and R. Sen. Zee: zero-effort crowdsourcing for indoor localization. In Mobicom, 2012.
[30]
V. Raychoudhury, S. Shrivastav, S. Sandha, and J. Cao. Crowd-pan-360: Crowdsourcing based context-aware panoramic map generation for smartphone users. Parallel and Distributed Systems, IEEE Transactions on, 26(8):2208--2219, Aug 2015.
[31]
N. Roy, H. Wang, and R. Roy Choudhury. I am a smartphone and i can tell my user's walking direction. In Mobisys, 2014.
[32]
L. Ruotsalainen, H. Kuusniemi, and R. Chen. Heading change detection for indoor navigation with a smartphone camera. In IPIN, 2011.
[33]
A. Sankar and S. Seitz. Capturing indoor scenes with smartphones. In UIST, 2012.
[34]
G. Shen, Z. Chen, P. Zhang, T. Moscibroda, and Y. Zhang. Walkie-markie: indoor pathway mapping made easy. In NSDI, 2013.
[35]
H. Shin, Y. Chon, and H. Cha. Unsupervised construction of an indoor floor plan using a smartphone. ITSMC, 2012.
[36]
N. Snavely, S. M. Seitz, and R. szeliski. Photo tourism: exploring photo collections in 3d. TOG, 2006.
[37]
N. Snavely, S. M. Seitz, and R. Szeliski. Modeling the world from internet photo collections. IJCV, 80(2):189--210, 2008.
[38]
P. Steadman. Why are most buildings rectangular? Architectural Research Quarterly, 10(02):119--130, 2006.
[39]
Z. Sun, S. Pan, Y.-C. Su, and P. Zhang. Headio: zero-configured heading acquisition for indoor mobile devices through multimodal context sensing. In UbiComp, 2013.
[40]
P. Tanskanen, K. Kolev, L. Meier, F. Camposeco, O. Saurer, and M. Pollefeys. Live metric 3d reconstruction on mobile phones. In ICCV, 2013.
[41]
TRXSystems. http://www.trxsystems.com/.
[42]
H. Wang, S. Sen, A. Elgohary, M. Farid, M. Youssef, and R. R. Choudhury. No need to war-drive: unsupervised indoor localization. In Mobisys, 2012.
[43]
C. Wu, Z. Yang, Y. Liu, and W. Xi. Will: Wireless indoor localization without site survey. TPDS, 24(4):839--848, 2013.
[44]
J. Xiao and Y. Furukawa. Reconstructing the world's museums. In ECCV. 2012.
[45]
J. Xiao, A. Owens, and A. Torralba. Sun3d: A database of big spaces reconstructed using sfm and object labels. In ICCV, 2013.
[46]
J. Xiong and K. Jamieson. Arraytrack: a fine-grained indoor location system. In Usenix NSDI, 2013.
[47]
C. Zauner. Implementation and benchmarking of perceptual image hash functions. 2010.
[48]
X. Zhang, Z. Yang, C. Wu, W. Sun, and Y. Liu. Robust trajectory estimation for crowdsourcing-based mobile applications. 2013.
[49]
Y. Zheng, G. Shen, L. Li, C. Zhao, M. Li, and F. Zhao. Travi-navi: Self-deployable indoor navigation system. In Proceedings of the 20th annual international conference on Mobile computing and networking, pages 471--482. ACM, 2014.
[50]
Y. Zheng, X. Xie, and W.-Y. Ma. Mining interesting locations and travel sequences from gps trajectories. In WWW, 2009.

Cited By

View all
  • (2024)Enabling lightweight immersive user interaction in smart buildings through learning-based mobile panorama streamingComputer Communications10.1016/j.comcom.2024.04.002222(68-76)Online publication date: Jun-2024
  • (2023)Smartphone-Based Indoor Floor Plan Construction via Acoustic Ranging and Inertial TrackingMachines10.3390/machines1102020511:2(205)Online publication date: 1-Feb-2023
  • (2023)EZMap: Boosting Automatic Floor Plan Construction With High-Precision Robotic TrackingIEEE Internet of Things Journal10.1109/JIOT.2022.322874010:8(6988-6998)Online publication date: 15-Apr-2023
  • Show More Cited By

Index Terms

  1. Rise of the Indoor Crowd: Reconstruction of Building Interior View via Mobile Crowdsourcing

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      SenSys '15: Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems
      November 2015
      526 pages
      ISBN:9781450336314
      DOI:10.1145/2809695
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 01 November 2015

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. crowdsourcing
      2. indoor scene
      3. multi-dimensional sensing
      4. panorama

      Qualifiers

      • Research-article

      Funding Sources

      • National Science Foundation

      Conference

      Acceptance Rates

      SenSys '15 Paper Acceptance Rate 27 of 132 submissions, 20%;
      Overall Acceptance Rate 198 of 990 submissions, 20%

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)29
      • Downloads (Last 6 weeks)3
      Reflects downloads up to 19 Feb 2025

      Other Metrics

      Citations

      Cited By

      View all
      • (2024)Enabling lightweight immersive user interaction in smart buildings through learning-based mobile panorama streamingComputer Communications10.1016/j.comcom.2024.04.002222(68-76)Online publication date: Jun-2024
      • (2023)Smartphone-Based Indoor Floor Plan Construction via Acoustic Ranging and Inertial TrackingMachines10.3390/machines1102020511:2(205)Online publication date: 1-Feb-2023
      • (2023)EZMap: Boosting Automatic Floor Plan Construction With High-Precision Robotic TrackingIEEE Internet of Things Journal10.1109/JIOT.2022.322874010:8(6988-6998)Online publication date: 15-Apr-2023
      • (2023)A survey of crowdsourcing-based indoor map learning methods using smartphonesResults in Control and Optimization10.1016/j.rico.2022.10018610(100186)Online publication date: Mar-2023
      • (2023)Crowdmapping: Inclusive Cities and EvaluationComputational Science and Its Applications – ICCSA 2023 Workshops10.1007/978-3-031-37129-5_7(80-90)Online publication date: 30-Jun-2023
      • (2022)Achieving Privacy-Preserving and Lightweight Truth Discovery in Mobile CrowdsensingIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2021.305440934:11(5140-5153)Online publication date: 1-Nov-2022
      • (2022)Floor Plan Reconstruction with High-Precision Rf-Based TrackingICASSP 2022 - 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)10.1109/ICASSP43922.2022.9746850(5073-5077)Online publication date: 23-May-2022
      • (2022)Privacy-Preserving Truth Discovery with Truth TransparencyPrivacy-Preserving in Mobile Crowdsensing10.1007/978-981-19-8315-3_5(109-142)Online publication date: 21-Dec-2022
      • (2022)BatMapper-Plus: Smartphone-Based Multi-level Indoor Floor Plan Construction via Acoustic Ranging and Inertial SensingWireless Algorithms, Systems, and Applications10.1007/978-3-031-19214-2_13(155-167)Online publication date: 17-Nov-2022
      • (2021)DeepNav: A scalable and plug-and-play indoor navigation system based on visual CNNPeer-to-Peer Networking and Applications10.1007/s12083-021-01216-0Online publication date: 10-Jul-2021
      • Show More Cited By

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Figures

      Tables

      Media

      Share

      Share

      Share this Publication link

      Share on social media