Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

ComNSense: Grammar-Driven Crowd-Sourcing of Point Clouds for Automatic Indoor Mapping

Published: 26 March 2018 Publication History

Abstract

Recently, point clouds have been efficiently utilized for medical imaging, modeling urban environments, and indoor modeling. In this realm, several mobile platforms, such as Google Tango and Apple ARKit, have been released leveraging 3D mapping, augmented reality, etc. In modeling applications, these modern mobile devices opened the door for crowd-sourcing point clouds to distribute the overhead of data collection. However, uploading these large points clouds from resources-constrained mobile devices to the back-end servers consumes excessive energy. Accordingly, participation rates in such crowd-sensing systems can be negatively influenced. To tackle this challenge, this paper introduces our ComNSense approach that dramatically reduces the energy consumption of processing and uploading point clouds. To this end, ComNSense reports only a set of extracted geometrical data to the servers. To optimize the geometry extraction, ComNSense leverages formal grammars which encode design-time knowledge, i.e. structural information. To demonstrate the effectiveness of ComNSense, we performed several experiments of collecting point clouds from two different buildings to extract the walls location, as a case study. We also assess the performance of ComNSense relative to a grammar-free method. The results showed a significant reduction of the energy consumption while achieving a comparable detection accuracy.

References

[1]
M. Alzantot and M. Youssef. 2012. CrowdInside: Automatic Construction of Indoor Floorplans. In Proceedings of the 20th International Conference on Advances in Geographic Information Systems (SIGSPATIAL '12). ACM, 99--108.
[2]
I. Anagnostopoulos, V. Pătrăucean, I. Brilakis, and P. Vela. 2016. Detection of Walls, Floors, and Ceilings in Point Cloud Data. In Proceedings of the Construction Research Congress 2016. 2302--2311.
[3]
ATAP. 2016. Depth Perception. (2016). https://developers.google.com/tango/overview/depth-perception accessed on July 2016.
[4]
ATAP. 2016. Google Project Tango. (2016). https://developers.google.com/project-tango/ accessed on June 2016.
[5]
S. Becker, M. Peter, and D. Fritsch. 2015. Grammar-supported 3D Indoor Reconstruction from Point Clouds for" as-built" BIM. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences 2, 3 (2015), 17.
[6]
S. Chen, M. Li, K. Ren, X. Fu, and C. Qiao. 2015. Rise of the Indoor Crowd: Reconstruction of Building Interior View via Mobile Crowdsourcing. In Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems (SenSys '15). ACM, 59--71.
[7]
Google Tango Developers. 2016. Integrating Motion Tracking with Area Learning. (2016). https://developers.google.com/tango/overview/area-learning accessed on May 2016.
[8]
J. Dong, Y. Xiao, M. Noreikis, Z. Ou, and A. Ylä-Jääski. 2015. iMoon: Using Smartphones for Image-based Indoor Navigation. In Proceedings of the 13th ACM Conference on Embedded Networked Sensor Systems (SenSys '15). ACM, 85--97.
[9]
N. Fenton and M. Neil. 2012. Risk Assessment and Decision Analysis with Bayesian Networks. CRC Press.
[10]
R. Gao, M. Zhao, T. Ye, F. Ye, G. Luo, Y. Wang, K. Bian, T. Wang, and X. Li. 2016. Multi-Story Indoor Floor Plan Reconstruction via Mobile Crowdsensing. IEEE Transactions on Mobile Computing 15, 6 (June 2016), 1427--1442.
[11]
J. Gudmundsson, A. Thorn, and J. Vahrenhold. 2012. Of Motifs and Goals: Mining Trajectory Data. In Proceedings of the 20th International Conference on Advances in Geographic Information Systems (SIGSPATIAL '12). ACM, 129--138.
[12]
G. Hartl and B. Li. 2005. Infer: A Bayesian Inference Approach towards Energy Efficient Data Collection in Dense Sensor Networks. In Proceedings of the 25th IEEE International Conference on Distributed Computing Systems (ICDCS'05). 371--380.
[13]
S. Ikehata, H. Yang, and Y. Furukawa. 2015. Structured Indoor Modeling. In Proceedings of the IEEE International Conference on Computer Vision. 1323--1331.
[14]
Ian Jolliffe. 2002. Principal Component Analysis. Wiley Online Library.
[15]
K. Kensuke, T. Kanji, and N. Tomomi. 2011. Grammar-Based Map Compression Using Manhattan World Priors. In Proceedings of the 2011 IEEE International Conference on Robotics and Biomimetics (ROBIO). IEEE, 2612--2617.
[16]
K. Khoshelham and L. Díaz-Vilariño. 2014. 3D Modelling of Interior Spaces: Learning the Language of Indoor Architecture. The International Archives of Photogrammetry, Remote Sensing and Spatial Information Sciences 40, 5 (2014), 321.
[17]
J. Kieffer and E. Yang. 2000. Grammar-Based Codes: a New Class of Universal Lossless Source Codes. IEEE Transactions on Information Theory 46, 3 (2000), 737--754.
[18]
M. Li, P. Wonka, and L. Nan. 2016. Manhattan-World Urban Reconstruction from Point Clouds. In European Conference on Computer Vision. Springer, 54--69.
[19]
C. Luo, H. Hong, L. Cheng, K. Sankaran, and M. C. Chan. 2015. iMap: Automatic Inference of Indoor Semantics Exploiting Opportunistic Smartphone Sensing. In Proceedings of the 12th Annual IEEE International Conference on Sensing, Communication, and Networking (SECON). 489--497.
[20]
D. Lymberopoulos, A. Ogale, A. Savvides, and Y. Aloimonos. 2006. A Sensory Grammar for Inferring Behaviors in Sensor Networks. In Proceedings of the 5th International Conference on Information Processing in Sensor Networks (IPSN'06). ACM, 251--259.
[21]
B. Okorn, X. Xiong, B. Akinci, and D. Huber. 2010. Toward Automated Modeling of Floor Plans. In Proceedings of the Symposium on 3D Data Processing, Visualization and Transmission, Vol. 2.
[22]
J. Park and S. Teller. 2014. Motion Compatibility for Indoor Localization. Technical Report MIT-CSAIL-TR-2014-017. http://hdl.handle.net/1721.1/89075
[23]
D. Philipp, P. Baier, C. Dibak, F. Dürr, K. Rothermel, S. Becker, M. Peter, and D. Fritsch. 2014. MapGENIE: Grammar-Enhanced Indoor Map Construction From Crowd-Sourced Data. In Proceedings of the 2014 IEEE International Conference on Pervasive Computing and Communications (PerCom). 139--147.
[24]
S. Pu and G. Vosselman. 2009. Knowledge Based Reconstruction of Building Models from Terrestrial Laser Scanning Data. ISPRS Journal of Photogrammetry and Remote Sensing 64, 6 (2009), 575--584.
[25]
C. Qiu and M. Mutka. 2016. iFrame: Dynamic Indoor Map Construction through Automatic Mobile Sensing. Pervasive and Mobile Computing (2016).
[26]
P. Robertson, M. Angermann, and B. Krach. 2009. Simultaneous Localization and Mapping for Pedestrians Using Only Foot-mounted Inertial Sensors. In Proceedings of the 11th International Conference on Ubiquitous Computing (UbiComp '09). ACM, New York, NY, USA, 93--96.
[27]
A. Rottmann, C. Mozos, Ó.and Stachniss, and W. Burgard. 2005. Semantic Place Classification of Indoor Environments with Mobile Robots Using Boosting. In Proceedings of the 20th National Conference on Artificial Intelligence - Volume 3 (AAAI'05). AAAI Press, 1306--1311. http://dl.acm.org/citation.cfm?id=1619499.1619543
[28]
S. Rusinkiewicz and M. Levoy. 2000. QSplat: A Multiresolution Point Rendering System for Large Meshes. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '00). ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 343--352.
[29]
R. Rusu and S. Cousins. 2011. 3D Is Here: Point Cloud Library (PCL). In Proceedings of the 2011 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 1--4.
[30]
J. Schmidt and H. Niemann. 2001. Using Quaternions for Parametrizing 3-D Rotations in Unconstrained Nonlinear Optimization. In Proceedings of the Vision Modeling and Visualization Conference (VMV '01). Aka GmbH, 399--406. http://dl.acm.org/citation.cfm?id=647260.718651
[31]
Ruwen Schnabel and Reinhard Klein. 2006. Octree-Based Point-Cloud Compression. In Proceedings of the Symposium on Point-Based Graphics, M. Botsch and B. Chen (Eds.). Eurographics.
[32]
P. Tang, D. Huber, B. Akinci, R. Lipman, and A. Lytle. 2010. Automatic Reconstruction of As-Built Building Information Models from Laser-Scanned Point Clouds: A Review of Related Techniques. Automation in Construction 19, 7 (2010), 829--843.
[33]
M. Venanzi, J. Guiver, G. Kazai, P. Kohli, and M. Shokouhi. 2014. Community-Based Bayesian Aggregation Models for Crowdsourcing. In Proceedings of the 23rd International Conference on World Wide Web. ACM, 155--164.
[34]
P. Wonka, M. Wimmer, F. Sillion, and W. Ribarsky. 2003. Instant Architecture. ACM, New York, NY, USA. 669--677 pages.
[35]
Z. Yan, D. Chakraborty, C. Parent, S. Spaccapietra, and K. Aberer. 2013. Semantic Trajectories: Mobility Data Computation and Annotation. ACM Transactions on Intelligent Systems and Technology 4, 3, Article 49 (July 2013), 38 pages.
[36]
X. Zhang, Y. Jin, H. Tan, and W. Soh. 2014. Cimloc: A Crowdsourcing Indoor Digital Map Construction System for Localization. In Intelligent Sensors, Sensor Networks and Information Processing (ISSNIP), 2014 IEEE Ninth International Conference on. IEEE, 1--6.
[37]
B. Zhou, Q. Li, Q. Mao, W. Tu, X. Zhang, and L. Chen. 2015. ALIMC: Activity Landmark-Based Indoor Mapping via Crowdsourcing. IEEE Transactions on Intelligent Transportation Systems 16, 5 (Oct 2015), 2774--2785.

Cited By

View all
  • (2023)VILL: Toward Efficient and Automatic Visual Landmark LabelingACM Transactions on Sensor Networks10.1145/358049719:4(1-25)Online publication date: 21-Apr-2023
  • (2023)TransFloorProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35694706:4(1-30)Online publication date: 11-Jan-2023
  • (2021)A Privacy-Enhanced and Personalized Safe Route Planner with Crowdsourced Data and Computation2021 IEEE 37th International Conference on Data Engineering (ICDE)10.1109/ICDE51399.2021.00027(229-240)Online publication date: Apr-2021
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies  Volume 2, Issue 1
March 2018
1370 pages
EISSN:2474-9567
DOI:10.1145/3200905
Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 March 2018
Accepted: 01 January 2018
Revised: 01 November 2017
Received: 01 August 2017
Published in IMWUT Volume 2, Issue 1

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. Crowd-Sensing
  2. Data Acquisition
  3. Energy Efficiency
  4. Formal Grammars
  5. Point Clouds

Qualifiers

  • Research-article
  • Research
  • Refereed

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)15
  • Downloads (Last 6 weeks)3
Reflects downloads up to 26 Sep 2024

Other Metrics

Citations

Cited By

View all
  • (2023)VILL: Toward Efficient and Automatic Visual Landmark LabelingACM Transactions on Sensor Networks10.1145/358049719:4(1-25)Online publication date: 21-Apr-2023
  • (2023)TransFloorProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35694706:4(1-30)Online publication date: 11-Jan-2023
  • (2021)A Privacy-Enhanced and Personalized Safe Route Planner with Crowdsourced Data and Computation2021 IEEE 37th International Conference on Data Engineering (ICDE)10.1109/ICDE51399.2021.00027(229-240)Online publication date: Apr-2021
  • (2018)Crowd-enabled Processing of Trustworthy, Privacy-Enhanced and Personalised Location Based Services with Quality GuaranteeProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/32870452:4(1-25)Online publication date: 27-Dec-2018
  • (2018)Feasibility of human activity recognition using wearable depth camerasProceedings of the 2018 ACM International Symposium on Wearable Computers10.1145/3267242.3267276(92-95)Online publication date: 8-Oct-2018
  • (2018)GreenMap: Approximated Filtering Towards Energy-Aware Crowdsensing for Indoor Mapping2018 IEEE 15th International Conference on Mobile Ad Hoc and Sensor Systems (MASS)10.1109/MASS.2018.00069(451-459)Online publication date: Oct-2018

View Options

Get Access

Login options

Full Access

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media