Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3137133.3137154acmconferencesArticle/Chapter ViewAbstractPublication PagessensysConference Proceedingsconference-collections
research-article

Sonicdoor: scaling person identification with ultrasonic sensors by novel modeling of shape, behavior and walking patterns

Published: 08 November 2017 Publication History

Abstract

Non-intrusive occupant identification enables numerous applications in Smart Buildings such as personalization of climate and lighting. Current non-intrusive identification techniques do not scale beyond 20 people whereas commercial buildings can have 100 or more people. This paper proposes a new method to identify occupants by sensing their body shape, movement and walking patterns as they walk through a SonicDoor, a door instrumented with three ultrasonic sensors. The proposed method infers contextual information such as path detection and historical walks through different doors of the building in order to enhance the identification accuracy. Each SonicDoor is instrumented with ultrasonic ping sensors, one on the top to sense height and two on the sides of the door to sense width of the person walking through the door. SonicDoor detects a walking event and analyzes it to infer whether the Walker is using a phone, holding a handbag, or wearing a backpack. It extracts a set of features from the walking event and corrects them using a set of transformation functions to mitigate the bias. We deployed five SonicDoors in a real building for two months and collected data consisting of over 9000 walking events spanning over 170 people. The proposed method identifies up to 100 occupants with an accuracy of 90.2%, which makes it suitable for large-scale realistic buildings. SonicDoor method surpasses the state of the art by a factor of five, which is limited to 20 people.

References

[1]
Brandon Amos, Bartosz Ludwiczuk, and Mahadev Satyanarayanan. 2016. Open-Face: A general-purpose face recognition library with mobile applications. Technical Report. CMU-CS-16--118, CMU School of Computer Science.
[2]
Ricardo JGB Campello, Davoud Moulavi, and Joerg Sander. 2013. Density-based clustering based on hierarchical density estimates. In Pacific-Asia Conference on Knowledge Discovery and Data Mining. Springer, 160--172.
[3]
Chasity DeLoney. 2008. Person identification and gender recognition from footstep sound using modulation analysis. (2008).
[4]
Scott Elrod and Eric Shrader. 2005. Smart floor tiles/carpet for tracking movement in retail, industrial and other environments. (Sept. 27 2005). US Patent App. 11/236,681.
[5]
Jürgen T Geiger, Maximilian Kneißl, Björn W Schuller, and Gerhard Rigoll. 2014. Acoustic gait-based person identification using hidden Markov models. In Proceedings of the 2014 Workshop on Mapping Personality Traits Challenge and Workshop. ACM, 25--30.
[6]
Timothy W Hnat, Erin Griffiths, Ray Dawson, and Kamin Whitehouse. 2012. Doorjamb: unobtrusive room-level tracking of people in homes using doorway sensors. In SenSys'12.
[7]
Andrew K Hrechak and James A McHugh. 1990. Automated fingerprint recognition using structural matching. Pattern Recognition 23, 8 (1990), 893--904.
[8]
Gary B. Huang, Manu Ramesh, Tamara Berg, and Erik Learned-Miller. 2007. Labeled Faces in the Wild: A Database for Studying Face Recognition in Unconstrained Environments. Technical Report 07--49. University of Massachusetts, Amherst.
[9]
Jam Jenkins and Carla Ellis. 2007. Using ground reaction forces from gait analysis: Body mass as a weak biometric. In International Conference on Pervasive Computing. Springer, 251--267.
[10]
Jam Jenkins and Carla Ellis. 2007. Using ground reaction forces from gait analysis: Body mass as a weak biometric. In International Conference on Pervasive Computing. Springer, 251--267.
[11]
Xin Li Kun Lv Qin Dick Robert P Hannigan Michae Shang Li Jiang, Yifei. 2012. Ariel: Automatic wi-fi based room fingerprinting for indoor localization. In Ubicomp'12.
[12]
Amit Kale, Aravind Sundaresan, AN Rajagopalan, Naresh P Cuntoor, Amit K Roy-Chowdhury, Volker Kruger, and Rama Chellappa. 2004. Identification of humans using gait. IEEE Transactions on image processing 13, 9 (2004), 1163--1173.
[13]
Nacer Khalil, Driss Benhaddou, Omprakash Gnawali, and Jaspal Subhlok. 2016. Nonintrusive Occupant Identification by Sensing Body Shape and Movement. In Proceedings of the 3rd ACM International Conference on Systems for Energy-Efficient Built Environments. ACM, 1--10.
[14]
Andreas Lanitis, Christopher J Taylor, and Timothy F Cootes. 1995. Automatic face identification system using flexible appearance models. Image and vision computing 13, 5 (1995), 393--401.
[15]
Wen-Hau Liau, Chao-Lin Wu, and Li-Chen Fu. 2008. Inhabitants tracking system in a cluttered home environment via floor load sensors. IEEE Transactions on Automation Science and Engineering 5, 1 (2008), 10--20.
[16]
Robert J Orr and Gregory D Abowd. 2000. The smart floor: a mechanism for natural user identification and tracking. In CHI'00 extended abstracts on Human factors in computing systems. ACM, 275--276.
[17]
Shijia Pan, An Chen, and Pei Zhang. 2013. Securitas: user identification through rgb-nir camera pair on mobile devices. In SPSM'13.
[18]
Shijia Pan, Ningning Wang, Yuqiu Qian, Irem Velibeyoglu, Hae Young Noh, and Pei Zhang. 2015. Indoor person identification through footstep induced structural vibration. In HotMobile'15.
[19]
Juhi Ranjan, Yu Yao, and Kamin Whitehouse. 2013. An RF doormat for tracking people's room locations. In Ubicomp'13.
[20]
Florian Schroff, Dmitry Kalenichenko, and James Philbin. 2015. Facenet: A unified embedding for face recognition and clustering. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 815--823.
[21]
Vijay Srinivasan, John Stankovic, and Kamin Whitehouse. 2010. Using height sensors for biometric identification in multi-resident homes. In Pervasive computing. Springer.
[22]
Kalyan P Subbu and Nathan Thomas. 2014. A location aware personalized smart control system. In IPSN'14.
[23]
Christel-loic Tisse, Lionel Martin, Lionel Torres, Michel Robert, et al. 2002. Person identification technique using human iris recognition. In Proc. Vision Interface. 294--299.
[24]
Yunze Zeng, Parth H Pathak, and Prasant Mohapatra. 2016. WiWho: WiFi-based Person Identification in Smart Spaces. In 2016 15th ACM/IEEE International Conference on Information Processing in Sensor Networks (IPSN). IEEE, 1--12.
[25]
Jin Zhang, Bo Wei, Wen Hu, Salii S Kanhere, and Ariel Tan. 2016. Human identification using WiFi signal. In 2016 IEEE International Conference on Pervasive Computing and Communication Workshops (PerCom Workshops). IEEE, 1--2.
[26]
Wenyi Zhao, Rama Chellappa, P Jonathon Phillips, and Azriel Rosenfeld. 2003. Face recognition: A literature survey. ACM computing surveys (CSUR) 35, 4 (2003), 399--458.

Cited By

View all
  • (2022)SolarWalkProceedings of the 9th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation10.1145/3563357.3564073(178-187)Online publication date: 9-Nov-2022
  • (2022)SolarWalk DatasetProceedings of the 20th ACM Conference on Embedded Networked Sensor Systems10.1145/3560905.3567773(1031-1034)Online publication date: 6-Nov-2022
  • (2022)PrivGait: An Energy-Harvesting-Based Privacy-Preserving User-Identification System by Gait AnalysisIEEE Internet of Things Journal10.1109/JIOT.2021.30896189:22(22048-22060)Online publication date: 15-Nov-2022
  • Show More Cited By

Index Terms

  1. Sonicdoor: scaling person identification with ultrasonic sensors by novel modeling of shape, behavior and walking patterns

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      BuildSys '17: Proceedings of the 4th ACM International Conference on Systems for Energy-Efficient Built Environments
      November 2017
      292 pages
      ISBN:9781450355445
      DOI:10.1145/3137133
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 08 November 2017

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. clustering
      2. occupant identification
      3. sensor networks
      4. smart buildings

      Qualifiers

      • Research-article

      Conference

      Acceptance Rates

      Overall Acceptance Rate 148 of 500 submissions, 30%

      Upcoming Conference

      SenSys '24

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)3
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 06 Oct 2024

      Other Metrics

      Citations

      Cited By

      View all
      • (2022)SolarWalkProceedings of the 9th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation10.1145/3563357.3564073(178-187)Online publication date: 9-Nov-2022
      • (2022)SolarWalk DatasetProceedings of the 20th ACM Conference on Embedded Networked Sensor Systems10.1145/3560905.3567773(1031-1034)Online publication date: 6-Nov-2022
      • (2022)PrivGait: An Energy-Harvesting-Based Privacy-Preserving User-Identification System by Gait AnalysisIEEE Internet of Things Journal10.1109/JIOT.2021.30896189:22(22048-22060)Online publication date: 15-Nov-2022
      • (2020)Person tracking and identification using cameras and wi-fi channel state information (CSI) from smartphonesProceedings of the Third Workshop on Data: Acquisition To Analysis10.1145/3419016.3431488(26-30)Online publication date: 16-Nov-2020
      • (2020)Tool-chain for supporting Privacy Risk AssessmentsProceedings of the 7th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation10.1145/3408308.3427605(140-149)Online publication date: 18-Nov-2020
      • (2020)Fusing wifi and camera for fast motion tracking and person identificationProceedings of the 18th Conference on Embedded Networked Sensor Systems10.1145/3384419.3430452(617-618)Online publication date: 16-Nov-2020
      • (2020)EyeFi: Fast Human Identification Through Vision and WiFi-based Trajectory Matching2020 16th International Conference on Distributed Computing in Sensor Systems (DCOSS)10.1109/DCOSS49796.2020.00022(59-68)Online publication date: May-2020
      • (2020)Ontology-Based Modeling of Privacy Vulnerabilities for Data SharingPrivacy and Identity Management. Data for Better Living: AI and Privacy10.1007/978-3-030-42504-3_8(109-125)Online publication date: 6-Mar-2020
      • (2019)OccuThermProceedings of the 6th ACM International Conference on Systems for Energy-Efficient Buildings, Cities, and Transportation10.1145/3360322.3360858(81-90)Online publication date: 13-Nov-2019
      • (2018)SonicDoorACM Transactions on Sensor Networks10.1145/322906414:3-4(1-21)Online publication date: 8-Dec-2018
      • Show More Cited By

      View Options

      Get Access

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media