Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3485730.3494117acmconferencesArticle/Chapter ViewAbstractPublication PagessensysConference Proceedingsconference-collections
short-paper
Open access

Footstep-Induced Floor Vibration Dataset: Reusability and Transferability Analysis

Published: 15 November 2021 Publication History

Abstract

Footstep-induced floor vibration sensing has been used in many smart home applications, such as elderly/patient monitoring. These systems often leverage data-driven models to infer human information. Therefore, characterizing datasets is crucial for the generalization of this new modality. This dataset contains 144-minute floor vibration signals from two pedestrians in eight environments. We analyze the reusability of this dataset in three different research areas, including vibration-based information inference, knowledge transferring, and multimodal learning. We further characterize the dataset transferability on the occupant identification task, to provide quantitative insights for the transfer learning problems in the real-world floor vibration sensing applications. The characterization is conducted with three metrics, including distribution distance, information dependency, and influencing factor bias. Analysis results depict that the dataset covers different levels of transferability caused by multiple influencing factors. As a result, there are multiple future directions in which the dataset can be reused.

References

[1]
[n.d.]. Adafruit Feather M0 Bluefruit LE. https://www.adafruit.com/product/2995. Accessed: 2021-03-14.
[2]
[n.d.]. SparkFun SAMD21 Mini Breakout. https://www.sparkfun.com/products/13664. Accessed: 2021-03-14.
[3]
Analog Devices, Inc. 2010. Small, Low Power, 3-Axis ± 3 g Accelerometer. Analog Devices, Inc.
[4]
Sahil Anchal, Bodhibrata Mukhopadhyay, and Subrat Kar. 2020. Person Identification and Imposter Detection Using Footstep Generated Seismic Signals. IEEE Transactions on Instrumentation and Measurement 70 (2020), 1--11.
[5]
Roberto Battiti. 1994. Using mutual information for selecting features in supervised neural net learning. IEEE Transactions on neural networks 5, 4 (1994), 537--550.
[6]
Shai Ben-David, John Blitzer, Koby Crammer, Fernando Pereira, et al. 2007. Analysis of representations for domain adaptation. Advances in neural information processing systems 19 (2007), 137.
[7]
Chih-Chung Chang and Chih-Jen Lin. 2011. LIBSVM: a library for support vector machines. ACM transactions on intelligent systems and technology (TIST) 2, 3 (2011), 1--27.
[8]
Thomas M Cover. 1999. Elements of information theory. John Wiley & Sons.
[9]
Benjamin T Davis, Juan M Caicedo, and Victor A Hirth. 2021. Force estimation and event localization (FEEL) of impacts using structural vibrations. Journal of Engineering Mechanics 147, 3 (2021), 04020154.
[10]
Yiwen Dong, Joanna Jiaqi Zou, Jingxiao Liu, Jonathon Fagert, Mostafa Mirshekari, Linda Lowes, Megan Iammarino, Pei Zhang, and Hae Young Noh. 2020. MD-Vibe: physics-informed analysis of patient-induced structural vibration data for monitoring gait health in individuals with muscular dystrophy. In Adjunct Proceedings of the 2020 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2020 ACM International Symposium on Wearable Computers. 525--531.
[11]
Slah Drira, Sai GS Pai, Yves Reuland, Nils FH Olsen, and Ian FC Smith. 2021. Using footstep-induced vibrations for occupant detection and recognition in buildings. Advanced Engineering Informatics 49 (2021), 101289.
[12]
Slah Drira, Sai GS Pai, and Ian FC Smith. 2021. Uncertainties in structural behavior for model-based occupant localization using floor vibrations. Frontiers in Built Environment 7 (2021), 13.
[13]
Jonathon Fagert, Mostafa Mirshekari, Shijia Pan, Linda Lowes, Megan Iammarino, Pei Zhang, and Hae Young Noh. 2021. Structure-and Sampling-Adaptive Gait Balance Symmetry Estimation Using Footstep-Induced Structural Floor Vibrations. Journal of Engineering Mechanics 147, 2 (2021), 04020151.
[14]
The Raspberry Pi Foundation. [n.d.]. Raspberry Pi 4 Model B specifications. https://www.raspberrypi.org/products/raspberry-pi-4-model-b/
[15]
Yaroslav Ganin, Evgeniya Ustinova, Hana Ajakan, Pascal Germain, Hugo Larochelle, François Laviolette, Mario Marchand, and Victor Lempitsky. 2016. Domain-adversarial training of neural networks. The journal of machine learning research 17, 1 (2016), 2096--2030.
[16]
Xavier Glorot and Yoshua Bengio. 2010. Understanding the difficulty of training deep feedforward neural networks. In Proceedings of the thirteenth international conference on artificial intelligence and statistics. JMLR Workshop and Conference Proceedings, 249--256.
[17]
Xavier Glorot, Antoine Bordes, and Yoshua Bengio. 2011. Domain adaptation for large-scale sentiment classification: A deep learning approach. In Proceedings of the 28th International Conference on Machine Learning (ICML-11). 513--520.
[18]
Yujiao Hao, Rong Zheng, and Boyu Wang. 2021. Invariant Feature Learning for Sensor-based Human Activity Recognition. IEEE Transactions on Mobile Computing (2021).
[19]
Moritz Hardt, Eric Price, and Nati Srebro. 2016. Equality of opportunity in supervised learning. Advances in neural information processing systems 29 (2016), 3315--3323.
[20]
Jeffrey M Hausdorff, Helen K Edelberg, Susan L Mitchell, Ary L Goldberger, and Jeanne Y Wei. 1997. Increased gait unsteadiness in community-dwelling elderly fallers. Archives of physical medicine and rehabilitation 78, 3 (1997), 278--283.
[21]
Jeffrey M Hausdorff, Dean A Rios, and Helen K Edelberg. 2001. Gait variability and fall risk in community-living older adults: a 1-year prospective study. Archives of physical medicine and rehabilitation 82, 8 (2001), 1050--1056.
[22]
Zhizhang Hu, Tong Yu, Yue Zhang, and Shijia Pan. 2020. Fine-grained activities recognition with coarse-grained labeled multi-modal data. In Adjunct Proceedings of the 2020 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2020 ACM International Symposium on Wearable Computers. 644--649.
[23]
Zhizhang Hu, Yue Zhang, and Shijia Pan. 2021. Vibration-based Indoor Occupant Gait Monitoring with Robot Vacuum Cleaners. In Proceedings of the International Conference on Internet-of-Things Design and Implementation. 247--248.
[24]
Input/Output, Inc. 2006. SM-24 Geophone Element. Input/Output, Inc. Rev. 3.
[25]
Ellis Kessler, Vijaya VN Sriram Malladi, and Pablo A Tarazaga. 2019. Vibration-based gait analysis via instrumented buildings. International Journal of Distributed Sensor Networks 15, 10 (2019), 1550147719881608.
[26]
Ellis Kessler, Moeti Masiane, and Awad Abdelhalim. 2020. Privacy Concerns Regarding Occupant Tracking in Smart Buildings. arXiv preprint arXiv:2010.07028 (2020).
[27]
Daniel Kifer, Shai Ben-David, and Johannes Gehrke. 2004. Detecting change in data streams. In VLDB, Vol. 4. Toronto, Canada, 180--191.
[28]
Wouter M Kouw and Marco Loog. 2019. A review of domain adaptation without target labels. IEEE transactions on pattern analysis and machine intelligence 43, 3 (2019), 766--785.
[29]
Fangyu Li, Jose Clemente, Maria Valero, Zion Tse, Sheng Li, and WenZhan Song. 2019. Smart home monitoring system via footstep-induced vibrations. IEEE Systems Journal 14, 3 (2019), 3383--3389.
[30]
Mostafa Mirshekari, Jonathon Fagert, Shijia Pan, Pei Zhang, and Hae Young Noh. 2020. Step-level occupant detection across different structures through footstep-induced floor vibration using model transfer. Journal of Engineering Mechanics 146, 3 (2020), 04019137.
[31]
Mostafa Mirshekari, Shijia Pan, Jonathon Fagert, Eve M Schooler, Pei Zhang, and Hae Young Noh. 2018. Occupant localization using footstep-induced structural vibration. Mechanical Systems and Signal Processing 112 (2018), 77--97.
[32]
Yuichi Nakamura, Kazuki Ito, Tatsuo Hasegawa, Shin Itami, Yohei Saika, and Masahiro Nakagawa. 2016. Individual identification by gait vibration data transmitted floor. In 2016 16th International Conference on Control, Automation and Systems (ICCAS). IEEE, 1371--1376.
[33]
Hieu V Nguyen and Li Bai. 2010. Cosine similarity metric learning for face verification. In Asian conference on computer vision. Springer, 709--720.
[34]
Shijia Pan, Amelie Bonde, Jie Jing, Lin Zhang, Pei Zhang, and Hae Young Noh. 2014. Boes: building occupancy estimation system using sparse ambient vibration monitoring. In Sensors and smart structures technologies for civil, mechanical, and aerospace systems 2014, Vol. 9061. International Society for Optics and Photonics, 90611O.
[35]
Shijia Pan and Phuc Nguyen. 2020. Opportunities in the Cross-Scale Collaborative Human Sensing of 'Developing' Device-Free and Wearable Systems. In Proceedings of the 2nd ACM Workshop on Device-Free Human Sensing. 16--21.
[36]
Shijia Pan, Tong Yu, Mostafa Mirshekari, Jonathon Fagert, Amelie Bonde, Ole J Mengshoel, Hae Young Noh, and Pei Zhang. 2017. Footprintid: Indoor pedestrian identification through ambient structural vibration sensing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (2017), 1--31.
[37]
Brian C Ross. 2014. Mutual information between discrete and continuous data sets. PloS one 9, 2 (2014), e87357.
[38]
Texas Instruments Incorporated 2020. LMV3xx Low-Voltage Rail-to-Rail Output Operational Amplifier. Texas Instruments Incorporated.
[39]
Ronald A Thisted. 1998. What is a P-value. Departments of Statistics and Health Studies (1998).
[40]
Keisuke Umakoshi, Tomokazu Matsui, Makoto Yoshida, Hyuckjin Choi, Manato Fujimoto, Hirohiko Suwa, and Keiichi Yasumoto. 2021. Non-contact Person Identification by Piezoelectric-Based Gait Vibration Sensing. In International Conference on Advanced Information Networking and Applications. Springer, 745--757.
[41]
Markus Wulfmeier, Alex Bewley, and Ingmar Posner. 2017. Addressing appearance change in outdoor robotics with adversarial domain adaptation. In 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems, IROS 2017, Vancouver, BC, Canada, September 24--28, 2017. IEEE, 1551--1558. https://doi.org/10.1109/IROS.2017.8205961
[42]
Tong Yu, Yue Zhang, Zhizhang Hu, Susu Xu, and Shijia Pan. 2021. Vibration-Based Indoor Human Sensing Quality Reinforcement via Thompson Sampling. In Proceedings of the First International Workshop on Cyber-Physical-Human System Design and Implementation. 33--38.
[43]
Brian Hu Zhang, Blake Lemoine, and Margaret Mitchell. 2018. Mitigating unwanted biases with adversarial learning. In Proceedings of the 2018 AAAI/ACM Conference on AI, Ethics, and Society. 335--340.
[44]
Yue Zhang, Zhizhang Hu, and Shijia Pan. 2021. Footstep-Induced Floor Vibration Dataset In Different Deployment Environment. https://doi.org/10.5281/zenodo.5571057
[45]
Yue Zhang, Zhizhang Hu, Susu Xu, and Shijia Pan. 2021. AutoQual: task-oriented structural vibration sensing quality assessment leveraging co-located mobile sensing context. CCF Transactions on Pervasive Computing and Interaction (2021), 1--19.
[46]
Yue Zhang, Shijia Pan, Jonathon Fagert, Mostafa Mirshekari, Hae Young Noh, Pei Zhang, and Lin Zhang. 2018. Occupant activity level estimation using floor vibration. In Proceedings of the 2018 ACM International Joint Conference and 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers. 1355--1363.

Cited By

View all
  • (2023)A Multi-Sensor Stochastic Energy-Based Vibro-Localization Technique with Byzantine Sensor EliminationSensors10.3390/s2323930923:23(9309)Online publication date: 21-Nov-2023

Index Terms

  1. Footstep-Induced Floor Vibration Dataset: Reusability and Transferability Analysis

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SenSys '21: Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems
    November 2021
    686 pages
    ISBN:9781450390972
    DOI:10.1145/3485730
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 15 November 2021

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Floor vibration
    2. dataset reusability
    3. transferability

    Qualifiers

    • Short-paper
    • Research
    • Refereed limited

    Funding Sources

    Conference

    Acceptance Rates

    SenSys '21 Paper Acceptance Rate 25 of 139 submissions, 18%;
    Overall Acceptance Rate 174 of 867 submissions, 20%

    Upcoming Conference

    SenSys '24

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)132
    • Downloads (Last 6 weeks)19
    Reflects downloads up to 01 Sep 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2023)A Multi-Sensor Stochastic Energy-Based Vibro-Localization Technique with Byzantine Sensor EliminationSensors10.3390/s2323930923:23(9309)Online publication date: 21-Nov-2023

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Get Access

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media