Active Acoustic Sensing Based Authentication System Using a Door Handle
Pages 324 - 330
Abstract
This paper presents a system that authenticates users solely based on the action of grasping a door handle. The system authenticates users by utilizing the differences in frequency characteristics between a hand and a door handle when grasped. The frequency characteristics of a hand vary from person to person depending on anatomical differences such as skeletal structure and muscle composition. This system is beneficial because it is not vulnerable to shoulder surfing and allows authentication solely by grasping the door handle. Data were collected from 25 users, and the system achieved an F1 score of 93.0% in the 25-class classification. In the One-vs-Rest classification using unknown users as test data, the average equal error rate was 4.76%.
References
[1]
Yomna Abdelrahman, Mohamed Khamis, Stefan Schneegass, and Florian Alt. 2017. Stay Cool! Understanding Thermal Attacks on Mobile-based User Authentication. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI ’17). Association for Computing Machinery, New York, NY, USA, 3751–3763.
[2]
Anne Adams and Martina Angela Sasse. 1999. Users are not the enemy. Communication of the ACM 42, 12 (1999), 40–46.
[3]
Takashi Amesaka, Hiroki Watanabe, Masanori Sugimoto, and Buntarou Shizuki. 2022. Gesture Recognition Method Using Acoustic Sensing on Usual Garment. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 2, Article 41 (2022), 27 pages.
[4]
Takashi Amesaka, Hiroki Watanabe, Masanori Sugimoto, Yuta Sugiura, and Buntarou Shizuki. 2023. User Authentication Method for Hearables Using Sound Leakage Signals. In Proceedings of the 2023 ACM International Symposium on Wearable Computers(ISWC ’23). Association for Computing Machinery, 119–123.
[5]
Takayuki Arakawa, Takafumi Koshinaka, Shohei Yano, Hideki Irisawa, Ryoji Miyahara, and Hitoshi Imaoka. 2016. Fast and accurate personal authentication using ear acoustics. In 2016 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference (APSIPA). 1–4.
[6]
Kusanagi Daichi, Aoyama Shoichiro, Ito Koichi, and Aoki Takafumi. 2017. A practical person authentication system using second minor finger knuckles for door security. IPSJ Transactions on Computer Vision and Applications 9, 8 (03 2017).
[7]
Phillip L. De Leon, Michael Pucher, Junichi Yamagishi, Inma Hernaez, and Ibon Saratxaga. 2012. Evaluation of Speaker Verification Security and Detection of HMM-Based Synthetic Speech. IEEE Transactions on Audio, Speech, and Language Processing 20, 8 (2012), 2280–2290.
[8]
Kyosuke Futami, Akari Fukao, and Kazuya Murao. 2019. A method to recognize entering and leaving person based on door opening and closing movement using angular velocity sensor. In Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers. Association for Computing Machinery, 57–60.
[9]
Yang Gao, Yincheng Jin, Jagmohan Chauhan, Seokmin Choi, Jiyang Li, and Zhanpeng Jin. 2021. Voice In Ear: Spoofing-Resistant and Passphrase-Independent Body Sound Authentication. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 1, Article 12 (2021), 12:1–12:25 pages.
[10]
Yang Gao, Wei Wang, Vir V. Phoha, Wei Sun, and Zhanpeng Jin. 2019. EarEcho: Using Ear Canal Echo for Wearable Authentication. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 3, Article 81 (2019), 24 pages.
[11]
Sandeep Gupta, Attaullah Buriro, and Bruno Crispo. 2018. Demystifying Authentication Concepts in Smartphones: Ways and Types to Secure Access. Mobile Information Systems 2018, 1 (2018), 2649598:1–2649598:16.
[12]
Sandeep Gupta, Attaullah Buriro, and Bruno Crispo. 2019. SmartHandle: A Novel Behavioral Biometric-based Authentication Scheme for Smart Lock Systems. In Proceedings of the 2019 3rd International Conference on Biometric Engineering and Applications(ICBEA 2019). Association for Computing Machinery, 15–22.
[13]
Zhaoyang Han, Liang Liu, and Zhe Liu. 2019. An efficient access control scheme for smart lock based on asynchronous communication. In Proceedings of the ACM Turing Celebration Conference - China (Chengdu, China) (ACM TURC ’19). Association for Computing Machinery, Article 61, 5 pages.
[14]
Zhaoyang Han, Liang Liu, and Zhe Liu. 2019. An efficient access control scheme for smart lock based on asynchronous communication. In Proceedings of the ACM Turing Celebration Conference - China (Chengdu, China) (ACM TURC ’19). Article 61, 5 pages.
[15]
Georg Heigold, Ignacio Moreno, Samy Bengio, and Noam Shazeer. 2016. End-to-end text-dependent speaker verification. In 2016 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). IEEE Press, 5115–5119.
[16]
Atsutoshi Ikeda, Shinichi Kosugi, and Yasuhiro Tanaka. 2019. Propagating Vibration Analysis of Leg towards Ankle Joint Angle Estimation. In Proceedings of the 24th International Conference on Intelligent User Interfaces: Companion (Marina del Ray, California) (IUI ’19). Association for Computing Machinery, New York, NY, USA, 11–12.
[17]
Irwansyah, Sho Otsuka, and Seiji Nakagawa. 2022. Evaluation of Bone-Conducted Cross-Talk Sound in the Head for Biometric Identification. In Proceedings of the 2021 International Conference on Computer, Control, Informatics and Its Applications(IC3INA ’21). Association for Computing Machinery, 76–80.
[18]
Kaito Isobe and Kazuya Murao. 2021. Person-identification Method using Active Acoustic Sensing Applied to Nose. In Proceedings of the 2021 ACM International Symposium on Wearable Computers(ISWC ’21). Association for Computing Machinery, 138–140.
[19]
Kaito Isobe and Kazuya Murao. 2023. Personal Identification Method using Active Acoustic Sensing applied to the Nose pad of Eyeglasses. In Adjunct Proceedings of the 2022 ACM International Joint Conference on Pervasive and Ubiquitous Computing and the 2022 ACM International Symposium on Wearable Computers(UbiComp/ISWC ’22 Adjunct). Association for Computing Machinery, 345–348.
[20]
Shunsuke Iwakiri and Kazuya Murao. 2023. User Authentication Method for Wearable Ring Devices using Active Acoustic Sensing. In Proceedings of the 2023 ACM International Symposium on Wearable Computers(ISWC ’23). Association for Computing Machinery, 17–21.
[21]
R G Maduranga M Jayamaha, Maduri R R Senadheera, T Nuwan C Gamage, K D Pavithra B Weerasekara, Gayan A Dissanayaka, and G. Nuwan Kodagoda. 2008. VoizLock - Human Voice Authentication System using Hidden Markov Model. In 2008 4th International Conference on Information and Automation for Sustainability. 330–335.
[22]
Hiroyuki Kato and Kentaro Takemura. 2016. Hand Pose Estimation Based on Active Bone-Conducted Sound Sensing. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct (Heidelberg, Germany) (UbiComp ’16). Association for Computing Machinery, New York, NY, USA, 109–112.
[23]
Jiwan Kim and Ian Oakley. 2022. SonarID: Using Sonar to Identify Fingers on a Smartwatch. In Proceedings of the 2022 CHI Conference on Human Factors in Computing Systems(CHI ’22). Association for Computing Machinery, Article 287, 287:1–287:10 pages.
[24]
Yuki Kubo, Kana Eguchi, and Ryosuke Aoki. 2020. 3D-Printed Object Identification Method using Inner Structure Patterns Configured by Slicer Software. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems(CHI EA ’20). Association for Computing Machinery, 1–7.
[25]
Yuki Kubo, Kana Eguchi, Ryosuke Aoki, Shigekuni Kondo, Shozo Azuma, and Takuya Indo. 2019. FabAuth: Printed Objects Identification Using Resonant Properties of Their Inner Structures. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems(CHI EA ’19). Association for Computing Machinery, 1–6.
[26]
Yuki Kubo, Yuto Koguchi, Buntarou Shizuki, Shin Takahashi, and Otmar Hilliges. 2019. AudioTouch: Minimally Invasive Sensing of Micro-Gestures via Active Bio-Acoustic Sensing. In Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services(MobileHCI ’19). Association for Computing Machinery, Article 36, 36:1–36:13 pages.
[27]
Chi-Jung Lee, Ruidong Zhang, Devansh Agarwal, Tianhong Catherine Yu, Vipin Gunda, Oliver Lopez, James Kim, Sicheng Yin, Boao Dong, Ke Li, Mose Sakashita, Francois Guimbretiere, and Cheng Zhang. 2024. EchoWrist: Continuous Hand Pose Tracking and Hand-Object Interaction Recognition Using Low-Power Active Acoustic Sensing On a Wristband. In Proceedings of the CHI Conference on Human Factors in Computing Systems(CHI ’24). Association for Computing Machinery, New York, NY, USA, Article 403, 403:1–403:21 pages.
[28]
Ke Li, Ruidong Zhang, Bo Liang, François Guimbretière, and Cheng Zhang. 2022. EarIO: A Low-power Acoustic Sensing Earable for Continuously Tracking Detailed Facial Movements. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 2, Article 62 (2022), 62:1–62:24 pages.
[29]
Rui Liu, Cory Cornelius, Reza Rawassizadeh, Ronald Peterson, and David Kotz. 2018. Vocal Resonance: Using Internal Body Voice for Wearable Authentication. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 2, 1, Article 19 (2018), 23 pages.
[30]
Li Lu, Jiadi Yu, Yingying Chen, Hongbo Liu, Yanmin Zhu, Yunfei Liu, and Minglu Li. 2018. LipPass: Lip Reading-based User Authentication on Smartphones Leveraging Acoustic Signals. In IEEE INFOCOM 2018 - IEEE Conference on Computer Communications. 1466–1474.
[31]
Shivangi Mahto, Takayuki Arakawa, and Takafumi Koshinak. 2018. Ear Acoustic Biometrics Using Inaudible Signals and Its Application to Continuous User Authentication. In 2018 26th European Signal Processing Conference (EUSIPCO). 1407–1411.
[32]
Delina Beh Mei Yin, Mohamad Izzuddin Kamal, Nurul Sharaz Azmanuddin, Siti Haryani Shaikh Ali, Abu Talib Othman, and Rita Zaharah Wan Chik. 2016. Electronic Door Access Control using MyAccess Two-Factor Authentication Scheme featuring Near-Field Communication and Eigenface-based Face Recognition using Principal Component Analysis(IMCOM ’16). Association for Computing Machinery, New York, NY, USA, Article 1, 8 pages.
[33]
Adiyan Mujibiya, Xiang Cao, Desney S. Tan, Dan Morris, Shwetak N. Patel, and Jun Rekimoto. 2013. The Sound of Touch: On-Body Touch and Gesture Sensing Based on Transdermal Ultrasound Propagation. In Proceedings of the 2013 ACM International Conference on Interactive Tabletops and Surfaces (St. Andrews, Scotland, United Kingdom) (ITS ’13). Association for Computing Machinery, New York, NY, USA, 189–198.
[34]
Arinobu Niijima and Yuki Kubo. 2023. Assisting with Fingertip Force Control by Active Bio-Acoustic Sensing and Electrical Muscle Stimulation. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems(CHI ’23). Association for Computing Machinery, Article 743, 743:1–74313 pages.
[35]
L. O’Gorman. 2003. Comparing passwords, tokens, and biometrics for user authentication. Proc. IEEE 91, 12 (2003), 2021–2040.
[36]
Yuya Okawa and Kentaro Takemura. 2015. Haptic-Enabled Active Bone-Conducted Sound Sensing. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (Daegu, Kyungpook, Republic of Korea) (UIST ’15 Adjunct). Association for Computing Machinery, New York, NY, USA, 87–88.
[37]
Makoto Ono, Buntarou Shizuki, and Jiro Tanaka. 2013. Touch & activate: adding interactivity to existing objects using active acoustic sensing. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology(UIST ’13). Association for Computing Machinery, New York, NY, USA, 31–40.
[38]
Makoto Ono, Buntarou Shizuki, and Jiro Tanaka. 2015. Sensing Touch Force using Active Acoustic Sensing. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction (Stanford, California, USA) (TEI ’15). Association for Computing Machinery, 355–358.
[39]
N.K. Ratha, R.M. Bolle, V.D. Pandit, and V. Vaish. 2000. Robust fingerprint authentication using local structural similarity. In Proceedings Fifth IEEE Workshop on Applications of Computer Vision. 29–34.
[40]
Sarah Delgado Rodriguez, Lukas Mecke, and Florian Alt. 2022. SenseHandle: Investigating Human-Door Interaction Behaviour for Authentication in the Physical World. In USENIX Symposium on Usable Privacy and Security (SOUPS). 7–9.
[41]
Shogo Sekiguchi, Shingo Kato, Yoshiki Nishikawa, and Buntarou Shizuki. 2024. Authentication Method Using Opening Gestures. In HCI for Cybersecurity, Privacy and Trust. Springer Nature Switzerland, 186–203.
[42]
Hyejin Shin, Jun Ho Huh, Bum Jun Kwon, Iljoo Kim, Eunyong Cheon, HongMin Kim, Choong-Hoon Lee, and Ian Oakley. 2024. SkullID: Through-Skull Sound Conduction based Authentication for Smartglasses. In Proceedings of the CHI Conference on Human Factors in Computing Systems(CHI ’24). Association for Computing Machinery, Article 834, 824:1–834:19 pages.
[43]
Kamath K.M Shreyas, Srijith Rajeev, Karen Panetta, and Sos S Agaian. 2017. Fingerprint authentication using geometric features. In 2017 IEEE International Symposium on Technologies for Homeland Security (HST). 1–7.
[44]
Kentaro Takemura, Akihiro Ito, Jun Takamatsu, and Tsukasa Ogasawara. 2011. Active Bone-Conducted Sound Sensing for Wearable Interfaces. In Proceedings of the 24th Annual ACM Symposium Adjunct on User Interface Software and Technology (Santa Barbara, California, USA) (UIST ’11 Adjunct). Association for Computing Machinery, New York, NY, USA, 53–54.
[45]
Shejin Thavalengal, Petronel Bigioi, and Peter Corcoran. 2015. Iris authentication in handheld devices - considerations for constraint-free acquisition. IEEE Trans. on Consum. Electron. 61, 2 (may 2015), 245–253.
[46]
Christian Tietz, Eric Klieme, Rachel Brabender, Teresa Lasarow, Lukas Rambold, and Christoph Meinel. 2020. Under Pressure: Pushing Down on Me - Touch Sensitive Door Handle to Identify Users at Room Entry. In Proceedings of the 17th International Joint Conference on e-Business and Telecommunications - Volume 3: SECRYPT,. INSTICC, SciTePress, 565–571.
[47]
Jesús Vegas, César Llamas, Manuel A. González, and Carmen Hernández. 2021. Identifying users from the interaction with a door handle. Pervasive and Mobile Computing 70 (2021), 101293.
[48]
Mei Wang and Weihong Deng. 2021. Deep face recognition: A survey. Neurocomputing 429 (2021), 215–244.
[49]
Zi Wang, Sheng Tan, Linghan Zhang, Yili Ren, Zhi Wang, and Jie Yang. 2021. EarDynamic: An Ear Canal Deformation Based Continuous User Authentication Using In-Ear Wearables. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 1, Article 39 (2021), 39:1–39:27 pages.
[50]
Hiroki Watanabe, Hiroaki Kakizawa, and Masanori Sugimoto. 2021. User Authentication Method Using Active Acoustic Sensing. Journal of Information Processing 29 (2021), 370–379.
[51]
Hiroki Watanabe, Tsutomu Terada, and Masahiko Tsukamoto. 2017. Gesture Recognition Method Utilizing Ultrasonic Active Acoustic Sensing. Journal of Information Processing 25 (2017), 331–340.
[52]
Yadong Xie, Fan Li, Yue Wu, Huijie Chen, Zhiyuan Zhao, and Yu Wang. 2022. TeethPass: Dental Occlusion-based User Authentication via In-ear Acoustic Sensing. In IEEE INFOCOM 2022 - IEEE Conference on Computer Communications. 1789–1798.
[53]
Tomohiro Yokota and Tomoko Hashida. 2016. Hand Gesture and On-Body Touch Recognition by Active Acoustic Sensing throughout the Human Body. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST ’16 Adjunct). Association for Computing Machinery, New York, NY, USA, 113–115.
[54]
Jiadi Yu, Li Lu, Yingying Chen, Yanmin Zhu, and Linghe Kong. 2021. An Indirect Eavesdropping Attack of Keystrokes on Touch Screen through Acoustic Sensing. IEEE Transactions on Mobile Computing 20, 2 (2021), 337–351.
[55]
Cheng Zhang, Qiuyue Xue, Anandghan Waghmare, Ruichen Meng, Sumeet Jain, Yizeng Han, Xinyu Li, Kenneth Cunefare, Thomas Ploetz, Thad Starner, Omer Inan, and Gregory D. Abowd. 2018. FingerPing: Recognizing Fine-Grained Hand Poses Using Active Acoustic On-Body Sensing. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (Montreal QC, Canada) (CHI ’18). Association for Computing Machinery, New York, NY, USA, 437:1–437:10.
[56]
Ruidong Zhang, Ke Li, Yihong Hao, Yufan Wang, Zhengnan Lai, François Guimbretière, and Cheng Zhang. 2023. EchoSpeech: Continuous Silent Speech Recognition on Minimally-obtrusive Eyewear Powered by Acoustic Sensing. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems(CHI ’23). Association for Computing Machinery, Article 852, 852:1–852:18 pages.
Index Terms
- Active Acoustic Sensing Based Authentication System Using a Door Handle
Recommendations
Typing Patterns: A Key to User Identification
The deficiencies of traditional password-based access systems have become more acute as these systems have grown in size and scope. Researchers are actively investigating ways to improve the security of password systems or offer replacements. One ...
Using Pupil Light Reflex for Fast Biometric Authentication
ACM TURC '20: Proceedings of the ACM Turing Celebration Conference - ChinaThe prevalence of using biometric for user authentication has attracted much attention. On the other hand, mobile devices such as smart glasses and VR headsets have gained great popularity among recent years. It is desirable to integrate authentication ...
A privacy-preserving cancelable iris template generation scheme using decimal encoding and look-up table mapping
Biometric-based recognition systems have overcome passive issues of traditional human authentication systems. However, security theft and privacy invasion are two passive issues that still persist in the effective deployment of biometric-based ...
Comments
Information & Contributors
Information
Published In
December 2024
568 pages
Copyright © 2024 Copyright held by the owner/author(s). Publication rights licensed to ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 02 December 2024
Check for updates
Author Tags
Qualifiers
- Research-article
Conference
MUM '24
MUM '24: International Conference on Mobile and Ubiquitous Multimedia
December 1 - 4, 2024
Stockholm, Sweden
Acceptance Rates
Overall Acceptance Rate 190 of 465 submissions, 41%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 34Total Downloads
- Downloads (Last 12 months)34
- Downloads (Last 6 weeks)34
Reflects downloads up to 23 Dec 2024
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderFull Text
View this article in Full Text.
Full TextHTML Format
View this article in HTML Format.
HTML Format