research-article

mmHSV: In-Air Handwritten Signature Verification via Millimeter-Wave Radar

Authors:

Lin WangAuthors Info & Claims

ACM Transactions on Internet of Things, Volume 4, Issue 4

Article No.: 27, Pages 1 - 22

https://doi.org/10.1145/3614443

Published: 22 November 2023 Publication History

Abstract

Electronic signatures are widely used in financial business, telecommuting, and identity authentication. Offline electronic signatures are vulnerable to copy or replay attacks. Contact-based online electronic signatures are limited by indirect contact such as handwriting pads and may threaten the health of users. Consider combining hand shape features and writing process features to form electronic signatures, the article proposes an in-air handwritten signature verification system with millimeter-wave(mmWave) radar, namely mmHSV. First, the biometrics of the handwritten signature process are modeled, and phase-dependent biometrics and behavioral features are extracted from the mmWave radar mixture signal. Secondly, a handwritten feature recognition network based on few-sample learning is presented to fuse multi-dimensional features and determine user legitimacy. Finally, mmHSV is implemented and evaluated with commercial mmWave devices in different scenarios and attack mode conditions. Experimental results show that the mmHSV can achieve accurate, efficient, robust and scalable handwritten signature verification. Area Under Curve (AUC) is 98.96%, False Acceptance Rate (FAR) is 5.1% at the fixed threshold, AUC is 97.79% for untrained users.

References

[1]

Debnath Bhattacharyya, Rahul Ranjan, Farkhod Alisherov, Minkyu Choi, et al. 2009. Biometric authentication: A review. International Journal of u-and e-Service, Science and Technology 2, 3 (2009), 13–28.

[2]

Mengqi Chen, Jiawei Lin, Yongpan Zou, Rukhsana Ruby, and Kaishun Wu. 2020. Silentsign: Device-free handwritten signature verification through acoustic sensing. In Proceedings of the 2020 IEEE International Conference on Pervasive Computing and Communications (PerCom’20). IEEE, 1–10.

[3]

Robert B. Cleveland, William S. Cleveland, Jean E. McRae, and Irma Terpenning. 1990. STL: A seasonal-trend decomposition. Journal of Official Statistics 6, 1 (1990), 3–73.

[4]

Feng Ding, Dong Wang, Qian Zhang, and Run Zhao. 2019. ASSV: Handwritten signature verification using acoustic signals. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 3 (2019), 1–22.

Digital Library

[5]

Yuxun Fang, Wenxiong Kang, Qiuxia Wu, and Lei Tang. 2017. A novel video-based system for in-air signature verification. Computers & Electrical Engineering 57 (2017), 1–14.

Digital Library

[6]

Isaac Griswold-Steiner, Richard Matovu, and Abdul Serwadda. 2019. Wearables-driven freeform handwriting authentication. IEEE Transactions on Biometrics, Behavior, and Identity Science 1, 3 (2019), 152–164.

[7]

Junfeng Guan, Sohrab Madani, Suraj Jog, Saurabh Gupta, and Haitham Hassanieh. 2020. Through fog high-resolution imaging using millimeter wave radar. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 11464–11473.

[8]

Qing Guo, Wei Feng, Ce Zhou, Rui Huang, Liang Wan, and Song Wang. 2017. Learning dynamic siamese network for visual object tracking. In Proceedings of the IEEE International Conference on Computer Vision. 1763–1771.

[9]

Raia Hadsell, Sumit Chopra, and Yann LeCun. 2006. Dimensionality reduction by learning an invariant mapping. In Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR’06), Vol. 2. IEEE, 1735–1742.

Digital Library

[10]

Assia Hamadene and Youcef Chibani. 2016. One-class writer-independent offline signature verification using feature dissimilarity thresholding. IEEE Transactions on Information Forensics and Security 11, 6 (2016), 1226–1238.

Digital Library

[11]

Eamonn Keogh and Chotirat Ann Ratanamahatana. 2005. Exact indexing of dynamic time warping. Knowledge and Information Systems 7, 3 (2005), 358–386.

[12]

Hao Kong, Li Lu, Jiadi Yu, Yingying Chen, Linghe Kong, and Minglu Li. 2019. Fingerpass: Finger gesture-based continuous user authentication for smart homes using commodity wifi. In Proceedings of the 20th ACM International Symposium on Mobile Ad Hoc Networking and Computing. 201–210.

Digital Library

[13]

Songxuan Lai and Lianwen Jin. 2018. Recurrent adaptation networks for online signature verification. IEEE Transactions on Information Forensics and Security 14, 6 (2018), 1624–1637.

Digital Library

[14]

Gen Li and Hiroyuki Sato. 2020. Handwritten signature authentication using smartwatch motion sensors. In Proceedings of the 2020 IEEE 44th Annual Computers, Software, and Applications Conference (COMPSAC’20). IEEE, 1589–1596.

[15]

Huining Li, Chenhan Xu, Aditya Singh Rathore, Zhengxiong Li, Hanbin Zhang, Chen Song, Kun Wang, Lu Su, Feng Lin, Kui Ren, and Wenyao Xu. 2020. VocalPrint: Exploring a resilient and secure voice authentication via mmWave biometric interrogation. In Proceedings of the 18th Conference on Embedded Networked Sensor Systems. 312–325.

Digital Library

[16]

Haipeng Liu, Kening Cui, Kaiyuan Hu, Yuheng Wang, Anfu Zhou, Liang Liu, and Huadong Ma. 2022. mTransSee: Enabling environment-independent mmWave sensing based gesture recognition via transfer learning. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 1 (2022), 1–28.

Digital Library

[17]

Tiantian Liu, Ming Gao, Feng Lin, Chao Wang, Zhongjie Ba, Jinsong Han, Wenyao Xu, and Kui Ren. 2021. Wavoice: A noise-resistant multi-modal speech recognition system fusing mmWave and audio signals. In Proceedings of the 19th ACM Conference on Embedded Networked Sensor Systems. 97–110.

Digital Library

[18]

Beth Logan. 2000. Mel frequency cepstral coefficients for music modeling. In Proceedings of the International Symposium on Music Information Retrieval. Citeseer.

[19]

Koki Nagai and Minseok Kim. 2020. Contactless simultaneous measurement method for breathing and heartbeat rates using millimeter-waves. In Proceedings of the 2020 14th International Symposium on Medical Information Communication Technology (ISMICT’20). IEEE, 1–4.

[20]

Sai Deepika Regani, Chenshu Wu, Beibei Wang, Min Wu, and KJ Ray Liu. 2021. mmWrite: Passive handwriting tracking using a single millimeter-wave radio. IEEE Internet of Things Journal 8, 17 (2021), 13291–13305.

[21]

Hem Regmi, Moh Sabbir Saadat, Sanjib Sur, and Srihari Nelakuditi. 2021. SquiggleMilli: Approximating SAR imaging on mobile millimeter-wave devices. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 3 (2021), 1–26.

Digital Library

[22]

Enrique Argones Rúa and José Luis Alba Castro. 2012. Online signature verification based on generative models. IEEE Transactions on Systems, Man, and Cybernetics, Part B (Cybernetics) 42, 4 (2012), 1231–1242.

Digital Library

[23]

Stan Salvador and Philip Chan. 2007. Toward accurate dynamic time warping in linear time and space. Intelligent Data Analysis 11, 5 (2007), 561–580.

Digital Library

[24]

Panneer Selvam Santhalingam, Al Amin Hosain, Ding Zhang, Parth Pathak, Huzefa Rangwala, and Raja Kushalnagar. 2020. mmASL: Environment-independent asl gesture recognition using 60 ghz millimeter-wave signals. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 4, 1 (2020), 1–30.

Digital Library

[25]

Moe Sasaki and Masaki Inamura. 2016. Evaluation of handwriting characteristic for two-factor authentication interface on touch-pad panel. In Proceedings of the ICE-B. 106–111.

Digital Library

[26]

Xiaoyu Song, Xinghua Xia, and Fangjun Luan. 2016. Online signature verification based on stable features extracted dynamically. IEEE Transactions on Systems, Man, and Cybernetics: Systems 47, 10 (2016), 2663–2676.

[27]

Fengyu Wang, Xiaolu Zeng, Chenshu Wu, Beibei Wang, and K. J. Ray Liu. 2021. mmHRV: Contactless heart rate variability monitoring using millimeter-wave radio. IEEE Internet of Things Journal 8, 22 (2021), 16623–16636.

[28]

Zhixiang Wei, Song Yang, Yadong Xie, Fan Li, and Bo Zhao. 2021. SVSV: Online handwritten signature verification based on sound and vibration. Information Sciences 572 (2021), 109–125.

Digital Library

[29]

Chenshu Wu, Feng Zhang, Beibei Wang, and K. J. Ray Liu. 2020. mmTrack: Passive multi-person localization using commodity millimeter wave radio. In Proceedings of the IEEE INFOCOM 2020-IEEE Conference on Computer Communications. IEEE, 2400–2409.

Digital Library

[30]

Chenhan Xu, Huining Li, Zhengxiong Li, Hanbin Zhang, Aditya Singh Rathore, Xingyu Chen, Kun Wang, Ming-chun Huang, and Wenyao Xu. 2021. CardiacWave: A mmWave-based scheme of non-contact and high-definition heart activity computing. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 5, 3 (2021), 1–26.

Digital Library

[31]

Wenyuan Xu, Jing Tian, Yu Cao, and Song Wang. 2017. Challenge-response authentication using in-air handwriting style verification. IEEE Transactions on Dependable and Secure Computing 17, 1 (2017), 51–64.

Digital Library

[32]

Xin Yang, Jian Liu, Yingying Chen, Xiaonan Guo, and Yucheng Xie. 2020. MU-ID: Multi-user identification through gaits using millimeter wave radios. In Proceedings of the IEEE INFOCOM 2020-IEEE Conference on Computer Communications. IEEE, 2589–2598.

Digital Library

[33]

Shichao Yue, Hao He, Peng Cao, Kaiwen Zha, Masayuki Koizumi, and Dina Katabi. 2022. CornerRadar: RF-based indoor localization around corners. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 6, 1 (2022), 1–24.

Digital Library

[34]

Zhenyuan Zhang, Zengshan Tian, and Mu Zhou. 2018. Latern: Dynamic continuous hand gesture recognition using FMCW radar sensor. IEEE Sensors Journal 18, 8 (2018), 3278–3289.

[35]

Run Zhao, Dong Wang, Qian Zhang, Xueyi Jin, and Ke Liu. 2021. Smartphone-based handwritten signature verification using acoustic signals. Proceedings of the ACM on Human–Computer Interaction 5, ISS (2021), 1–26.

Digital Library

Cited By

Jiang SFu RBurgholzer LWille RHo THuang T(2024)FlatDD: A High-Performance Quantum Circuit Simulator using Decision Diagram and Flat ArrayProceedings of the 53rd International Conference on Parallel Processing10.1145/3673038.3673073(388-399)Online publication date: 12-Aug-2024
https://dl.acm.org/doi/10.1145/3673038.3673073
Yan FVenegas-Andraca S(2024)Lessons from Twenty Years of Quantum Image ProcessingACM Transactions on Quantum Computing10.1145/3663577Online publication date: 2-May-2024
https://dl.acm.org/doi/10.1145/3663577
De Maio VBrandic I(2023)Accelerating Scientific Applications with the Quantum Edge: A Drug Design Use CaseHigh Performance Computing10.1007/978-3-031-40843-4_11(134-143)Online publication date: 21-May-2023
https://dl.acm.org/doi/10.1007/978-3-031-40843-4_11

Index Terms

mmHSV: In-Air Handwritten Signature Verification via Millimeter-Wave Radar
1. Human-centered computing
  1. Ubiquitous and mobile computing

Recommendations

Hindi Off-Line Signature Verification
ICFHR '12: Proceedings of the 2012 International Conference on Frontiers in Handwriting Recognition

Handwritten Signatures are one of the widely used biometrics for document authentication as well as human authorization. The purpose of this paper is to present an off-line signature verification system involving Hindi signatures. Signature verification ...
Online handwritten signature verification using feature weighting algorithm relief

Online handwritten signatures are widely used as a reliable identity authentication technology in industries such as banking, insurance and hospitals. Most existing online handwritten signature verification schemes usually choose the same feature sets ...
Detection of alcohol intoxication via online handwritten signature verification

The Internet has recently facilitated various methods of personal authentication based on biometrics. Personal authentication techniques based on human physical features include fingerprint matching, vein matching, facial recognition, speech recognition,...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Internet of Things

ACM Transactions on Internet of Things Volume 4, Issue 4

Special Issue on Wireless Sensing for IoT: Part 1

November 2023

194 pages

EISSN:2577-6207

DOI:10.1145/3633336

Editor:
Gian Pietro Picco
University of Trento, Italy

Issue’s Table of Contents

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Journal Family

ACM Journals for the Design of Smart and Connected Systems

Publication History

Published: 22 November 2023

Online AM: 12 August 2023

Accepted: 25 July 2023

Revised: 26 March 2023

Received: 31 October 2022

Published in TIOT Volume 4, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
382
Total Downloads

Downloads (Last 12 months)295
Downloads (Last 6 weeks)27

Reflects downloads up to 15 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Jiang SFu RBurgholzer LWille RHo THuang T(2024)FlatDD: A High-Performance Quantum Circuit Simulator using Decision Diagram and Flat ArrayProceedings of the 53rd International Conference on Parallel Processing10.1145/3673038.3673073(388-399)Online publication date: 12-Aug-2024
https://dl.acm.org/doi/10.1145/3673038.3673073
Yan FVenegas-Andraca S(2024)Lessons from Twenty Years of Quantum Image ProcessingACM Transactions on Quantum Computing10.1145/3663577Online publication date: 2-May-2024
https://dl.acm.org/doi/10.1145/3663577
De Maio VBrandic I(2023)Accelerating Scientific Applications with the Quantum Edge: A Drug Design Use CaseHigh Performance Computing10.1007/978-3-031-40843-4_11(134-143)Online publication date: 21-May-2023
https://dl.acm.org/doi/10.1007/978-3-031-40843-4_11

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Full Text

View this article in Full Text.

Media

Figures

Other

Tables

View full text|Download PDF

View Issue’s Table of Contents