research-article

Hand Gesture Recognition Using IR-UWB Radar with ShuffleNet V2

Authors:

Mingming ZhuAuthors Info & Claims

CCEAI '21: Proceedings of the 5th International Conference on Control Engineering and Artificial Intelligence

Pages 126 - 131

https://doi.org/10.1145/3448218.3448233

Published: 15 February 2021 Publication History

Abstract

In recent years, gesture recognition has developed rapidly in non-contact Human-Computer Interaction(HCI).This paper presents an efficient hand gesture recognition system for HCI based on Impulse-Radio Ultra-Wideband (IR-UWB) radar using ShuffleNet V2, which performed well on accuracy, speed and robustness. We convert time-domain radar signals to continuous Range-Doppler Map(RDM) by algorithm1. RDM images are easier to understand than waveform diagrams for Convolutional Neural Networks(CN-N). ShuffleNet V2 is a masterpiece of lightweight CNN and is used to analyze the patterns of different gesture RDM images to classify gestures in this paper. In order to ensure the robustness of the algorithm, we invited 7 participants to construct the gesture data set. The proposed hand gesture recognition system can classify 7 gestures with a promising accuracy of 98.52%.

References

[1]

Wenkui X. Intelligent Control System of Picking Robot Based on Visual Gesture Recognition[J]. Journal of Agricultural Mechanization Research, 2020.

[2]

Ghofrani A, Toroghi R M, Ghanbari S. Realtime Face-Detection and Emotion Recognition Using MTCNN and miniShuffleNet V2[C]// IEEE Conference on Knowledge Based Engineering and Innovation. Faculty of Media Technology and Engineering, Iran Broadcasting University (IRIBU), Tehran, Iran;Faculty of Media Technology and Engineering, Iran Broadcasting University (IRIBU), Tehran, Iran;Faculty of Media Technology and Engineering, Iran Broadcasting U, 2019.

[3]

Elboushaki A, Hannane R, Afdel K, et al. MultiD-CNN: A multi-dimensional feature learning approach based on deep convolutional networks for gesture recognition in RGB-D image sequences[J]. Expert Systems with Application, 2020, 139(Jan.):112829.1-112829.25.

Digital Library

[4]

A A B, B M Y, B M M, et al. High Accurate Lightweight Deep Learning Method for Gesture Recognition Based on Surface Electromyography[J]. Computer Methods and Programs in Biomedicine, 2020.

[5]

Bedico S R, Lope E M L, Lope E J L, et al. Gesture Recognition of Basketball Referee Violation Signal by Applying Dynamic Time Warping Algorithm Using a Wearable Device[C]// 2020 Fourth International Conference on Computing Methodologies and Communication (ICCMC). 2020.

[6]

Lien J, Gillian N, Karagozler M E, et al. Soli: Ubiquitous Gesture Sensing with Millimeter Wave Radar[J]. ACM Transactions on Graphics, 2016, 35(4):1--19.

Digital Library

[7]

Kim S Y, Han H G, Kim J W, et al. A Hand Gesture Recognition Sensor Using Reflected Impulses[J]. IEEE Sensors Journal, 2017, 17(10):2975--2976.

[8]

Park J, Jang J, Lee G, et al. A Time Domain Artificial Intelligence Radar System Using 33-GHz Direct Sampling for Hand Gesture Recognition[J]. IEEE Journal of Solid-State Circuits, 2020, 55(4):879--888.

[9]

Choi J W, Ryu S J, Kim J H. Short-Range Radar based Real-Time Hand Gesture Recognition Using LSTM Encoder[J]. IEEE Access, 2019, PP(99):1--1.

[10]

Ningning Ma, Xiangyu Zhang, Hai-Tao Zheng, et al. ShuffleNet V2:Practical Guidelines for Efficient CNN Architecture Design[A].Proceedings of the European Conference on Computer Vision[C], 2018

[11]

Takuya S, Xiaomeng G, Ehsan Y, et al. Hand Gesture Recognition Using a Radar Echo I-Q Plot and Convolutional Neural Network[J]. IEEE Sensors Letters, 2018, 2(3):1--4.

[12]

Klauder, J. R. The Design of Radar Signals Having Both High Range Resolution and High Velocity Resolution[J]. Bell Labs Technical Journal, 2013, 39(4):809--820.

[13]

Cevher V, Sankaranarayanan A, Duarte M F, et al. Compressive Sensing for Background Subtraction[M]// Computer Vision - ECCV 2008. Springer Berlin Heidelberg, 2008.

[14]

Molchanov P, Gupta S, Kim K, et al. Short-range FMCW monopulse radar for hand-gesture sensing[J]. IEEE National Radar Conference - Proceedings, 2015, 2015:1491--1496.

[15]

Hazra, Souvik & Santra, Avik. (2018). Robust Gesture Recognition Using Millimetric-Wave Radar System. IEEE Sensors Letters. PP. 1--1. 10.1109/LSENS.2018.2882642.

[16]

Donahue J, Hendricks L A, Rohrbach M, et al. Long-term Recurrent Convolutional Networks for Visual Recognition and Description[J]. IEEE Transactions on Pattern Analysis & Machine Intelligence, 2017, 39(4):677--691.

Digital Library

[17]

Zhang, X., Zhou, X., Lin, M., Sun, J.: Shufflenet: An extremely efficient convolutional neural network for mobile devices. arXiv preprint arXiv:1707.01083 (2017)

Cited By

Qiao LWang ZShu YXiao BLuan XShi YLi WGao X(2024)Simple and Efficient Gesture Recognition Based on Frequency-Modulated Continuous Wave RadarIEEE Transactions on Instrumentation and Measurement10.1109/TIM.2024.339682873(1-11)Online publication date: 2024
https://doi.org/10.1109/TIM.2024.3396828
Li XChen SZhang SZhu YXiao ZWang X(2024)Advancing IR-UWB Radar Human Activity Recognition With Swin Transformers and Supervised Contrastive LearningIEEE Internet of Things Journal10.1109/JIOT.2023.333099611:7(11750-11766)Online publication date: 1-Apr-2024
https://doi.org/10.1109/JIOT.2023.3330996
Li XChen SZhang SHou LZhu YXiao Z(2023)Human Activity Recognition Using IR-UWB Radar: A Lightweight Transformer ApproachIEEE Geoscience and Remote Sensing Letters10.1109/LGRS.2023.331462820(1-5)Online publication date: 2023
https://doi.org/10.1109/LGRS.2023.3314628
Show More Cited By

Index Terms

Hand Gesture Recognition Using IR-UWB Radar with ShuffleNet V2
1. Computing methodologies

Recommendations

Multi-scenario gesture recognition using Kinect
CGAMES '12: Proceedings of the 2012 17th International Conference on Computer Games: AI, Animation, Mobile, Interactive Multimedia, Educational & Serious Games (CGAMES)

Hand gesture recognition (HGR) is an important research topic because some situations require silent communication with sign languages. Computational HGR systems assist silent communication, and help people learn a sign language. In this article, a ...
Finger identification and hand gesture recognition techniques for natural user interface
APCHI '13: Proceedings of the 11th Asia Pacific Conference on Computer Human Interaction

The natural user interface using hand gesture have been popular field in Human-Computer-Interaction(HCI). Many research papers have been proposed in this field. They proposed vision-based, glove-based and depth-based approach for hand gesture ...
Robust hand gesture recognition with kinect sensor
MM '11: Proceedings of the 19th ACM international conference on Multimedia

Hand gesture based Human-Computer-Interaction (HCI) is one of the most natural and intuitive ways to communicate between people and machines, since it closely mimics how human interact with each other. In this demo, we present a hand gesture recognition ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

CCEAI '21: Proceedings of the 5th International Conference on Control Engineering and Artificial Intelligence

January 2021

165 pages

ISBN:9781450388870

DOI:10.1145/3448218

Editor:
Dan Zhang

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

York University

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 February 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

CCEAI 2021

CCEAI 2021: 5th International Conference on Control Engineering and Artificial Intelligence

January 14 - 16, 2021

Sanya, China

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
217
Total Downloads

Downloads (Last 12 months)45
Downloads (Last 6 weeks)0

Reflects downloads up to 26 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Qiao LWang ZShu YXiao BLuan XShi YLi WGao X(2024)Simple and Efficient Gesture Recognition Based on Frequency-Modulated Continuous Wave RadarIEEE Transactions on Instrumentation and Measurement10.1109/TIM.2024.339682873(1-11)Online publication date: 2024
https://doi.org/10.1109/TIM.2024.3396828
Li XChen SZhang SZhu YXiao ZWang X(2024)Advancing IR-UWB Radar Human Activity Recognition With Swin Transformers and Supervised Contrastive LearningIEEE Internet of Things Journal10.1109/JIOT.2023.333099611:7(11750-11766)Online publication date: 1-Apr-2024
https://doi.org/10.1109/JIOT.2023.3330996
Li XChen SZhang SHou LZhu YXiao Z(2023)Human Activity Recognition Using IR-UWB Radar: A Lightweight Transformer ApproachIEEE Geoscience and Remote Sensing Letters10.1109/LGRS.2023.331462820(1-5)Online publication date: 2023
https://doi.org/10.1109/LGRS.2023.3314628
Wang LZhang JLi YWang H(2023)AudioWrite: A Handwriting Recognition System Using Acoustic Signals2022 IEEE 28th International Conference on Parallel and Distributed Systems (ICPADS)10.1109/ICPADS56603.2022.00019(81-88)Online publication date: Jan-2023
https://doi.org/10.1109/ICPADS56603.2022.00019
Islami AStudiawan H(2023)Image Forensics of Compressed Image on Social Media with Lightweight Deep Learning2023 24th International Arab Conference on Information Technology (ACIT)10.1109/ACIT58888.2023.10453792(1-6)Online publication date: 6-Dec-2023
https://doi.org/10.1109/ACIT58888.2023.10453792
Chen ZYang JFeng ZChen L(2022)RSCNet: An Efficient Remote Sensing Scene Classification Model Based on Lightweight Convolution Neural NetworksElectronics10.3390/electronics1122372711:22(3727)Online publication date: 14-Nov-2022
https://doi.org/10.3390/electronics11223727
Amit MFajardo AMedina R(2022)Recognition of Real-Time Hand Gestures using Mediapipe Holistic Model and LSTM with MLP Architecture2022 IEEE 10th Conference on Systems, Process & Control (ICSPC)10.1109/ICSPC55597.2022.10001800(292-295)Online publication date: 17-Dec-2022
https://doi.org/10.1109/ICSPC55597.2022.10001800
Wang SYan YChu HHu GZhang ZZou ZZheng L(2022)Hand Gesture Recognition Using IR-UWB Radar with Spiking Neural Networks2022 IEEE 4th International Conference on Artificial Intelligence Circuits and Systems (AICAS)10.1109/AICAS54282.2022.9870013(423-426)Online publication date: 13-Jun-2022
https://doi.org/10.1109/AICAS54282.2022.9870013
Yang YLi JLi BZhang Y(2022)MDHandNet: a lightweight deep neural network for hand gesture/sign language recognition based on micro-doppler imagesWorld Wide Web10.1007/s11280-021-00985-125:5(1951-1969)Online publication date: 1-Sep-2022
https://dl.acm.org/doi/10.1007/s11280-021-00985-1

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents