poster

Informing Future Gesture Elicitation Studies for Interactive Applications that Use Radar Sensing

Authors:

Santiago Villarreal-Narvaez,

Alexandru-Ionuţ Şiean,

Arthur Sluÿters,

Radu-Daniel Vatavu,

Jean VanderdoncktAuthors Info & Claims

AVI '22: Proceedings of the 2022 International Conference on Advanced Visual Interfaces

Article No.: 50, Pages 1 - 3

https://doi.org/10.1145/3531073.3534475

Published: 06 June 2022 Publication History

Abstract

We show how two recently introduced visual tools, RepliGES and GEStory, can be used conjointly to inform possible replications of Gesture Elicitation Studies (GES) with a case study centered on gestures that can be sensed with radars. Starting from a GES identified in GEStory, we employ the dimensions of the RepliGES space to enumerate eight possible ways to replicate that study towards gaining new insights into end user’s preferences for gesture-based interaction for applications that use radar sensors.

Supplemental Material

MP4 File

Supplemental video

Download
14.33 MB

References

[1]

Shahzad Ahmed, Karam Dad Kallu, Sarfaraz Ahmed, and Sung Ho Cho. 2021. Hand Gestures Recognition Using Radar Sensors for Human-Computer-Interaction: A Review. Remote Sensing 13(2021), 24 pages. https://doi.org/10.3390/rs13030527

[2]

Daniel Avrahami, Mitesh Patel, Yusuke Yamaura, and Sven Kratz. 2018. Below the Surface: Unobtrusive Activity Recognition for Work Surfaces Using RF-Radar Sensing. In Proceedings of the 23rd International Conference on Intelligent User Interfaces(IUI ’18). Association for Computing Machinery, New York, NY, USA, 439–451. https://doi.org/10.1145/3172944.3172962

Digital Library

[3]

Phil Cohen, Colin Swindells, Sharon Oviatt, and Alex Arthur. 2008. A High-Performance Dual-Wizard Infrastructure for Designing Speech, Pen, and Multimodal Interfaces. In Proceedings of the 10th International Conference on Multimodal Interfaces (Chania, Crete, Greece) (ICMI ’08). Association for Computing Machinery, New York, NY, USA, 137–140. https://doi.org/10.1145/1452392.1452419

Digital Library

[4]

Bogdan-Florin Gheran, Santiago Villarreal-Narvaez, Radu-Daniel Vatavu, and Jean Vanderdonckt. 2022. RepliGES and GEStory: Visual Tools for Systematizing and Consolidating Knowledge on User-Defined Gestures. In Proceedings of the 2022 International Conference on Advanced Visual Interfaces (AVI 2022), June 6–10, 2022, Frascati, Rome, Italy(AVI ’22). ACM, New York, NY, USA, 9 pages. https://doi.org/10.1145/3531073.3531112

Digital Library

[5]

Jaime Lien, Nicholas Gillian, M. Emre Karagozler, Patrick Amihood, Carsten Schwesig, Erik Olson, Hakim Raja, and Ivan Poupyrev. 2016. Soli: Ubiquitous Gesture Sensing with Millimeter Wave Radar. ACM Trans. Graph. 35, 4, Article 142 (jul 2016), 19 pages. https://doi.org/10.1145/2897824.2925953

Digital Library

[6]

Nathan Magrofuoco, Jorge Luis Pérez-Medina, Paolo Roselli, Jean Vanderdonckt, and Santiago Villarreal. 2019. Eliciting Contact-Based and Contactless Gestures With Radar-Based Sensors. IEEE Access 7(2019), 176982–176997. https://doi.org/10.1109/ACCESS.2019.2951349

[7]

Sameera Palipana, Dariush Salami, Luis A. Leiva, and Stephan Sigg. 2021. Pantomime: Mid-Air Gesture Recognition with Sparse Millimeter-Wave Radar Point Clouds. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 5, 1, Article 27 (mar 2021), 27 pages. https://doi.org/10.1145/3448110

Digital Library

[8]

Arthur Sluÿters, Sébastien Lambot, and Jean Vanderdonckt. 2022. Hand Gesture Recognition for an Off-the-Shelf Radar by Electromagnetic Modeling and Inversion. In Proceedings of the 27th International Conference on Intelligent User Interfaces(IUI ’22). ACM, New York, NY, USA, 506–522. https://doi.org/10.1145/3490099.3511107

Digital Library

[9]

Radu-Daniel Vatavu. 2019. The Dissimilarity-Consensus Approach to Agreement Analysis in Gesture Elicitation Studies. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems(CHI ’19). Association for Computing Machinery, New York, NY, USA, 1–13. https://doi.org/10.1145/3290605.3300454

Digital Library

[10]

Radu-Daniel Vatavu and Jacob O. Wobbrock. 2015. Formalizing Agreement Analysis for Elicitation Studies: New Measures, Significance Test, and Toolkit. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems(CHI ’15). Association for Computing Machinery, New York, NY, USA, 1325–1334. https://doi.org/10.1145/2702123.2702223

Digital Library

[11]

Santiago Villarreal-Narvaez, Jean Vanderdonckt, Radu-Daniel Vatavu, and Jacob O. Wobbrock. 2020. A Systematic Review of Gesture Elicitation Studies: What Can We Learn from 216 Studies?. In Proceedings of the 2020 ACM Designing Interactive Systems Conference. Association for Computing Machinery, New York, NY, USA, 855–872. https://doi.org/10.1145/3357236.3395511

Digital Library

[12]

Saiwen Wang, Jie Song, Jaime Lien, Ivan Poupyrev, and Otmar Hilliges. 2016. Interacting with Soli: Exploring Fine-Grained Dynamic Gesture Recognition in the Radio-Frequency Spectrum. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST ’16). Association for Computing Machinery, New York, NY, USA, 851–860. https://doi.org/10.1145/2984511.2984565

Digital Library

[13]

Jacob O. Wobbrock, Htet Htet Aung, Brandon Rothrock, and Brad A. Myers. 2005. Maximizing the Guessability of Symbolic Input. In Proceedings of CHI ’05 Extended Abstracts on Human Factors in Computing Systems (Portland, OR, USA) (CHI EA ’05). Association for Computing Machinery, New York, NY, USA, 1869–1872. https://doi.org/10.1145/1056808.1057043

Digital Library

[14]

Jacob O. Wobbrock, Meredith Ringel Morris, and Andrew D. Wilson. 2009. User-Defined Gestures for Surface Computing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems(CHI ’09). Association for Computing Machinery, New York, NY, USA, 1083–1092. https://doi.org/10.1145/1518701.1518866

Digital Library

[15]

Hui-Shyong Yeo, Gergely Flamich, Patrick Schrempf, David Harris-Birtill, and Aaron Quigley. 2016. RadarCat: Radar Categorization for Input & Interaction. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST ’16). Association for Computing Machinery, New York, NY, USA, 833–841. https://doi.org/10.1145/2984511.2984515

Digital Library

[16]

Hui-Shyong Yeo and Aaron Quigley. 2017. Radar Sensing in Human-Computer Interaction. Interactions 25, 1 (dec 2017), 70–73. https://doi.org/10.1145/3159651

Digital Library

Cited By

Čopič Pucihar KMeneghello FSalami DSluÿters AVatavu R(2024)Beyond Radar Waves: The First Workshop on Radar-Based Human-Computer InteractionCompanion Proceedings of the 16th ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3660515.3662836(97-102)Online publication date: 24-Jun-2024
https://dl.acm.org/doi/10.1145/3660515.3662836
Vanderdonckt JVatavu RSluÿters A(2024)Engineering Touchscreen Input for 3-Way Displays: Taxonomy, Datasets, and ClassificationCompanion Proceedings of the 16th ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3660515.3661331(57-65)Online publication date: 24-Jun-2024
https://dl.acm.org/doi/10.1145/3660515.3661331
Villarreal-Narvaez SSluÿters AVanderdonckt JVatavu R(2024)Brave New GES World: A Systematic Literature Review of Gestures and Referents in Gesture Elicitation StudiesACM Computing Surveys10.1145/363645856:5(1-55)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3636458
Show More Cited By

Recommendations

RepliGES and GEStory: Visual Tools for Systematizing and Consolidating Knowledge on User-Defined Gestures
AVI '22: Proceedings of the 2022 International Conference on Advanced Visual Interfaces

The body of knowledge accumulated by gesture elicitation studies (GES), although useful, large, and extensive, is also heterogeneous, scattered in the scientific literature across different venues and fields of research, and difficult to generalize to ...
Brave New GES World: A Systematic Literature Review of Gestures and Referents in Gesture Elicitation Studies
How do we determine highly effective and intuitive gesture sets for interactive systems tailored to end users’ preferences? A substantial body of knowledge is available on this topic, among which gesture elicitation studies stand out distinctively. In ...
Gesture Elicitation for Augmented Reality Environments
HCI International 2022 - Late Breaking Papers. Multimodality in Advanced Interaction Environments
Abstract
The study of gesture elicitation in Human-Computer Interaction (HCI) aims to improve the interaction with the computational environment, providing improved usability and a consequent increase in performance in executing their tasks. In ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

AVI '22: Proceedings of the 2022 International Conference on Advanced Visual Interfaces

June 2022

414 pages

ISBN:9781450397193

DOI:10.1145/3531073

General Chair:
Paolo Bottoni
Sapienza University of Rome, Italy
,
Program Chair:
Emanuele Panizzi
Sapienza University of Rome, Italy

Copyright © 2022 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 June 2022

Check for updates

Author Tags

Qualifiers

Poster
Research
Refereed limited

Data Availability

Supplemental video https://dl.acm.org/doi/10.1145/3531073.3534475#Search-in-GEStory.mp4

Funding Sources

Fonds De La Recherche Scientifique - FNRS
Wallonie-Bruxelles International
UEFIS - CDI

Conference

AVI 2022

AVI 2022: International Conference on Advanced Visual Interfaces

June 6 - 10, 2022

Frascati, Rome, Italy

Acceptance Rates

Overall Acceptance Rate 128 of 490 submissions, 26%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
68
Total Downloads

Downloads (Last 12 months)12
Downloads (Last 6 weeks)0

Reflects downloads up to 01 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Čopič Pucihar KMeneghello FSalami DSluÿters AVatavu R(2024)Beyond Radar Waves: The First Workshop on Radar-Based Human-Computer InteractionCompanion Proceedings of the 16th ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3660515.3662836(97-102)Online publication date: 24-Jun-2024
https://dl.acm.org/doi/10.1145/3660515.3662836
Vanderdonckt JVatavu RSluÿters A(2024)Engineering Touchscreen Input for 3-Way Displays: Taxonomy, Datasets, and ClassificationCompanion Proceedings of the 16th ACM SIGCHI Symposium on Engineering Interactive Computing Systems10.1145/3660515.3661331(57-65)Online publication date: 24-Jun-2024
https://dl.acm.org/doi/10.1145/3660515.3661331
Villarreal-Narvaez SSluÿters AVanderdonckt JVatavu R(2024)Brave New GES World: A Systematic Literature Review of Gestures and Referents in Gesture Elicitation StudiesACM Computing Surveys10.1145/363645856:5(1-55)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3636458
Sluÿters ALambot SVanderdonckt JVillarreal-Narvaez S(2024)Analysis of User-Defined Radar-Based Hand Gestures Sensed Through Multiple MaterialsIEEE Access10.1109/ACCESS.2024.336666712(27895-27917)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3366667
Sluÿters ALambot SVanderdonckt JVatavu R(2023)RadarSense: Accurate Recognition of Mid-air Hand Gestures with Radar Sensing and Few Training ExamplesACM Transactions on Interactive Intelligent Systems10.1145/358964513:3(1-45)Online publication date: 11-Sep-2023
https://dl.acm.org/doi/10.1145/3589645
Şiean APamparău CSluÿters AVatavu RVanderdonckt J(2023)Flexible gesture input with radars: systematic literature review and taxonomy of radar sensing integration in ambient intelligence environmentsJournal of Ambient Intelligence and Humanized Computing10.1007/s12652-023-04606-914:6(7967-7981)Online publication date: 10-Apr-2023
https://doi.org/10.1007/s12652-023-04606-9

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten