research-article

Investigating how user avatar in touchless interfaces affects perceived cognitive load and two-handed interactions

Authors:

Salvatore Sorce,

Alessio Malizia,

Fabrizio Milazzo,

Antonio GentileAuthors Info & Claims

PerDis '17: Proceedings of the 6th ACM International Symposium on Pervasive Displays

Article No.: 21, Pages 1 - 7

https://doi.org/10.1145/3078810.3078831

Published: 07 June 2017 Publication History

Abstract

In recent years, touchless-enabling technologies have been more and more adopted for providing public displays with gestural interactivity. This has led to the need for novel visual interfaces aimed at solving issues such as communicating interactivity to users, as well as supporting immediate usability and "natural" interactions. In this paper, we focus our investigation on a visual interface based only on the use of in-air direct manipulations. Our study aims at evaluating whether and how the presence of an Avatar that replays user's movements may decrease the perceived cognitive workload during interactions. Moreover, we conducted a brief evaluation of the relationship between the presence of the Avatar and the use of one or two hands during the interactions. To this end, we compared two versions of the same interface, differing only for the presence/absence of the user's Avatar. Our results showed that the Avatar contributes to lower the perceived cognitive workload during the interactions.

References

[1]

R. de la Barré, P. Chojecki, U. Leiner, L. Mühlbach e D. Ruschin, «Touchless Interaction-Novel Chances and Challenges,» in Human-Computer Interaction. Novel Interaction Methods and Techniques, J. A. Jacko, A cura di, Springer Berlin Heidelberg, 2009, pp. 161--169.

Digital Library

[2]

V. Gentile, S. Sorce e A. Gentile, «Continuous Hand Openness Detection Using a Kinect-Like Device,» in Eighth International Conference on Complex, Intelligent and Software Intensive Systems (CISIS), Birmingham, UK, 2014.

Digital Library

[3]

M. H. Haeusler, Media facades: history, technology, content., Ludwigsburg: Avedition, 2009.

[4]

M. Brynskov, P. Dalsgaard, T. Ebsen, J. Fritsch, K. Halskov e R. Nielsen, «Staging Urban Interactions with Media Facades,» in INTERACT, 2009.

Digital Library

[5]

P. Dalsgaard e K. Halskov, «Dynamically transparent window,» in CHI EA '09: Proceedings of the 27th international conference extended abstracts on Human factors in computing systems, 2009.

Digital Library

[6]

J. Fritsch e P. Dalsgaard, «Media Facades Beyond Interaction,» in Proceedings of OzCHI 2008, 2008.

[7]

J. Müller, G. Bailly, T. Bossuyt e N. Hillgreen, «MirrorTouch: Combining Touch and Mid-air Gestures for Public Displays,» in Proceedings of the 16th international conference on Human-computer interaction with mobile devices & services - MobileHCI '14, Toronto, Canada, 2014.

Digital Library

[8]

N. Davies, S. Clinch e F. Alt, Pervasive Displays: Understanding the Future of Digital Signage, Morgan & Claypool, 2014.

Digital Library

[9]

R. Walter, G. Bailly e J. Müller, «StrikeAPose: revealing mid-air gestures on public displays,» in CHI '13 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Paris, France, 2013.

Digital Library

[10]

J. Müller, F. Alt, D. Michelis e A. Schmidt, «Requirements and design space for interactive public displays,» in Proceedings of the 18th ACM international conference on Multimedia (MM '10), Firenze, Italy, 2010.

Digital Library

[11]

J. Müller, R. Walter, G. Bailly, M. Nischt e F. Alt, «Looking glass: a field study on noticing interactivity of a shop window,» in Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems - CHI '12, 2012.

Digital Library

[12]

V. Gentile, A. Malizia, S. Sorce e A. Gentile, «Designing Touchless Gestural Interactions for Public Displays In-the-Wild,» in Human-Computer Interaction: Interaction Technologies, M. Kurosu, A cura di, Springer International Publishing, 2015, pp. 24--34.

[13]

J. O. Wobbrock, M. R. Morris e A. D. Wilson, «User-defined gestures for surface computing,» in Proceedings of the 27th international conference on Human factors in computing systems - CHI 09, 2009.

Digital Library

[14]

D. Grijincu, M. A. Nacenta e P. O. Kristensson, «User-defined Interface Gestures,» in Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces - ITS '14, 2014.

Digital Library

[15]

T. Seyed, C. Burns, M. Costa Sousa, F. Maurer e A. Tang, «Eliciting usable gestures for multi-display environments,» in Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces - ITS '12, 2012.

Digital Library

[16]

P. Koutsabasis e C. K. Domouzis, «Mid-Air Browsing and Selection in Image Collections,» in AVI '16 Proceedings of the International Working Conference on Advanced Visual Interfaces, 2016.

Digital Library

[17]

R. Walter, G. Bailly, N. Valkanova e J. Müller, «Cuenesics: using mid-air gestures to select items on interactive public displays,» in 16th international conference on Human-computer interaction with mobile devices & services - MobileHCI '14, 2014.

Digital Library

[18]

M. Ringel Morris, A. Danielescu, S. Drucker, D. Fisher, B. Lee, C. Schraefel e J. O. Wobbrock, «Reducing legacy bias in gesture elicitation studies,» Interactions, vol. 21, n. 3, pp. 40--45, 2014.

Digital Library

[19]

Microsoft, Online. Available: http://download.microsoft.com/download/6/7/6/676611B4-1982-47A4-A42E-4CF84E1095A8/KinectHIG.2.0.pdf.

[20]

H. Brignull e Y. Rogers, «Enticing people to interact with large public displays in public spaces,» in Proceedings of the IFIP International Conference on Human-Computer Interaction (INTERACT 2003), 2003.

[21]

V. Gentile, S. Sorce, A. Malizia, D. Pirrello e A. Gentile, «Touchless Interfaces For Public Displays: Can We Deliver Interface Designers From Introducing Artificial Push Button Gestures?,» in Proceedings of the International Working Conference on Advanced Visual Interfaces, 2016.

Digital Library

[22]

A. Dix, J. Finlay, G. D. Abowd e R. Beale, Human Computer Interaction, III a cura di, Upper Saddle River: Prentice-Hall, 2003.

Digital Library

[23]

S. G. Hart e L. E. Staveland, «Development of NASA-TLX (Task Load Index): Results of Empirical and Theoretical Research,» Advances in Psychology, vol. 52, p. 139--183, 1988.

[24]

S. G. Hart, «NASA-task load index (NASA-TLX); 20 years later,» in Proceedings of the human factors and ergonomics society annual meeting, 2006.

Cited By

Villarreal-Narvaez SSluÿters AVanderdonckt JVatavu R(2023)Brave New GES World: A Systematic Literature Review of Gestures and Referents in Gesture Elicitation StudiesACM Computing Surveys10.1145/363645856:5(1-55)Online publication date: 7-Dec-2023
https://dl.acm.org/doi/10.1145/3636458
Gentile VFarzand HBonaccorso SRocchesso DMalizia AKhamis MSorce S(2023)User-Centered Evaluation of Different Configurations of a Touchless Gestural Interface for Interactive DisplaysHuman-Computer Interaction – INTERACT 202310.1007/978-3-031-42280-5_32(501-520)Online publication date: 25-Aug-2023
https://doi.org/10.1007/978-3-031-42280-5_32
Darejeh AMarcus NSweller J(2022)Increasing learner interactions with E-learning systems can either decrease or increase cognitive load depending on the nature of the interactionL’Année psychologique10.3917/anpsy1.223.0405Vol. 122:3(405-437)Online publication date: 21-Jul-2022
https://doi.org/10.3917/anpsy1.223.0405
Show More Cited By

Index Terms

Investigating how user avatar in touchless interfaces affects perceived cognitive load and two-handed interactions
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Touchless Interfaces For Public Displays: Can We Deliver Interface Designers From Introducing Artificial Push Button Gestures?
AVI '16: Proceedings of the International Working Conference on Advanced Visual Interfaces

Public displays have lately become ubiquitous thanks to the decreasing cost of such technology and public policies supporting the development of smart cities. Depending on form factor, those displays might use touchless gestural interfaces that ...
User-Centered Evaluation of Different Configurations of a Touchless Gestural Interface for Interactive Displays
Human-Computer Interaction – INTERACT 2023
Abstract
Approaches for improving the user experience when interacting with touchless displays have been proposed, such as using activation gestures and representing users as avatars in real-time. However, the novelty of such approaches may hinder users’ ...
Touchless gestural interfaces for networked public displays: overcoming interaction blindness and performing evaluations in-the-wild
UbiComp/ISWC'15 Adjunct: Adjunct Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2015 ACM International Symposium on Wearable Computers

In the near future, we can easily imagine a significant increment in diffusion of networked public displays, as well as novel interaction modalities used in their applications. In the following, we present two of the main challenges related to networked ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

PerDis '17: Proceedings of the 6th ACM International Symposium on Pervasive Displays

June 2017

186 pages

ISBN:9781450350457

DOI:10.1145/3078810

General Chair:
Marc Langheinrich
Universitá della Svizzera italiana (USI), Lugano, Switzerland
,
Program Chair:
Sarah Clinch
University of Manchester, Manchester, UK

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGMOBILE: ACM Special Interest Group on Mobility of Systems, Users, Data and Computing

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 June 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Ministero dell'Istruzione, dell'Università e della Ricerca

Conference

PerDis '17

Sponsor:

SIGMOBILE

PerDis '17: 6th International Symposium on Pervasive Displays

June 7 - 9, 2017

Lugano, Switzerland

Acceptance Rates

PerDis '17 Paper Acceptance Rate 21 of 38 submissions, 55%;

Overall Acceptance Rate 213 of 384 submissions, 55%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

9
Total Citations
View Citations
199
Total Downloads

Downloads (Last 12 months)10
Downloads (Last 6 weeks)0

Reflects downloads up to 13 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Villarreal-Narvaez SSluÿters AVanderdonckt JVatavu R(2023)Brave New GES World: A Systematic Literature Review of Gestures and Referents in Gesture Elicitation StudiesACM Computing Surveys10.1145/363645856:5(1-55)Online publication date: 7-Dec-2023
https://dl.acm.org/doi/10.1145/3636458
Gentile VFarzand HBonaccorso SRocchesso DMalizia AKhamis MSorce S(2023)User-Centered Evaluation of Different Configurations of a Touchless Gestural Interface for Interactive DisplaysHuman-Computer Interaction – INTERACT 202310.1007/978-3-031-42280-5_32(501-520)Online publication date: 25-Aug-2023
https://doi.org/10.1007/978-3-031-42280-5_32
Darejeh AMarcus NSweller J(2022)Increasing learner interactions with E-learning systems can either decrease or increase cognitive load depending on the nature of the interactionL’Année psychologique10.3917/anpsy1.223.0405Vol. 122:3(405-437)Online publication date: 21-Jul-2022
https://doi.org/10.3917/anpsy1.223.0405
Vatavu RUngurean OBilius L(2022)Interactive Public Displays and Wheelchair Users: Between Direct, Personal and Indirect, Assisted InteractionProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545662(1-17)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526113.3545662
Rubegni EGentile VMalizia ASorce SKargas N(2020)Child–display interaction: Lessons learned on touchless avatar-based large display interfacesPersonal and Ubiquitous Computing10.1007/s00779-020-01451-x26:3(667-680)Online publication date: 30-Oct-2020
https://dl.acm.org/doi/10.1007/s00779-020-01451-x
Gentile VAdjorlu ASerafin SRocchesso DSorce SKhamis MSorce SCauchard JGentile V(2019)Touch or touchless?Proceedings of the 8th ACM International Symposium on Pervasive Displays10.1145/3321335.3324946(1-7)Online publication date: 12-Jun-2019
https://dl.acm.org/doi/10.1145/3321335.3324946
Rubegni EGentile VMalizia ASorce SKargas NKhamis MSorce SCauchard JGentile V(2019)Child-display interactionProceedings of the 8th ACM International Symposium on Pervasive Displays10.1145/3321335.3324942(1-7)Online publication date: 12-Jun-2019
https://dl.acm.org/doi/10.1145/3321335.3324942
Gentile VFundarò DSorce SKhamis MSorce SCauchard JGentile V(2019)Elicitation and evaluation of zoom gestures for touchless interaction with desktop displaysProceedings of the 8th ACM International Symposium on Pervasive Displays10.1145/3321335.3324934(1-7)Online publication date: 12-Jun-2019
https://dl.acm.org/doi/10.1145/3321335.3324934
Ferreira MGarcía LMota MSerique BPrates RCandello H(2018)Requirements for Avatar in Virtual Environment of Support Learning in the Literacy of Deaf People in Portuguese Mediated by LIBRASProceedings of the 17th Brazilian Symposium on Human Factors in Computing Systems10.1145/3274192.3274241(1-6)Online publication date: 22-Oct-2018
https://dl.acm.org/doi/10.1145/3274192.3274241

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents