abstract

Mid-Air Haptic Interfaces for Interactive Digital Signage and Kiosks

Authors:

Orestis Georgiou,

Hannah Limerick,

Loïc Corenthy,

Mykola Maksymenko,

Myroslav Bachynskyi,

Jin Ryong KimAuthors Info & Claims

CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems

Paper No.: W31, Pages 1 - 9

https://doi.org/10.1145/3290607.3299030

Published: 02 May 2019 Publication History

Abstract

Digital signage systems are transitioning from static displays to rich, dynamic interactive experiences while new enabling technologies that support these interactions are also evolving. For instance, advances in computer vision and face, gaze, facial expression, body and hand-gesture recognition have enabled new ways of distal interactivity with digital content. Such possibilities are only just being adopted by advertisers and retailers, yet, they face important challenges e.g. the lack of a commonly accepted gesture, facial expressions or call-to-action set. Another common issue here is the absence of active tactile stimuli. Mid-air haptic interfaces can help alleviate these problems and aid in defining a gesture set, informing users about their interaction via haptic feedback loops, and enhancing the overall user experience. This workshop aims to examine the possibilities opened up by these technologies and discuss opportunities in designing the next generation of interactive digital signage kiosks.

References

[1]

Davies, Nigel, et al. "Pervasive displays: understanding the future of digital signage." Synthesis Lectures on Mobile and Pervasive Computing 8.1 (2014): 1--128.

Digital Library

[2]

Sandnes, Frode Eika, et al. "User interface design for public kiosks: an evaluation of the Taiwan high speed rail ticket vending machine." Journal of information science and engineering 26.1 (2010): 307--321.

[3]

Cao, Zhe, et al. "Realtime multi-person 2d pose estimation using part affinity fields." arXiv preprint arXiv:1611.08050 (2016).

[4]

Taylor, Jonathan, et al. "Articulated distance fields for ultra-fast tracking of hands interacting." ACM Transactions on Graphics (TOG) 36.6 (2017): 244.

Digital Library

[5]

Balakrishnan, Guha, et al. "Detecting pulse from head motions in video." Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2013.

Digital Library

[6]

Zhao, Mingmin, et al. "Emotion recognition using wireless signals." Proceedings of the 22nd Annual International Conference on Mobile Computing and Networking. ACM, 2016.

Digital Library

[7]

Garcia-Garcia, et al. "Advancing Connections Between Neuromarketing Academics and Industry." ACR North American Advances (2015).

[8]

Obrist, Marianna, et al. "Emotions mediated through mid-air haptics." Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 2015.

Digital Library

[9]

Peck, Joann, et al. 'It just feels good: Customers' affective response to touch and its influence on persuasion" Journal of Marketing 70 (2006):56--69.

[10]

T. Carter, et al, "Ultrahaptics: Multi-point Mid-air Haptic Feedback for Touch Surfaces," In Proceedings of the ACM Symposium on User Interface Software and Technology (UIST 2013), pp. 504--514, 2013.

Digital Library

[11]

T. Iwamoto, et al. "Non-contact Method for Producing Tactile Sensation using Airborne Ultrasound," In Proceedings of EuroHaptics, pp. 504--513, 2008.

Digital Library

[12]

Gatti, Elia, et al. "Emotional ratings and skin conductance response to visual, auditory and haptic stimuli." Scientific data 5 (2018): 180120.

[13]

Corenthy, Loic, et al. "Touchless Tactile Displays for Digital Signage: Mid-air Haptics meets Large Screens." Extended Abstracts of the CHI Conference on Human Factors in Computing Systems. ACM, 2018.

Digital Library

[14]

Freeman, Euan, et al. "Textured surfaces for ultrasound haptic displays." Proceedings of the 19th ACM International Conference on Multimodal Interaction. ACM, 2017.

Digital Library

[15]

Vo, Dong-Bach et al. "Touching the invisible: Localizing ultrasonic haptic cues." World Haptics Conference (WHC), 2015 IEEE. IEEE, 2015

[16]

Subramanian, Sriram, et al. "Mid-air haptics and displays: systems for un-instrumented mid-air interactions." Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 2016.

Digital Library

[17]

Giordano, Marcello, et al. "Mid-Air Haptics for Control Interfaces." Extended Abstracts of the CHI Conference on Human Factors in Computing Systems. ACM, 2018.

Digital Library

Cited By

Kawabe TUjitoko Y(2024)Softness Perception of Visual Objects Controlled by Touchless Inputs: The Role of Effective Distance of Hand MovementsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.325452230:7(4154-4169)Online publication date: Jul-2024
https://doi.org/10.1109/TVCG.2023.3254522
Bernardos ABesada JCobo GCasar J(2024)Evaluating Touchless Haptics for Interaction with Virtual ObjectsIntelligent Technologies for Interactive Entertainment10.1007/978-3-031-55722-4_15(210-221)Online publication date: 23-Mar-2024
https://doi.org/10.1007/978-3-031-55722-4_15
Dube TArif A(2023)Ultrasonic Keyboard: A Mid-Air Virtual Qwerty with Ultrasonic Feedback for Virtual RealityProceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3569009.3573117(1-8)Online publication date: 26-Feb-2023
https://dl.acm.org/doi/10.1145/3569009.3573117
Show More Cited By

Index Terms

Mid-Air Haptic Interfaces for Interactive Digital Signage and Kiosks
1. Hardware
  1. Emerging technologies
    1. Emerging interfaces
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Haptic devices
    2. Interaction techniques
      1. Gestural input

Recommendations

Touchless Tactile Displays for Digital Signage: Mid-air Haptics meets Large Screens
CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems

This demo presents the concept of Interactive Digital Signage with Haptics, where users can interact with public digital screens with their bare hands, utilizing tracking technology and ultrasonic mid-air haptic feedback. Using these three main ...
Mid-Air Haptics for Control Interfaces
CHI EA '18: Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems

Control interfaces and interactions based on touch-less gesture tracking devices have become a prevalent research topic in both industry and academia. Touch-less devices offer a unique interaction immediateness that makes them ideal for applications ...
User engagement for mid-air haptic interactions with digital signage
PerDis '19: Proceedings of the 8th ACM International Symposium on Pervasive Displays

Interactive digital signage is increasingly deployed in urban environments, from airports and train stations, to cinemas and shopping malls, whilst their integration into public spaces introduces new possibilities in multimedia presentation. In this ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '19: Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems

May 2019

3673 pages

ISBN:9781450359719

DOI:10.1145/3290607

General Chairs:
Stephen Brewster
University of Glasgow, Scotland, UK
,
Geraldine Fitzpatrick
TU Wien, Austria
,
Program Chairs:
Anna Cox
University College London, UK
,
Vassilis Kostakos
University of Melbourne, Australia

Copyright © 2019 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 May 2019

Check for updates

Author Tags

Qualifiers

Abstract

Funding Sources

European Union

Conference

CHI '19

Sponsor:

SIGCHI

CHI '19: CHI Conference on Human Factors in Computing Systems

May 4 - 9, 2019

Glasgow, Scotland Uk

Acceptance Rates

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

7
Total Citations
View Citations
635
Total Downloads

Downloads (Last 12 months)42
Downloads (Last 6 weeks)4

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Kawabe TUjitoko Y(2024)Softness Perception of Visual Objects Controlled by Touchless Inputs: The Role of Effective Distance of Hand MovementsIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2023.325452230:7(4154-4169)Online publication date: Jul-2024
https://doi.org/10.1109/TVCG.2023.3254522
Bernardos ABesada JCobo GCasar J(2024)Evaluating Touchless Haptics for Interaction with Virtual ObjectsIntelligent Technologies for Interactive Entertainment10.1007/978-3-031-55722-4_15(210-221)Online publication date: 23-Mar-2024
https://doi.org/10.1007/978-3-031-55722-4_15
Dube TArif A(2023)Ultrasonic Keyboard: A Mid-Air Virtual Qwerty with Ultrasonic Feedback for Virtual RealityProceedings of the Seventeenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3569009.3573117(1-8)Online publication date: 26-Feb-2023
https://dl.acm.org/doi/10.1145/3569009.3573117
Dube TRen YLimerick HMacKenzie IArif A(2022)Push, Tap, Dwell, and Pinch: Evaluation of Four Mid-air Selection Methods Augmented with Ultrasonic Haptic FeedbackProceedings of the ACM on Human-Computer Interaction10.1145/35677186:ISS(207-225)Online publication date: 14-Nov-2022
https://dl.acm.org/doi/10.1145/3567718
Kim J(2022)Multimodal Interaction with Mid-Air HapticsUltrasound Mid-Air Haptics for Touchless Interfaces10.1007/978-3-031-04043-6_7(185-205)Online publication date: 17-Sep-2022
https://doi.org/10.1007/978-3-031-04043-6_7
Kim HJo JLee JJung JAn JChoi MChung S(2021)Development of a Tactile Actuator with Non-Contact and Trans-Object Characteristics Using a Time-Varying Magnetic FieldActuators10.3390/act1006010610:6(106)Online publication date: 21-May-2021
https://doi.org/10.3390/act10060106
Rakkolainen IFreeman ESand ARaisamo RBrewster S(2021)A Survey of Mid-Air Ultrasound Haptics and Its ApplicationsIEEE Transactions on Haptics10.1109/TOH.2020.301875414:1(2-19)Online publication date: 1-Jan-2021
https://doi.org/10.1109/TOH.2020.3018754

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten