research-article

Cross-Field Aerial Haptics: Rendering Haptic Feedback in Air with Light and Acoustic Fields

Authors:

Takayuki Hoshi,

Satoshi Hasegawa,

Yoshio HayasakiAuthors Info & Claims

CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

Pages 3238 - 3247

https://doi.org/10.1145/2858036.2858489

Published: 07 May 2016 Publication History

Abstract

We present a new method of rendering aerial haptic images that uses femtosecond-laser light fields and ultrasonic acoustic fields. In conventional research, a single physical quantity has been used to render aerial haptic images. In contrast, our method combines multiple fields (light and acoustic fields) at the same time. While these fields have no direct interference, combining them provides benefits such as multi-resolution haptic images and a synergistic effect on haptic perception. We conducted user studies with laser haptics and ultrasonic haptics separately and tested their superposition. The results showed that the acoustic field affects the tactile perception of the laser haptics. We explored augmented reality/virtual reality (AR/VR) applications such as providing haptic feedback of the combination of these two methods. We believe that the results of this study contribute to the exploration of laser haptic displays and expand the expression of aerial haptic displays based on other principles.

Supplementary Material

suppl.mov (pn2246-file3.m4v)

Supplemental video

Download
90.21 MB

References

[1]

BENGTSSON, J. 1994. Kinoform design with an optimal-rotationangle method. Appl. Opt. 33, 29 (Oct), 6879.6884.

[2]

BOLANOWSKI, S. J. Jr., GESCHEIDER, G. A., VERRILLO, R.T., AND CHECKOSKY, C. M. 1968. Four channels mediate the mechanical aspects of touch. The Journal of the Acoustical Society of America. 84, 5, 1680.94.

[3]

BRANDT, E. H. 1989. Levitation in physics. Science 243, 4889, 349.55.

[4]

CAIN, C. P., ROACH, W. P., STOLARSKI, D. J., NOOJIN, G. D., KUMRU, S. S., STOCKTON, K. L., ZOHNER, J. J., AND ROCKWELL, B. A. 2007. Infrared laser damage thresholds for skin at wavelengths from 0.810 to 1.54 microns for femto-tomicrosecond pulse durations. In Proc. SPIE. Vol. 6435. 64350W.64350W.12.

[5]

CARTER, T., SEAH, S. A., LONG, B., DRINKWATER, B., AND SUBRAMANIAN, S. 2013. Ultrahaptics: Multi-point mid-air haptic feedback for touch surfaces. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology, ACM, NY, NY, USA, UIST '13, 505.514.

Digital Library

[6]

GUPTA, S., MORRIS, D., PATEL, S. N., AND TAN, D. 2013. Airwave: Non-contact haptic feedback using air vortex rings. In Proceedings of the 2013 ACM International Joint Conference on Pervasive and Ubiquitous Computing, ACM, NY, NY, USA, UbiComp '13, 419.428.

Digital Library

[7]

HASEGAWA, K., AND SHINODA, H. 2013. Aerial display of vibrotactile sensation with high spatialtemporal resolution using large-aperture airborne ultrasound phased array. In World Haptics Conference (WHC), 2013, 31.36.

[8]

HAYASAKI, Y., SUGIMOTO, T., TAKITA, A., AND NISHIDA, N. 2005. Variable holographic femtosecond laser processing by use of a spatial light modulator. Appl. Phys. Lett. 87, 3.

[9]

HOSHI, T., TAKAHASHI, M., IWAMOTO, T., AND SHINODA, H. 2010. Noncontact tactile display based on radiation pressure of airborne ultrasound. IEEE Transactions on Haptics 3, 3, 155.165.

Digital Library

[10]

INOUE, S., KOBAYASHI-KIRSCHVINK, K. J., MONNAI, Y., HASEGAWA, K., MAKINO, Y., AND SHINODA, H. 2014. Horn: The hapt-optic reconstruction. In ACM SIGGRAPH 2014 Emerging Technologies, ACM, NY, NY, USA, SIGGRAPH '14, 11:1.11:1.

Digital Library

[11]

IWAKI, S., MORIMASA, H., NORITSUGU, T., AND KOBAYASHI, M. 2011. Contactless manipulation of an object on a plane surface using multiple air jets. In ICRA, IEEE, 3257.3262.

[12]

JUN, J. H, PARK, J. R., KIM, S. P., MIN, B. Y., PARK J. Y., KIM H. S., CHOI, S., JUNG, S. J., HWA P. S., YEOM D. I., JUNG, G. I., KIM J. S., AND CHUNG, S. C. 2015. Laser-induced thermoelastic effects can evoke tactile sensations. Scientific Reports 5, 11016.

[13]

KIMURA, H., UCHIYAMA, T., AND YOSHIKAWA, H. 2006. Laser produced 3d display in the air. In ACM SIGGRAPH 2006 Emerging Technologies, ACM, NY, NY, USA, SIGGRAPH --06.

Digital Library

[14]

KONO, M., KAKEHI, Y., AND HOSHI, T., 2013. lapillus bug. SIGGRAPH Asia 2013 Art Gallery.

[15]

LEE, H., KIM, J. S., CHOI, S., JUN, J. H., PARK, J. R., KIM, A. H., OH, H. B., KIM, H. S, AND CHUNG, S. C., 2015. Mid-air tactile stimulation using laserinduced thermoelastic effects: The first study for indirect radiation. In World Haptics Conference (WHC), 2015, 374.380.

[16]

LEE, J., POST, R., AND ISHII, H. 2011. Zeron: Midair tangible interaction enabled by computer controlled magnetic levitation. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, ACM, NY, NY, USA, UIST '11, 327.336.

Digital Library

[17]

MARSHALL, M., CARTER, T., ALEXANDER, J., AND SUBRAMANIAN, S. 2012. Ultra-tangibles: Creating movable tangible objects on interactive tables. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, ACM, NY, NY, USA, CHI '12, 2185.2188.

Digital Library

[18]

OCHIAI, Y., HOSHI, T., OYAMA, A., AND REKIMOTO, J. 2013. Poppable display: A display that enables popping, breaking, and tearing interactions with people. In Consumer Electronics (GCCE), 2013 IEEE 2nd Global Conference on, 124.128.

[19]

OCHIAI, Y., HOSHI, T., AND REKIMOTO, J. 2014. Pixie dust: Graphics generated by levitated and animated objects in computational acoustic-potential field. ACM Trans. Graph. 33, 4 (July), 85:1.85:13.

Digital Library

[20]

OCHIAI, Y., KUMAGAI, K., HOSHI, T., REKIMOTO, J., HASEGAWA, S., AND YOSHIO, H. 2015. Fairy lights in femtoseconds: Aerial and volumetric graphics rendered by focused femtosecond laser combined with computational holographic fields. In ACM SIGGRAPH 2015 Emerging Technologies, ACM, NY, NY, USA, SIGGRAPH '15.

Digital Library

[21]

SAGA, S. 2014. Fingerflux: Near-surface haptic feedback on tabletops. In Proceedings of AsiaHaptics 2014, AsiaHaptics 2014.

[22]

SODHI, R., POUPYREV, I., GLISSON, M., AND ISRAR, A. 2013. Aireal: Interactive tactile experiences in free air. ACM Trans. Graph. 32, 4 (July), 134:1.134:10.

Digital Library

[23]

SUZUKI, Y., AND KOBAYASHI, M. 2005. Air jet driven force feedback in virtual reality. Computer Graphics and Applications, IEEE 25, 1 (Jan), 44.47.

Digital Library

[24]

WEISS, M., WACHARAMANOTHAM, C., VOELKER, S., AND BORCHERS, J. 2011. Fingerflux: Near-surface haptic feedback on tabletops. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology, ACM, NY, NY, USA, UIST '11, 615.620.

Digital Library

Cited By

Bernardos ABesada JCobo GCasar J(2024)Evaluating Touchless Haptics for Interaction with Virtual ObjectsIntelligent Technologies for Interactive Entertainment10.1007/978-3-031-55722-4_15(210-221)Online publication date: 23-Mar-2024
https://doi.org/10.1007/978-3-031-55722-4_15
Shin DPark JLim YChoi J(2022)A Study on the Shift Register-Based Multi Channel Ultrasonic Focusing Delay Control Method using a CPLD for Ultrasonic Tactile ImplementationJOURNAL OF SENSOR SCIENCE AND TECHNOLOGY10.46670/JSST.2022.31.5.32431:5(324-329)Online publication date: 30-Sep-2022
https://doi.org/10.46670/JSST.2022.31.5.324
Long ZYe SPeng ZYuan YLi Z(2022)Phase Optimization for Multipoint Haptic Feedback Based on Ultrasound ArraySensors10.3390/s2206239422:6(2394)Online publication date: 20-Mar-2022
https://doi.org/10.3390/s22062394
Show More Cited By

Index Terms

Cross-Field Aerial Haptics: Rendering Haptic Feedback in Air with Light and Acoustic Fields
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Fairy Lights in Femtoseconds: Aerial and Volumetric Graphics Rendered by Focused Femtosecond Laser Combined with Computational Holographic Fields

We present a method of rendering aerial and volumetric graphics using femtosecond lasers. A high-intensity laser excites physical matter to emit light at an arbitrary three-dimensional position. Popular applications can thus be explored, especially ...
Exploring surround haptics displays
CHI EA '10: CHI '10 Extended Abstracts on Human Factors in Computing Systems

In this paper we present the design and evaluation of a two dimensional haptics display intended to be used for enhancing experience for movies and rides. The display, haptics surface, utilizes an array of vibrators contacting the skin at discrete ...
SoEs: Attachable Augmented Haptic on Gaming Controller for Immersive Interaction
UIST '16 Adjunct: Adjunct Proceedings of the 29th Annual ACM Symposium on User Interface Software and Technology

We present SoEs (Sword of Elements), an attachable augmented haptic device for enhancing gaming controller in the immersive first-person game. Generally, Player can easily receive visual and auditory feedback through head-mounted displays (HMD) and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

May 2016

6108 pages

ISBN:9781450333627

DOI:10.1145/2858036

General Chairs:
Jofish Kaye
Yahoo
,
Allison Druin
University of Maryland / National Park Service
,
Program Chairs:
Cliff Lampe
University of Michigan
,
Dan Morris
Microsoft
,
Juan Pablo Hourcade
University of Iowa

Copyright © 2016 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2016

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI'16

Sponsor:

SIGCHI

CHI'16: CHI Conference on Human Factors in Computing Systems

May 7 - 12, 2016

California, San Jose, USA

Acceptance Rates

CHI '16 Paper Acceptance Rate 565 of 2,435 submissions, 23%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

33
Total Citations
View Citations
1,130
Total Downloads

Downloads (Last 12 months)105
Downloads (Last 6 weeks)7

Reflects downloads up to 16 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Bernardos ABesada JCobo GCasar J(2024)Evaluating Touchless Haptics for Interaction with Virtual ObjectsIntelligent Technologies for Interactive Entertainment10.1007/978-3-031-55722-4_15(210-221)Online publication date: 23-Mar-2024
https://doi.org/10.1007/978-3-031-55722-4_15
Shin DPark JLim YChoi J(2022)A Study on the Shift Register-Based Multi Channel Ultrasonic Focusing Delay Control Method using a CPLD for Ultrasonic Tactile ImplementationJOURNAL OF SENSOR SCIENCE AND TECHNOLOGY10.46670/JSST.2022.31.5.32431:5(324-329)Online publication date: 30-Sep-2022
https://doi.org/10.46670/JSST.2022.31.5.324
Long ZYe SPeng ZYuan YLi Z(2022)Phase Optimization for Multipoint Haptic Feedback Based on Ultrasound ArraySensors10.3390/s2206239422:6(2394)Online publication date: 20-Mar-2022
https://doi.org/10.3390/s22062394
Li JHirsch LLu TMayer SButz A(2022)A Touch of Realities: Car-Interior-Based Haptic Interaction Supports In-Car VR Recovery from InterruptionsProceedings of Mensch und Computer 202210.1145/3543758.3543768(229-239)Online publication date: 4-Sep-2022
https://dl.acm.org/doi/10.1145/3543758.3543768
Fan LSong AZhang H(2022)Development of an Integrated Haptic Sensor System for Multimodal Human–Computer Interaction Using Ultrasonic Array and Cable RobotIEEE Sensors Journal10.1109/JSEN.2022.314488822:5(4634-4643)Online publication date: 1-Mar-2022
https://doi.org/10.1109/JSEN.2022.3144888
Fan LSong AZhang H(2022)Design of a Haptic Interface Based on Cable Robot and Ultrasonic Transducers Array2022 8th International Conference on Mechatronics and Robotics Engineering (ICMRE)10.1109/ICMRE54455.2022.9734100(106-111)Online publication date: 10-Feb-2022
https://doi.org/10.1109/ICMRE54455.2022.9734100
Kim J(2022)Multimodal Interaction with Mid-Air HapticsUltrasound Mid-Air Haptics for Touchless Interfaces10.1007/978-3-031-04043-6_7(185-205)Online publication date: 17-Sep-2022
https://doi.org/10.1007/978-3-031-04043-6_7
Georgiou OFrier WFreeman EPacchierotti CHoshi T(2022)Mid-Air Haptics: Future Challenges and OpportunitiesUltrasound Mid-Air Haptics for Touchless Interfaces10.1007/978-3-031-04043-6_18(385-397)Online publication date: 17-Sep-2022
https://doi.org/10.1007/978-3-031-04043-6_18
Li JMayer AButz A(2021)Towards a Design Space of Haptics in Everyday Virtual Reality across Different Spatial ScalesMultimodal Technologies and Interaction10.3390/mti50700365:7(36)Online publication date: 3-Jul-2021
https://doi.org/10.3390/mti5070036
Bermejo CHui P(2021)A Survey on Haptic Technologies for Mobile Augmented RealityACM Computing Surveys10.1145/346539654:9(1-35)Online publication date: 8-Oct-2021
https://dl.acm.org/doi/10.1145/3465396
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents