research-article

Open access

PneuSleeve: In-fabric Multimodal Actuation and Sensing in a Soft, Compact, and Expressive Haptic Sleeve

Authors:

Amirhossein H. Memar,

Priyanshu Agarwal,

Sean J. Keller,

Nicholas ColonneseAuthors Info & Claims

CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

Pages 1 - 12

https://doi.org/10.1145/3313831.3376333

Published: 23 April 2020 Publication History

All formats PDF

Abstract

Integration of soft haptic devices into garments can improve their usability and wearability for daily computing interactions. In this paper, we introduce PneuSleeve, a fabric-based, compact, and highly expressive forearm sleeve which can render a broad range of haptic stimuli including compression, skin stretch, and vibration. The haptic stimuli are generated by controlling pneumatic pressure inside embroidered stretchable tubes. The actuation configuration includes two compression actuators on the proximal and distal forearm, and four uniformly distributed linear actuators around and tangent to the forearm. Further, to ensure a suitable grip force, two soft mutual capacitance sensors are fabricated and integrated into the compression actuators, and a closed-loop force controller is implemented. We physically characterize the static and dynamic behavior of the actuators, as well as the performance of closed-loop control. We quantitatively evaluate the psychophysical characteristics of the six actuators in a set of user studies. Finally, we show the expressiveness of PneuSleeve by evaluating combined haptic stimuli using subjective assessments.

Supplementary Material

ZIP File (paper206aux.zip)

Auxiliary Material Description:

Download
110.81 MB

MP4 File (paper206vf.mp4)

Supplemental video

Download
93.98 MB

MP4 File (paper206pv.mp4)

Preview video

Download
16.25 MB

MP4 File (a206-zhu-presentation.mp4)

Download
65.04 MB

References

[1]

Nathaniel Agharese, Tyler Cloyd, Laura H Blumenschein, Michael Raitor, Elliot W Hawkes, Heather Culbertson, and Allison M Okamura. 2018. HapWRAP: Soft growing wearable haptic device. In 2018 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 1--5.

Digital Library

[2]

Faisal Arafsha, Kazi Masudul Alam, and Abdulmotaleb El Saddik. 2012. EmoJacket: Consumer centric wearable affective jacket to enhance emotional immersion. In 2012 international conference on innovations in information technology (IIT). IEEE, 350--355.

[3]

Karlin Bark, Jason Wheeler, Gayle Lee, Joan Savall, and Mark Cutkosky. 2009. A wearable skin stretch device for haptic feedback. In World Haptics 2009-Third Joint EuroHaptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. IEEE, 464--469.

Digital Library

[4]

Alexandra Delazio, Ken Nakagaki, Roberta L Klatzky, Scott E Hudson, Jill Fain Lehman, and Alanson P Sample. 2018. Force jacket: Pneumatically-actuated jacket for embodied haptic experiences. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 320.

Digital Library

[5]

Esther W Foo, J Walter Lee, Crystal Compton, Simon Ozbek, and Brad Holschuh. 2019. User experiences of garment-based dynamic compression for novel haptic applications. In Proceedings of the 23rd International Symposium on Wearable Computers. ACM, 54--59.

Digital Library

[6]

MM Gavrilovi´ c and MR Mari´ c. 1969. Positional servo-mechanism activated by artificial muscles. Medical and Biological Engineering 7, 1 (1969), 77--82.

[7]

Aakar Gupta, Antony Albert Raj Irudayaraj, and Ravin Balakrishnan. 2017. HapticClench: Investigating Squeeze Sensations using Memory Alloys. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. ACM, 109--117.

Digital Library

[8]

Nur Al-huda Hamdan, Adrian Wagner, Simon Voelker, Jürgen Steimle, and Jan Borchers. 2019. Springlets: Expressive, Flexible and Silent On-Skin Tactile Interfaces. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 488.

Digital Library

[9]

Elliot W Hawkes, David L Christensen, and Allison M Okamura. 2016. Design and implementation of a 300% strain soft artificial muscle. In 2016 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 4022--4029.

Digital Library

[10]

Ronan Hinchet, Velko Vechev, Herbert Shea, and Otmar Hilliges. 2018. DextrES: Wearable Haptic Feedback for Grasping in VR via a Thin Form-Factor Electrostatic Brake. In The 31st Annual ACM Symposium on User Interface Software and Technology. ACM, 901--912.

Digital Library

[11]

Da-Yuan Huang, Ruizhen Guo, Jun Gong, Jingxian Wang, John Graham, De-Nian Yang, and Xing-Dong Yang. 2017. RetroShape: Leveraging rear-surface shape displays for 2.5 D interaction on smartwatches. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. ACM, 539--551.

Digital Library

[12]

Alexandra Ion, Edward Jay Wang, and Patrick Baudisch. 2015. Skin drag displays: Dragging a physical tactor across the user's skin produces a stronger tactile stimulus than vibrotactile. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 2501--2504.

Digital Library

[13]

Ali Israr and Ivan Poupyrev. 2011. Tactile brush: drawing on skin with a tactile grid display. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2019--2028.

Digital Library

[14]

Ali Israr, Siyan Zhao, Kaitlyn Schwalje, Roberta Klatzky, and Jill Lehman. 2014. Feel Effects: Enriching Storytelling with Haptic Feedback. ACM Trans. Appl. Percept. 11, 3 (Sept. 2014).

Digital Library

[15]

Claudio Pacchierotti, Stephen Sinclair, Massimiliano Solazzi, Antonio Frisoli, Vincent Hayward, and Domenico Prattichizzo. 2017. Wearable haptic systems for the fingertip and the hand: taxonomy, review, and perspectives. IEEE transactions on haptics 10, 4 (2017), 580--600.

Digital Library

[16]

Roshan Lalitha Peiris, Yuan-Ling Feng, Liwei Chan, and Kouta Minamizawa. 2019. ThermalBracelet: Exploring Thermal Haptic Feedback Around the Wrist. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 170.

Digital Library

[17]

Evan Pezent, Ali Israr, Majed Samad, Shea Robinson, Priyanshu Agarwal, Hrvoje Benko, and Nick Colonnese. 2019. Tasbi: Multisensory squeeze and vibrotactile wrist haptics for augmented and virtual reality. In 2019 IEEE World Haptics Conference (WHC). IEEE, 1--6.

[18]

Henning Pohl, Peter Brandes, Hung Ngo Quang, and Michael Rohs. 2017. Squeezeback: pneumatic compression for notifications. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 5318--5330.

Digital Library

[19]

Panagiotis Polygerinos, Zheng Wang, Kevin C Galloway, Robert J Wood, and Conor J Walsh. 2015. Soft robotic glove for combined assistance and at-home rehabilitation. Robotics and Autonomous Systems 73 (2015), 135--143.

Digital Library

[20]

Domenico Prattichizzo, Francesco Chinello, Claudio Pacchierotti, and Monica Malvezzi. 2013. Towards wearability in fingertip haptics: a 3-dof wearable device for cutaneous force feedback. IEEE Transactions on Haptics 6, 4 (2013), 506--516.

Digital Library

[21]

Michael Raitor, Julie M Walker, Allison M Okamura, and Heather Culbertson. 2017. WRAP: Wearable, restricted-aperture pneumatics for haptic guidance. In 2017 IEEE International Conference on Robotics and Automation (ICRA). IEEE, 427--432.

Digital Library

[22]

Samuel B Schorr and Allison M Okamura. 2017. Fingertip tactile devices for virtual object manipulation and exploration. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 3115--3119.

Digital Library

[23]

HF Schulte Jr. 1961. The characteristics of the McKibben artificial muscle (1961) The Application of external power in prosthetics and orthotics. National Academy of Sciences-National Research Council, Washington DC, Appendix H (1961), 94--115.

[24]

Youngbo Aram Shim, Jaeyeon Lee, and Geehyuk Lee. 2018. Exploring Multimodal Watch-back Tactile Display using Wind and Vibration. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 132.

Digital Library

[25]

Evan Strasnick, Jessica R Cauchard, and James A Landay. 2017. Brushtouch: Exploring an alternative tactile method for wearable haptics. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. ACM, 3120--3125.

Digital Library

[26]

Nobuhiro Takahashi, Hayato Takahashi, and Hideki Koike. 2019. Soft Exoskeleton Glove Enabling Force Feedback for Human-Like Finger Posture Control with 20 Degrees of Freedom. In 2019 IEEE World Haptics Conference (WHC). IEEE, 217--222.

[27]

Fei Tang, Ryan P McMahan, and Tandra T Allen. 2014. Development of a low-cost tactile sleeve for autism intervention. In 2014 IEEE International Symposium on Haptic, Audio and Visual Environments and Games (HAVE) Proceedings. IEEE, 35--40.

[28]

Michael Wehner, Michael T Tolley, Yi?it Mengüç, Yong-Lae Park, Annan Mozeika, Ye Ding, Cagdas Onal, Robert F Shepherd, George M Whitesides, and Robert J Wood. 2014. Pneumatic energy sources for autonomous and wearable soft robotics. Soft robotics 1, 4 (2014), 263--274.

[29]

Eric Whitmire, Hrvoje Benko, Christian Holz, Eyal Ofek, and Mike Sinclair. 2018. Haptic revolver: Touch, shear, texture, and shape rendering on a reconfigurable virtual reality controller. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 86.

Digital Library

[30]

Weicheng Wu and Heather Culbertson. 2019. Wearable Haptic Pneumatic Device for Creating the Illusion of Lateral Motion on the Arm. In 2019 IEEE World Haptics Conference (WHC). IEEE, 193--198.

[31]

Eric M Young, Amirhossein H Memar, Priyanshu Agarwal, and Nick Colonnese. 2019. Bellowband: A Pneumatic Wristband for Delivering Local Pressure and Vibration. In 2019 IEEE World Haptics Conference (WHC). IEEE, 55--60.

[32]

Mengjia Zhu, Thanh Nho Do, Elliot Hawkes, and Yon Visell. 2020. Fluidic fabric muscle sheets for wearable and soft robotics. Soft Robotics (2020).

[33]

Bengang Zhuo, Sujie Chen, Mingmin Zhao, and Xiaojun Guo. 2017. High sensitivity flexible capacitive pressure sensor using polydimethylsiloxane elastomer dielectric layer micro-structured by 3-D printed mold. IEEE Journal of the Electron Devices Society 5, 3 (2017), 219--223.

Cited By

Fan ZSanson ARames TCoutrix C(2024)Design and Perception of a Soft Shape Change Beneath a SmartwatchProceedings of the ACM on Human-Computer Interaction10.1145/36764958:MHCI(1-23)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676495
Hong KZhang RLee KYoung PJoiner WRobinson SGoncu-Berk GSchofield JKostakos VKay JHoang T(2024)A Wearable Haptic Sleeve Interface for Spaceflight Robotic Arm OperationsCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3681943(318-322)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3681943
Vikberg ETseng YMoesgen TGowrishankar RXiao Y(2024)ThermoTouch: Exploring a modular design of a programmable wearable thermo-haptic deviceProceedings of the 2024 ACM International Conference on Interactive Media Experiences Workshops10.1145/3672406.3672423(122-126)Online publication date: 12-Jun-2024
https://dl.acm.org/doi/10.1145/3672406.3672423
Show More Cited By

Index Terms

PneuSleeve: In-fabric Multimodal Actuation and Sensing in a Soft, Compact, and Expressive Haptic Sleeve
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Haptic devices

Recommendations

Force Jacket: Pneumatically-Actuated Jacket for Embodied Haptic Experiences
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems

Immersive experiences seek to engage the full sensory system in ways that words, pictures, or touch alone cannot. With respect to the haptic system, however, physical feedback has been provided primarily with handheld tactile experiences or vibration-...
Pneumatic and acoustic suit: multimodal haptic suit for enhanced virtual reality simulation
Abstract
A haptic device provides users with physical feedback to enhance their experience in virtual reality (VR). We developed a multimodal haptic suit, called as Pneumatic and Acoustic (PA) suit, which exhibits high-resolution haptic feedback, and ...
Explorations of Wrist Haptic Feedback for AR/VR Interactions with Tasbi
CHI EA '20: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems

Most widespread haptic feedback devices for augmented and virtual reality (AR/VR) fall into one of two categories: simple hand-held controllers with a single vibration actuator, or complex glove systems with several embedded actuators. In this work, we ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

April 2020

10688 pages

ISBN:9781450367080

DOI:10.1145/3313831

General Chairs:
Regina Bernhaupt
Eindhoven University of Technology, Netherlands
,
Florian 'Floyd' Mueller
Monash University, Australia
,
David Verweij
Newcastle University, UK
,
Josh Andres
RMIT, Australia
,
Program Chairs:
Joanna McGrenere
University of British Columbia, Canada
,
Andy Cockburn
University of Canterbury, New Zealand
,
Ignacio Avellino
University of Maryland Baltimore County, USA
,
Alix Goguey
Grenoble Alpes University, France
,
Pernille Bjørn
University of Copenhagen, Denmark
,
Shengdong (Shen) Zhao
National University of Singapore, Singapore
,
Briane Paul Samson
Future University Hakodate, Japan & De La Salle University, Philippines
,
Rafal Kocielnik
University of Washington, USA

Copyright © 2020 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 April 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Badges

Honorable Mention

Author Tags

Qualifiers

Research-article

Conference

CHI '20

Sponsor:

SIGCHI

CHI '20: CHI Conference on Human Factors in Computing Systems

April 25 - 30, 2020

HI, Honolulu, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

66
Total Citations
View Citations
2,842
Total Downloads

Downloads (Last 12 months)651
Downloads (Last 6 weeks)80

Reflects downloads up to 03 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Fan ZSanson ARames TCoutrix C(2024)Design and Perception of a Soft Shape Change Beneath a SmartwatchProceedings of the ACM on Human-Computer Interaction10.1145/36764958:MHCI(1-23)Online publication date: 24-Sep-2024
https://dl.acm.org/doi/10.1145/3676495
Hong KZhang RLee KYoung PJoiner WRobinson SGoncu-Berk GSchofield JKostakos VKay JHoang T(2024)A Wearable Haptic Sleeve Interface for Spaceflight Robotic Arm OperationsCompanion of the 2024 on ACM International Joint Conference on Pervasive and Ubiquitous Computing10.1145/3675094.3681943(318-322)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675094.3681943
Vikberg ETseng YMoesgen TGowrishankar RXiao Y(2024)ThermoTouch: Exploring a modular design of a programmable wearable thermo-haptic deviceProceedings of the 2024 ACM International Conference on Interactive Media Experiences Workshops10.1145/3672406.3672423(122-126)Online publication date: 12-Jun-2024
https://dl.acm.org/doi/10.1145/3672406.3672423
Fan ZSanson ARames TCoutrix C(2024)Design and Perception of a Soft Shape Change Beneath a SmartwatchProceedings of the 35th Conference on l'Interaction Humain-Machine10.1145/3649792.3649800(1-14)Online publication date: 25-Mar-2024
https://dl.acm.org/doi/10.1145/3649792.3649800
Ruston OSharma AFraser M(2024)SeamSleeve: Robust Arm Movement Sensing through Powered StitchingProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660726(1134-1147)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660726
Pardomuan JMiyafuji STakahashi NKoike H(2024)VabricBeads : Variable Stiffness Structured Fabric using Artificial Muscle in Woven BeadsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642401(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642401
Talhan AYoo YCooperstock J(2024)Soft Pneumatic Haptic Wearable to Create the Illusion of Human TouchIEEE Transactions on Haptics10.1109/TOH.2023.330549517:2(177-190)Online publication date: Apr-2024
https://doi.org/10.1109/TOH.2023.3305495
Yoshida SXie HMiyata K(2023)Omnidirectional Haptic Stimulation System via Pneumatic Actuators for Presence PresentationSensors10.3390/s2302058423:2(584)Online publication date: 4-Jan-2023
https://doi.org/10.3390/s23020584
Mutlu RSingh DTawk CSariyildiz E(2023)A 3D-Printed Soft Haptic Device with Built-in Force Sensing Delivering Bio-Mimicked FeedbackBiomimetics10.3390/biomimetics80101278:1(127)Online publication date: 22-Mar-2023
https://doi.org/10.3390/biomimetics8010127
Choi HYoo S(2023)Development of human-touch smart armband for tele-haptic communication using a fabric-based soft pneumatic actuatorFashion and Textiles10.1186/s40691-023-00350-y10:1Online publication date: 25-Aug-2023
https://doi.org/10.1186/s40691-023-00350-y
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents