Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3313831.3376190acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

HapBead: On-Skin Microfluidic Haptic Interface using Tunable Bead

Published: 23 April 2020 Publication History

Abstract

On-skin haptic interfaces using soft elastomers which are thin and flexible have significantly improved in recent years. Many are focused on vibrotactile feedback that requires complicated parameter tuning. Another approach is based on mechanical forces created via piezoelectric devices and other methods for non-vibratory haptic sensations like stretching, twisting. These are often bulky with electronic components and associated drivers are complicated with limited control of timing and precision. This paper proposes HapBead, a new on-skin haptic interface that is capable of rendering vibration like tactile feedback using microfluidics. HapBead leverages a microfluidic channel to precisely and agilely oscillate a small bead via liquid flow, which then generates various motion patterns in channel that creates highly tunable haptic sensations on skin. We developed a proof-of-concept design to implement thin, flexible and easily affordable HapBead platform, and verified its haptic rendering capabilities via attaching it to users' fingertips. A study was carried out and confirmed that participants could accurately tell six different haptic patterns rendered by HapBead. HapBead enables new wearable display applications with multiple integrated functionalities such as on-skin haptic doodles, visuo-haptic displays and haptic illusions.

Supplementary Material

MP4 File (paper063vf.mp4)
Supplemental video

References

[1]
Shubhi Bansal and Prosenjit Sen. 2016. Mixing enhancement by degenerate modes in electrically actuated sessile droplets. Sensors and Actuators B: Chemical 232 (2016), 318--326.
[2]
Carlos Bermejo and Pan Hui. 2017. A survey on haptic technologies for mobile augmented reality. arXiv preprint arXiv:1709.00698 (2017).
[3]
Youngsu Cha, Jeonggyu Seo, Jun-Sik Kim, and Jung-Min Park. 2017. Human--computer interface glove using flexible piezoelectric sensors. Smart Materials and Structures 26, 5 (2017), 057002.
[4]
RJ Cornish. 1928. Flow in a pipe of rectangular cross-section. Proceedings of the Royal Society of London. Series A, Containing Papers of a Mathematical and Physical Character 120, 786 (1928), 691--700.
[5]
Loïc D'eramo, Benjamin Chollet, Marie Leman, Ekkachai Martwong, Mengxing Li, Hubert Geisler, Jules Dupire, Margaux Kerdraon, Clémence Vergne, Fabrice Monti, and others. 2018. Microfluidic actuators based on temperature-responsive hydrogels. Microsystems & Nanoengineering 4 (2018), 17069.
[6]
Manjeet Dhindsa, Jason Heikenfeld, Seyeoul Kwon, Jungwon Park, Philip D. Rack, and Ian Papautsky. 2010. Virtual electrowetting channels: electronic liquid transport with continuous channel functionality. Lab Chip 10 (2010), 832--836. Issue 7.
[7]
Yuan-Ling Feng, Charith Lasantha Fernando, Jan Rod, and Kouta Minamizawa. 2017. Submerged Haptics: A 3-DOF Fingertip Haptic Display Using Miniature 3D Printed Airbags. In ACM SIGGRAPH 2017 Emerging Technologies (SIGGRAPH '17). ACM, NY, NY, USA, Article 22, 2 pages.
[8]
Jonathan Follett. 2014. Designing for emerging technologies: UX for genomics, robotics, and the internet of things. " O'Reilly Media, Inc.".
[9]
Gabriele Frediani, Daniele Mazzei, Danilo Emilio De Rossi, and Federico Carpi. 2014. Wearable wireless tactile display for virtual interactions with soft bodies. Frontiers in bioengineering and biotechnology 2 (2014), 31.
[10]
Antonio Frisoli, Massimiliano Solazzi, Fabio Salsedo, and Massimo Bergamasco. 2008. A fingertip haptic display for improving curvature discrimination. Presence: Teleoperators and Virtual Environments 17, 6 (2008), 550--561.
[11]
Christian Frisson, Julien Decaudin, Thomas Pietrzak, Alexander Ng, Pauline Poncet, Fabrice Casset, Antoine Latour, and Stephen A. Brewster. 2017. Designing Vibrotactile Widgets with Printed Actuators and Sensors. In Adjunct Publication of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, NY, NY, USA, 11--13.
[12]
Brian T Gleeson, Scott K Horschel, and William R Provancher. 2010. Design of a fingertip-mounted tactile display with tangential skin displacement feedback. IEEE Transactions on Haptics 3, 4 (2010), 297--301.
[13]
Aakar Gupta, Antony Albert Raj Irudayaraj, and Ravin Balakrishnan. 2017. HapticClench: Investigating Squeeze Sensations Using Memory Alloys. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, NY, NY, USA, 109--117.
[14]
Nur Al-huda Hamdan, Adrian Wagner, Simon Voelker, Jürgen Steimle, and Jan Borchers. 2019. Springlets: Expressive, Flexible and Silent On-Skin Tactile Interfaces. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, NY, NY, USA, Article 488, 14 pages.
[15]
Teng Han, Fraser Anderson, Pourang Irani, and Tovi Grossman. 2018. HydroRing: Supporting Mixed Reality Haptics Using Liquid Flow. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST '18). ACM, NY, NY, USA, 913--925.
[16]
Chris Harrison. 2013. The human body as an interactive computing platform. Ph.D. Dissertation. Google.
[17]
Sreenivasa Saravan Kallempudi, Zeynep Altintas, Javed H. Niazi, and Yasar Gurbuz. 2012. A new microfluidics system with a hand-operated, on-chip actuator for immunosensor applications. Sensors and Actuators B: Chemical 163, 1 (2012), 194 -- 201.
[18]
Hsin-Liu (Cindy) Kao, Miren Bamforth, David Kim, and Chris Schmandt. 2018. Skinmorph: Texture-tunable On-skin Interface Through Thin, Programmable Gel. In Proceedings of the 2018 ACM International Symposium on Wearable Computers (ISWC '18). ACM, NY, NY, USA, 196--203.
[19]
Hsin-Liu (Cindy) Kao, Christian Holz, Asta Roseway, Andres Calvo, and Chris Schmandt. 2016. DuoSkin: Rapidly Prototyping On-skin User Interfaces Using Skin-friendly Materials. In Proceedings of the 2016 ACM International Symposium on Wearable Computers (ISWC '16). ACM, NY, NY, USA, 16--23.
[20]
Kazuhiro Kobayashi and Hiroaki Onoe. 2018. Microfluidic-based flexible reflective multicolor display. Microsystems & nanoengineering 4, 1 (2018), 17.
[21]
Siddharth R Krishnan, Chun-Ju Su, Zhaoqian Xie, Manish Patel, Surabhi R Madhvapathy, Yeshou Xu, Juliet Freudman, Barry Ng, Seung Yun Heo, Heling Wang, and others. 2018. Wireless, Battery-Free Epidermal Electronics for Continuous, Quantitative, Multimodal Thermal Characterization of Skin. Small 14, 47 (2018), 1803192.
[22]
Di Li and Xiangchun Xuan. 2018. Electrophoretic slip-tuned particle migration in microchannel viscoelastic fluid flows. Physical Review Fluids 3, 7 (2018), 074202.
[23]
Tie Li, Yue Li, and Ting Zhang. 2019. Materials, Structures, and Functions for Flexible and Stretchable Biomimetic Sensors. Accounts of chemical research 52, 2 (2019), 288--296.
[24]
Robert W Lindeman, Yasuyuki Yanagida, Haruo Noma, and Kenichi Hosaka. 2006. Wearable vibrotactile systems for virtual contact and information display. Virtual Reality 9, 2--3 (2006), 203--213.
[25]
Joanne Lo, Doris Jung Lin Lee, Nathan Wong, David Bui, and Eric Paulos. 2016. Skintillates: Designing and Creating Epidermal Interactions. In Proceedings of the 2016 ACM Conference on Designing Interactive Systems (DIS '16). ACM, NY, NY, USA, 853--864.
[26]
Nicholas Mavrogiannis, Markela Ibo, Xiaotong Fu, Francesca Crivellari, and Zachary Gagnon. 2016. Microfluidics made easy: A robust low-cost constant pressure flow controller for engineers and cell biologists. Biomicrofluidics 10, 3 (2016), 034107.
[27]
Georgia-Paraskevi Nikoleli, Christina G Siontorou, Dimitrios P Nikolelis, Spyridoula Bratakou, Stephanos Karapetis, and Nikolaos Tzamtzis. 2018. Biosensors Based on Microfluidic Devices Lab-on-a-Chip and Microfluidic Technology. In Nanotechnology and Biosensors. Elsevier, 375--394.
[28]
Aditya Shekhar Nittala, Klaus Kruttwig, Jaeyeon Lee, Roland Bennewitz, Eduard Arzt, and Jürgen Steimle. 2019. Like A Second Skin: Understanding How Epidermal Devices Affect Human Tactile Perception. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, NY, NY, USA, Article 380, 16 pages.
[29]
Aditya Shekhar Nittala, Anusha Withana, Narjes Pourjafarian, and Jürgen Steimle. 2018. Multi-Touch Skin: A Thin and Flexible Multi-Touch Sensor for On-Skin Input. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, NY, NY, USA, Article 33, 12 pages.
[30]
Kwang W Oh, Kangsun Lee, Byungwook Ahn, and Edward P Furlani. 2012. Design of pressure-driven microfluidic networks using electric circuit analogy. Lab on a Chip 12, 3 (2012), 515--545.
[31]
Claudio Pacchierotti, Stephen Sinclair, Massimiliano Solazzi, Antonio Frisoli, Vincent Hayward, and Domenico Prattichizzo. 2017. Wearable haptic systems for the fingertip and the hand: taxonomy, review, and perspectives. IEEE transactions on haptics 10, 4 (2017), 580--600.
[32]
Daniel S Pamungkas and Wahyu Caesarendra. 2018. Overview Electrotactile Feedback for Enhancing Human Computer Interface. In Journal of Physics: Conference Series, Vol. 1007. IOP Publishing, 012001.
[33]
Tyler R Ray, Jungil Choi, Amay J Bandodkar, Siddharth Krishnan, Philipp Gutruf, Limei Tian, Roozbeh Ghaffari, and John A Rogers. 2019. Bio-integrated wearable systems: a comprehensive review. Chemical reviews 119, 8 (2019), 5461--5533.
[34]
John A Rogers and Ralph G Nuzzo. 2005. Recent progress in soft lithography. Materials today 8, 2 (2005), 50--56.
[35]
Harshal A. Sonar, Aaron P. Gerratt, Stéphanie P. Lacour, and Jamie Paik. 2019. Closed-Loop Haptic Feedback Control Using a Self-Sensing Soft Pneumatic Actuator Skin. Soft Robotics (2019).
[36]
Chaolong Song and Say Tan. 2017. A perspective on the rise of optofluidics and the future. Micromachines 8, 5 (2017), 152.
[37]
Kahye Song, Sung Hee Kim, Sungho Jin, Sohyun Kim, Sunho Lee, Jun-Sik Kim, Jung-Min Park, and Youngsu Cha. 2019. Pneumatic actuator and flexible piezoelectric sensor for soft virtual reality glove system. Scientific reports 9, 1 (2019), 8988.
[38]
Mayuko Tezuka, Norihide Kitamura, Kohei Tanaka, and Norihisa Miki. 2016. Presentation of various tactile sensations using micro-needle electrotactile display. PloS one 11, 2 (2016), e0148410.
[39]
Wei-Yu Tseng, Jeffrey S Fisher, JL Prieto, K Rinaldi, G Alapati, and AP Lee. 2009a. A slow-adapting microfluidic-based tactile sensor. Journal of Micromechanics and Microengineering 19, 8 (2009), 085002.
[40]
W-Y Tseng, J S Fisher, J L Prieto, K Rinaldi, G Alapati, and A P Lee. 2009b. A slow-adapting microfluidic-based tactile sensor. Journal of Micromechanics and Microengineering 19, 8 (jul 2009), 085002.
[41]
Dzmitry Tsetserukou, Shotaro Hosokawa, and Kazuhiko Terashima. 2014. LinkTouch: A wearable haptic device with five-bar linkage mechanism for presentation of two-DOF force feedback at the fingerpad. In 2014 IEEE Haptics Symposium (HAPTICS). IEEE, 307--312.
[42]
Yanan Wang, Shijian Luo, Hebo Gong, Fei Xu, Rujia Chen, Shuai Liu, and Preben Hansen. 2018. SKIN+: Fabricating Soft Fluidic User Interfaces for Enhancing On-Skin Experiences and Interactions. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (CHI EA '18). ACM, NY, NY, USA, Article LBW111, 6 pages.
[43]
Martin Weigel, Tong Lu, Gilles Bailly, Antti Oulasvirta, Carmel Majidi, and Jürgen Steimle. 2015. iSkin: Flexible, Stretchable and Visually Customizable On-Body Touch Sensors for Mobile Computing. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, NY, NY, USA, 2991--3000.
[44]
Anusha Withana, Daniel Groeger, and Jürgen Steimle. 2018. Tacttoo: A Thin and Feel-Through Tattoo for On-Skin Tactile Output. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST '18). ACM, NY, NY, USA, 365--378.
[45]
Ruben D. Ponce Wong, Jonathan D. Posner, and Veronica J. Santos. 2012. Flexible microfluidic normal force sensor skin for tactile feedback. Sensors and Actuators A: Physical 176 (2012), 62--69.
[46]
Lei Xiao, Tingwei Zhang, Chen Kun, Jue Zhang, Tian Yue, Fang Fang, and Chen Lihan. 2019. Psychophysics of wearable haptic/tactile perception in a multisensory context. Virtual Reality & Intelligent Hardware 1, 2 (2019), 185--200.
[47]
Sheng Xu, Yihui Zhang, Lin Jia, ..., and John A. Rogers. 2014. Soft Microfluidic Assemblies of Sensors, Circuits, and Radios for the Skin. Science 344, 6179 (2014), 70--74. https://science.sciencemag.org/content/344/6179/70
[48]
Jianzhu Yin, Veronica J. Santos, and Jonathan D. Posner. 2017. Bioinspired flexible microfluidic shear force sensor skin. Sensors and Actuators A: Physical 264 (2017), 289--297.
[49]
Ryuji Yokokawa, Yusuke Sakai, Atsuhito Okonogi, Isaku Kanno, and Hidetoshi Kotera. 2010. Force Measurement and Modeling for Motor Proteins Between Microsphere and Microfluidic Channel Surface. In 14th International Conference on Miniaturized Systems for Chemistry and Life Sciences. CBMS, 372--374.
[50]
Tomoyuki Yokota, Peter Zalar, Martin Kaltenbrunner, Hiroaki Jinno, Naoji Matsuhisa, Hiroki Kitanosako, Yutaro Tachibana, Wakako Yukita, Mari Koizumi, and Takao Someya. 2016. Ultraflexible organic photonic skin. Science advances 2, 4 (2016), e1501856.
[51]
Xinge Yu, Zhaoqian Xie, Yang Yu, ..., and John A. Rogers. 2019. Skin-integrated wireless haptic interfaces for virtual and augmented reality. Nature 575 (2019), 473--479.
[52]
Jinnan Zhang, Yanghua Cao, Min Qiao, Lingmei Ai, Kaize Sun, Qing Mi, Siyao Zang, Yong Zuo, Xueguang Yuan, and Qi Wang. 2018. Human motion monitoring in sports using wearable graphene-coated fiber sensors. Sensors and Actuators A: Physical 274 (2018), 132--140.
[53]
Jie Zhang, Rui Guo, and Jing Liu. 2016. Self-propelled liquid metal motors steered by a magnetic or electrical field for drug delivery. J. Mater. Chem. B 4 (2016), 5349--5357. Issue 32.
[54]
Yi Zhang, Hexia Guo, Sung Bong Kim, Yixin Wu, Diana Ostojich, Sook Hyeon Park, Xueju Wang, Zhengyan Weng, Rui Li, Amay J Bandodkar, and others. 2019. Passive sweat collection and colorimetric analysis of biomarkers relevant to kidney disorders using a soft microfluidic system. Lab on a Chip 19, 9 (2019), 1545--1555.

Cited By

View all
  • (2024)Sentura: Understanding the Cognitive Affordances of Silicone Microtextures in Tangible User Interface DesignProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3664264(72-78)Online publication date: 23-Jun-2024
  • (2024)SweatSkinProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314257:4(1-30)Online publication date: 12-Jan-2024
  • (2024)breatHaptics: Enabling Granular Rendering of Breath Signals via Haptics using Shape-Changing Soft InterfacesProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633372(1-11)Online publication date: 11-Feb-2024
  • Show More Cited By

Index Terms

  1. HapBead: On-Skin Microfluidic Haptic Interface using Tunable Bead

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems
    April 2020
    10688 pages
    ISBN:9781450367080
    DOI:10.1145/3313831
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 23 April 2020

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. fluid flow
    2. haptics
    3. microfluidics
    4. wearable devices

    Qualifiers

    • Research-article

    Funding Sources

    • National Key R&D Program of China
    • Royal Academy of Engineering
    • ERC Advanced Grant
    • National Natural Science Foundation of China

    Conference

    CHI '20
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)161
    • Downloads (Last 6 weeks)12
    Reflects downloads up to 26 Sep 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Sentura: Understanding the Cognitive Affordances of Silicone Microtextures in Tangible User Interface DesignProceedings of the 16th Conference on Creativity & Cognition10.1145/3635636.3664264(72-78)Online publication date: 23-Jun-2024
    • (2024)SweatSkinProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314257:4(1-30)Online publication date: 12-Jan-2024
    • (2024)breatHaptics: Enabling Granular Rendering of Breath Signals via Haptics using Shape-Changing Soft InterfacesProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633372(1-11)Online publication date: 11-Feb-2024
    • (2024)HydroSkin: Rapid Prototyping On-Skin Interfaces via Low-Cost Hydrographic PrintingExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3651052(1-6)Online publication date: 11-May-2024
    • (2024)Haptic Permeability: Adding Holes to Tactile Devices Improves DexterityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642156(1-12)Online publication date: 11-May-2024
    • (2023)Augmenting On-Body Touch Input with Tactile Feedback Through Fingernail HapticsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581473(1-13)Online publication date: 19-Apr-2023
    • (2023)Fingertip Wearable High-resolution Electrohydraulic Interface for Multimodal Haptics2023 IEEE World Haptics Conference (WHC)10.1109/WHC56415.2023.10224383(299-305)Online publication date: 10-Jul-2023
    • (2022)MicroFluIDProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35502966:3(1-23)Online publication date: 7-Sep-2022
    • (2022)Designing Electrolysis Ion Display on Everyday Open Wet SurfacesProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3533574(1020-1034)Online publication date: 13-Jun-2022
    • (2022)Next Steps in Epidermal Computing: Opportunities and Challenges for Soft On-Skin DevicesProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517668(1-22)Online publication date: 29-Apr-2022
    • Show More Cited By

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media