Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3586183.3606808acmconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
research-article

FeetThrough: Electrotactile Foot Interface that Preserves Real-World Sensations

Published: 29 October 2023 Publication History

Abstract

Haptic interfaces have been extended to the feet to enhance foot-based activities, such as guidance while walking or stepping on virtual textures. Most feet haptics use mechanical actuators, namely vibration motors. However, we argue that vibration motors are not the ideal actuators for all feet haptics. Instead, we demonstrate that electrotactile stimulation provides qualities that make it a powerful feet-haptic interface: (1) Users wearing electrotactile can not only feel the stimulation but can also better feel the terrain under their feet—this is critical as our feet are also responsible for the balance on uneven terrains and stairs—electrotactile achieves this improved “feel-through” effect because it is thinner than vibrotactile actuators, at 0.1 mm in our prototype; (2) While a single vibrotactile actuator will also vibrate surrounding skin areas, we found improved two-point discrimination thresholds for electrotactile; (3) Electrotactile can be applied directly to soles, insoles or socks, enabling new applications such as barefoot interactive experiences or without requiring users to have custom-shoes with built-in vibration motors. Finally, we demonstrate applications in which electrotactile feet interfaces allow users to feel not only virtual information but also the real terrain under their shoes, such as a VR experience where users walk on ground props and a tactile navigation system that augments the ground with virtual tactile paving to assist pedestrians in low-vision situations.

Supplementary Material

ZIP File (3606808.zip)
Supplemental File

References

[1]
Adilkhanov, A. 2022. Haptic Devices: Wearability-Based Taxonomy and Literature Review. IEEE Access. 10, (2022), 91923–91947.
[2]
Ando, H. 2002. SmartFinger: nail-mounted tactile display. ACM SIGGRAPH 2002 conference abstracts and applications (New York, NY, USA, 21 2002), 78.
[3]
Anlauff, J. 2018. Feel-a-bump: Haptic feedback for foot-based angular menu selection. 2018 IEEE Haptics Symposium (HAPTICS) (Mar. 2018), 175–179.
[4]
Anlauff, J. 2017. VibeWalk: Foot-based tactons during walking and quiet stance. 2017 IEEE World Haptics Conference (WHC) (Jun. 2017), 647–652.
[5]
Bial, D. 2012. Improving Cyclists Training with Tactile Feedback on Feet. Haptic and Audio Interaction Design (Berlin, Heidelberg, 2012), 41–50.
[6]
Brusa, T. 2022. FeetBack – Redirecting touch sensation from a prosthetic hand to the human foot. Frontiers in Neuroscience. 16, (Oct. 2022), 1–12.
[7]
Elvitigala, D.S. 2020. GymSoles++: Using Smart Wearbales to Improve Body Posture when Performing Squats and Dead-Lifts. Proceedings of the Augmented Humans International Conference (Kaiserslautern Germany, Mar. 2020), 1–3.
[8]
Elvitigala, D.S. 2019. GymSoles: Improving Squats and Dead-Lifts by Visualizing the User's Center of Pressure. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow Scotland Uk, May 2019), 1–12.
[9]
Feeken, C. 2016. ClimbingAssist: direct vibro-tactile feedback on climbing technique. Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct (New York, NY, USA, Sep. 2016), 57–60.
[10]
Frahm, K.S. 2013. Experimental and model-based analysis of differences in perception of cutaneous electrical stimulation across the sole of the foot. Medical & Biological Engineering & Computing. 51, 9 (Sep. 2013), 999–1009.
[11]
Franceschi, M. 2017. A System for Electrotactile Feedback Using Electronic Skin and Flexible Matrix Electrodes: Experimental Evaluation. IEEE Transactions on Haptics. 10, 2 (Apr. 2017), 162–172.
[12]
Germani, M. 2013. Electro-tactile device for material texture simulation. The International Journal of Advanced Manufacturing Technology. 68, 9 (Oct. 2013), 2185–2203.
[13]
Han, T. 2018. HydroRing: Supporting Mixed Reality Haptics Using Liquid Flow. The 31st Annual ACM Symposium on User Interface Software and Technology - UIST ’18 (Berlin, Germany, 2018), 913–925.
[14]
Hayakawa, Y. 2022. Development and application of silicone outer shell-type pneumatic soft actuators. J. Robot. Mechatron. 34, 2 (Apr. 2022), 444–453.
[15]
Hill, E. 2014. Haptic foot interface for language communication. Proceedings of the 5th Augmented Human International Conference (Kobe Japan, Mar. 2014), 1–4.
[16]
Hughes, J. 1990. The importance of the toes in walking. The Journal of Bone & Joint Surgery British Volume. 72-B, 2 (Mar. 1990), 245–251.
[17]
Iijima, Y. 2019. Enhancement of range of creation of foot sole tactile illusion by vibration stimulation of the foot instep. 2019 IEEE World Haptics Conference (WHC) (Jul. 2019), 31–36.
[18]
Jingu, A. 2023. LipIO: Enabling Lips as both Input and Output Surface. Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (New York, NY, USA, Apr. 2023), 1–14.
[19]
Jirattigalachote, W. 2011. Virtual pebble: A haptic state display for pedestrians. 2011 RO-MAN (Jul. 2011), 401–406.
[20]
Jones, B. 2020. FeetBack: Augmenting Robotic Telepresence with Haptic Feedback on the Feet. Proceedings of the 2020 International Conference on Multimodal Interaction (Virtual Event Netherlands, Oct. 2020), 194–203.
[21]
Kaczmarek, K.A. 1991. Electrotactile and vibrotactile displays for sensory substitution systems. IEEE Transactions on Biomedical Engineering. 38, 1 (Jan. 1991), 1–16.
[22]
Kajimoto, H. 2021. Electro-Tactile Display Kit for Fingertip. 2021 IEEE World Haptics Conference (WHC) (Jul. 2021), 587–587.
[23]
Kajimoto, H. 2016. Electro-tactile Display: Principle and Hardware. Pervasive Haptics: Science, Design, and Application. H. Kajimoto, eds. Springer Japan. 79–96.
[24]
Kajimoto, H. 2014. HamsaTouch: tactile vision substitution with smartphone and electro-tactile display. CHI ’14 Extended Abstracts on Human Factors in Computing Systems (New York, NY, USA, Apr. 2014), 1273–1278.
[25]
Kammoun, S. 2015. Sole based tactile information display for visually impaired pedestrian navigation. Proceedings of the 8th ACM International Conference on Pervasive Technologies Related to Assistive Environments (New York, NY, USA, Jul. 2015), 1–4.
[26]
Kao, H.-L. (Cindy) 2016. DuoSkin: rapidly prototyping on-skin user interfaces using skin-friendly materials. Proceedings of the 2016 ACM International Symposium on Wearable Computers (New York, NY, USA, Sep. 2016), 16–23.
[27]
Kikuchi, T. 2013. Contribution of senses of foot for identification of shape, elasticity and tilt angle of ground. 2013 23rd International Conference on Artificial Reality and Telexistence (ICAT) (Dec. 2013), 61–66.
[28]
Kim, H. 2006. Vibrotactile Display for Driving Safety Information. 2006 IEEE Intelligent Transportation Systems Conference (Sep. 2006), 573–577.
[29]
Knibbe, J. 2021. Skill-Sleeves: Designing Electrode Garments for Wearability. Proceedings of the Fifteenth International Conference on Tangible, Embedded, and Embodied Interaction (New York, NY, USA, Feb. 2021), 1–16.
[30]
Kourtesis, P. 2022. Electrotactile Feedback Applications for Hand and Arm Interactions: A Systematic Review, Meta-Analysis, and Future Directions. IEEE Transactions on Haptics. 15, 3 (Jul. 2022), 479–496.
[31]
Kowalzik, R. 1996. Two-point Discrimination of Vibratory Perception on the Sole of the Human Foot. Foot & Ankle International. 17, 10 (Oct. 1996), 629–634.
[32]
Kruijff, E. 2022. First insights in perception of feet and lower-body stimuli for proximity and collision feedback in 3D user interfaces. Frontiers in Virtual Reality. 3, (2022).
[33]
Kruijff, E. 2016. On Your Feet!: Enhancing Vection in Leaning-Based Interfaces through Multisensory Stimuli. Proceedings of the 2016 Symposium on Spatial User Interaction (Tokyo Japan, Oct. 2016), 149–158.
[34]
Lee, J. 2007. Preliminary User Studies on Tactile Interface for Telematics Services. 2007 IEEE Intelligent Transportation Systems Conference (Sep. 2007), 929–933.
[35]
Lin, W. 2022. Super-resolution wearable electrotactile rendering system. Science Advances. 8, 36 (Sep. 2022), eabp8738.
[36]
Lopes, P. 2018. Adding Force Feedback to Mixed Reality Experiences and Games using Electrical Muscle Stimulation. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (New York, NY, USA, Apr. 2018), 1–13.
[37]
Matthies, D. 2014. ShoeSoleSense: demonstrating a wearable foot interface for locomotion in virtual environments. CHI ’14 Extended Abstracts on Human Factors in Computing Systems (Toronto Ontario Canada, Apr. 2014), 183–184.
[38]
Meier, A. 2015. Exploring vibrotactile feedback on the body and foot for the purpose of pedestrian navigation. Proceedings of the 2nd international Workshop on Sensor-based Activity Recognition and Interaction (New York, NY, USA, Jun. 2015), 1–11.
[39]
Nittala, A.S. 2019. Like A Second Skin: Understanding How Epidermal Devices Affect Human Tactile Perception. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI ’19 (Glasgow, Scotland Uk, 2019), 1–16.
[40]
Nordahl, R. 2012. Enhancing realism in virtual environments by simulating the audio-haptic sensation of walking on ground surfaces. 2012 IEEE Virtual Reality Workshops (VRW) (Mar. 2012), 73–74.
[41]
Pacchierotti, C. 2017. Wearable Haptic Systems for the Fingertip and the Hand: Taxonomy, Review, and Perspectives. IEEE Transactions on Haptics. 10, 4 (Oct. 2017), 580–600.
[42]
Papetti, S. 2011. Rhythm'n’Shoes: a Wearable Foot Tapping Interface with Audio-Tactile Feedback. NIME (2011), 473–476.
[43]
Roudaut, A. 2013. Gesture output: eyes-free output using a force feedback touch surface. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (New York, NY, USA, Apr. 2013), 2547–2556.
[44]
Rovers, A.F. and van Essen, H.A. 2005. FootIO - design and evaluation of a device to enable foot interaction over a computer network. First Joint Eurohaptics Conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems. World Haptics Conference (Mar. 2005), 521–522.
[45]
Rovers, A.F. and van Essen, H.A. 2006. Guidelines for haptic interpersonal communication applications: an exploration of foot interaction styles. Virtual Reality. 9, 2 (Mar. 2006), 177–191.
[46]
Sakai, K. 2017. Characteristics of illusory vibration in the toe pad induced by vibration applied to toenail and toe force to surface. 2017 IEEE World Haptics Conference (WHC) (Jun. 2017), 281–286.
[47]
Schirmer, M. 2015. Shoe me the Way: A Shoe-Based Tactile Interface for Eyes-Free Urban Navigation. Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services (New York, NY, USA, Aug. 2015), 327–336.
[48]
Solomonow, M. 1977. Electrotactile two-point discrimination as a function of frequency, body site, laterality, and stimulation codes. Annals of Biomedical Engineering. 5, 1 (Mar. 1977), 47–60.
[49]
Son, H. 2019. RealWalk: Haptic Shoes Using Actuated MR Fluid for Walking in VR. 2019 IEEE World Haptics Conference (WHC) (Tokyo, Japan, Jul. 2019), 241–246.
[50]
Strohmeier, P. 2020. bARefoot: Generating Virtual Materials using Motion Coupled Vibration in Shoes. Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (Virtual Event USA, Oct. 2020), 579–593.
[51]
Strzalkowski, N.D.J. 2018. Cutaneous afferent innervation of the human foot sole: what can we learn from single-unit recordings? Journal of Neurophysiology. 120, 3 (Sep. 2018), 1233–1246.
[52]
Takeuchi, Y. 2010. Gilded gait: reshaping the urban experience with augmented footsteps. Proceedings of the 23nd annual ACM symposium on User interface software and technology (New York, NY, USA, Oct. 2010), 185–188.
[53]
Tang, H. and Beebe, D.J. 2006. An oral tactile interface for blind navigation. IEEE Transactions on Neural Systems and Rehabilitation Engineering. 14, 1 (Mar. 2006), 116–123.
[54]
Tsao, C.-A. 2022. FrictShoes: Providing Multilevel Nonuniform Friction Feedback on Shoes in VR. IEEE Transactions on Visualization and Computer Graphics. 28, 5 (May 2022), 2026–2036.
[55]
Turchet, L. 2013. Haptic Feedback for Enhancing Realism of Walking Simulations. IEEE Transactions on Haptics. 6, 1 (2013), 35–45.
[56]
Velázquez, R. 2012. Insights into the Capabilities of Tactile-Foot Perception. International Journal of Advanced Robotic Systems. 9, 5 (Nov. 2012), 179.
[57]
Visell, Y. 2008. A Vibrotactile Device for Display of Virtual Ground Materials in Walking. Haptics: Perception, Devices and Scenarios. M. Ferre, ed. Springer Berlin Heidelberg. 420–426.
[58]
Viseux, F.J.F. 2020. The sensory role of the sole of the foot: Review and update on clinical perspectives. Neurophysiologie Clinique. 50, 1 (Feb. 2020), 55–68.
[59]
Vizcay, S. 2022. Design and Evaluation of Electrotactile Rendering Effects for Finger-Based Interactions in Virtual Reality. Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology (New York, NY, USA, Nov. 2022), 1–11.
[60]
Watanabe, J. and Ando, H. 2010. Pace-sync shoes: intuitive walking-pace guidance based on cyclic vibro-tactile stimulation for the foot. Virtual Reality. 14, 3 (Sep. 2010), 213–219.
[61]
Withana, A. 2018. Tacttoo: A Thin and Feel-Through Tattoo for On-Skin Tactile Output. Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (Berlin Germany, Oct. 2018), 365–378.
[62]
Wittchen, D. 2023. Designing Interactive Shoes for Tactile Augmented Reality. Proceedings of the Augmented Humans International Conference 2023 (Mar. 2023), 1–14.
[63]
Xu, Q. 2016. Design and Evaluation of Vibrating Footwear for Navigation Assistance to Visually Impaired People. 2016 IEEE International Conference on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData) (Dec. 2016), 305–310.
[64]
Yoshimoto, S. 2015. Material Roughness Modulation via Electrotactile Augmentation. IEEE Transactions on Haptics. 8, 2 (Apr. 2015), 199–208.
[65]
Zanotto, D. 2014. SoleSound: Towards a novel portable system for audio-tactile underfoot feedback. 5th IEEE RAS/EMBS International Conference on Biomedical Robotics and Biomechatronics (Aug. 2014), 193–198.
[66]
Zehr, E.P. 2014. Cutaneous stimulation of discrete regions of the sole during locomotion produces “sensory steering” of the foot. BMC Sports Science, Medicine and Rehabilitation. 6, 1 (Aug. 2014), 33.
[67]
Ziat, M. 2022. Walking on paintings: Assessment of passive haptic feedback to enhance the immersive experience. Frontiers in Virtual Reality. 3, (2022).

Cited By

View all
  • (2024)Integrating Force Sensing with Electro-Tactile Feedback in 3D Printed Haptic InterfacesProceedings of the 2024 ACM International Symposium on Wearable Computers10.1145/3675095.3676612(48-54)Online publication date: 5-Oct-2024
  • (2024)Flip-Pelt: Motor-Driven Peltier Elements for Rapid Thermal Stimulation and Congruent Pressure Feedback in Virtual RealityProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676363(1-15)Online publication date: 13-Oct-2024
  • (2024)Seated-WIP: Enabling Walking-in-Place Locomotion for Stationary Chairs in Confined SpacesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642395(1-13)Online publication date: 11-May-2024
  • Show More Cited By

Index Terms

  1. FeetThrough: Electrotactile Foot Interface that Preserves Real-World Sensations

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    UIST '23: Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology
    October 2023
    1825 pages
    ISBN:9798400701320
    DOI:10.1145/3586183
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 29 October 2023

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. AR
    2. Haptics
    3. VR
    4. electrotactile
    5. feel-through
    6. foot

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Funding Sources

    • JSPS KAKENHI

    Conference

    UIST '23

    Acceptance Rates

    Overall Acceptance Rate 561 of 2,567 submissions, 22%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)655
    • Downloads (Last 6 weeks)83
    Reflects downloads up to 15 Oct 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Integrating Force Sensing with Electro-Tactile Feedback in 3D Printed Haptic InterfacesProceedings of the 2024 ACM International Symposium on Wearable Computers10.1145/3675095.3676612(48-54)Online publication date: 5-Oct-2024
    • (2024)Flip-Pelt: Motor-Driven Peltier Elements for Rapid Thermal Stimulation and Congruent Pressure Feedback in Virtual RealityProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676363(1-15)Online publication date: 13-Oct-2024
    • (2024)Seated-WIP: Enabling Walking-in-Place Locomotion for Stationary Chairs in Confined SpacesProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642395(1-13)Online publication date: 11-May-2024
    • (2024)Stick&Slip: Altering Fingerpad Friction via Liquid CoatingsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642299(1-14)Online publication date: 11-May-2024
    • (2024)Haptic Permeability: Adding Holes to Tactile Devices Improves DexterityProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642156(1-12)Online publication date: 11-May-2024
    • (2024)Shaping Compliance: Inducing Haptic Illusion of Compliance in Different Shapes with Electrotactile GrainsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3641907(1-13)Online publication date: 11-May-2024
    • (2024)Experience Haptics Seamlessly Across Virtual and Real Worlds2024 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW62533.2024.00109(573-577)Online publication date: 16-Mar-2024

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media