Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/2702123.2702461acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

Proprioceptive Interaction

Published: 18 April 2015 Publication History
  • Get Citation Alerts
  • Abstract

    We propose a new way of eyes-free interaction for wearables. It is based on the user's proprioceptive sense, i.e., rather than seeing, hearing, or feeling an outside stimulus, users feel the pose of their own body. We have implemented a wearable device called Pose-IO that offers input and output based on proprioception. Users communicate with Pose-IO through the pose of their wrists. Users enter information by performing an input gesture by flexing their wrist, which the device senses using a 3-axis accelerometer. Users receive output from Pose-IO by find-ing their wrist posed in an output gesture, which Pose-IO actuates using electrical muscle stimulation. This mechanism allows users to interact with Pose-IO without visual or auditory senses, but through the proprioceptive sense alone. We developed three simple applications that demonstrate symmetric proprioceptive interaction, where input and output occur through the same limb, as well as asymmetric interaction, where input and output occur through different limbs. In a first user study, participants using a symmetric proprioceptive interface re-entered poses received from Pose-IO with an average accuracy of 5.8° despite the minimal bandwidth offered by the device. In a second, exploratory study, we investigated participants' emotional response to asymmetric proprioceptive interaction and the concept of the user's body serving as interface. Participants reported to enjoy the experience (4.6 out of 5).

    Supplementary Material

    suppl.mov (pn1766-file3.mp4)
    Supplemental video

    References

    [1]
    Ashbrook, D. Enabling Mobile Microinteractions. Ph.D. Dissertation. Georgia Tech, Atlanta, GA, USA.
    [2]
    Ban, Y., Narumi, T., Fujii, T., Sakurai, S., Imura, J., Tanikawa, T., and Hirose, M Augmented endurance: controlling fatigue while handling objects by affecting weight perception using augmented reality. Proc. CHI '13, 69--78.
    [3]
    Baudisch, P., Pohl, H., Reinicke, S., Wittmers, E., Lühne, P., Knaust, M., Köhler, S., Schmidt, P., and Holz, C. Imaginary reality gaming: ball games without a ball. Proc. UIST'13, 405--410.
    [4]
    Boven, K., Fejtl, M., Moeller, A., Nisch, W. and Stett, A. On Micro-Electrode Array Revival. In: Advances in Network Electrophysiology Using Multi-Electrode Arrays, 2006: 24--37.
    [5]
    Chao, E., An, K., Cooney, W., Linscheid, R. Biomechanics of the Hand. World Scientific Publishing, 1989.
    [6]
    Daniel, S., Gallagher, S., (Eds.), Handbook of Phenomenology and Cognitive Science, Springer; 2010 edition, ISBN-10: 9048126452
    [7]
    E. Gardner and J. Martin. Coding of Sensory Information, Principles of Neural Science. McGrawHill, fourth edition, 2000.
    [8]
    Farbiz, F., Yu, Z. H., Manders, C., and Ahmad, W. An electrical muscle stimulation haptic feedback for mixed reality tennis game. Proc. SIGGRAPH '07 (poster).
    [9]
    Felzer, T., and Nordmann, R. Using intentional muscle contractions as input signals for various hands-free control applications. Proc. iCREATe'08, 87--91.
    [10]
    Gandevia, S., Smith, J., Crawford, M., Proske, U., and Taylor, J. Motor commands contribute to human position sense. Journal of Physiology, 2006, 571(3) 703--710.
    [11]
    Gustafson, S., Bierwirth, D., and Baudisch, P. Imaginary interfaces: spatial interaction with empty hands and without visual feedback. Proc. UIST '10, 3--12.
    [12]
    Gustafson, S., Rabe, B., and Baudisch, P. Understanding palm-based imaginary interfaces: the role of visual and tactile cues when browsing. Proc CHI'13, 889--898.
    [13]
    Harrison, C., Tan, D., and Morris, D. Skinput: appropriating the body as an input surface. Proc. CHI'10, 453--462.
    [14]
    Hollerbach J. and Jacobsen S. Haptic Interfaces for Teleoperation and Virtual Environments. Proc. of First Workshop on Simulation and Interaction in Virtual Environments '95, 13--15.
    [15]
    Hook, J., Nappey, T., Making 3D Printed Objects Interactive Using Wireless Accelerometers. Proc. CHI '14 Extended Abstracts, 1435--1440.
    [16]
    K. Bark, J. W. Wheeler, S. Premakumar, and M. R. Cutkosky, Comparison of Skin Stretch and Vibrotactile Stimulation for Feedback of Proprioceptive Information. Proc. HAPTICS '08, 71--78.
    [17]
    Karuei, I., MacLean, K., Foley-Fisher, Z., MacKenzie, R., Koch, S., and El-Zohairy, M. Detecting vibrations across the body in mobile contexts. Proc. CHI'11, 3267--3276.
    [18]
    Katoh, M, Nishimura, N., Yokoyama, M., Hachisu, T., Sato, M., FUnited Kingdomushima, S., and Kajimoto, H. Optimal selection of electrodes for muscle electrical stimulation using twitching motion measurement. Proc. AH '13, 237--238.
    [19]
    Ken Hinckley, Randy Pausch, and Dennis Proffitt. 1997. Attention and visual feedback: the bimanual frame of reference. Proc. I3D '97, 121--126.
    [20]
    Kruijff, E., Schmalstieg, D., and Beckhaus, S. Using neuromuscular electrical stimulation for pseudo-haptic feedback. Proc. VRST '06, 316--319.
    [21]
    Li, K, A. Designing easily learnable eyes-free interaction, Ph.D. Thesis. UC San Diego, 2009.
    [22]
    Lopes, P. and Baudisch, P., Muscle-Propelled Force Feedback: bringing force feedback to mobile devices, Proc. CHI'13, 2577--2580.
    [23]
    Maffiuletti, N., Minetto, M., Farina, D., and Bottinelli, R. Electrical stimulation for neuromuscular testing and training: State-of-the art and unresolved issues. In Journal of Applied Physiology 2011, 111:2391--2397.
    [24]
    Murayama, J., Bougrila, L., Luo, Y., Akahane, K., Hasegawa, S., Hirsbrunner, B., Sato, M. SPIDAR G&G: a two-handed haptic interface for bimanual VR interaction. Proc. EuroHaptics '04, 138--146.
    [25]
    Ni, T. and Baudisch, P. Disappearing mobile devices. Proc. UIST'09, 101--110.
    [26]
    Pasquero, J., Stobbe, S., and Stonehouse, N. A haptic wristwatch for eyes-free interactions. Proc. CHI'11, 3257--3266.
    [27]
    Pfeiffer, M., Schneegass, S., Alt, F., and Rohs, M., Let Me Grab This: A Comparison of EMS and Vibration for Haptic Feedback in Free-Hand Interaction, Proc. AH'14.
    [28]
    Proske, U., and Gandevia, S., The Proprioceptive Senses: Their Roles in Signaling Body Shape, Body Position and Movement, and Muscle Force, In Physiological Reviews 2012, Vol. 92 no. 4,1651--1697
    [29]
    Red Hands, http://en.wikipedia.org/wiki/Red_hands.
    [30]
    Roudaut, A., Rau, A., Sterz, C., Plauth, M., Lopes, P., and Baudisch, P. Gesture output: eyes-free output using a force feedback touch surface. Proc. CHI'13, 25472556.
    [31]
    Saponas, S., Tan, D., Morris, D., Balakrishnan, R., Turner, J., and Landay, J. Enabling always-available input with muscle-computer interfaces. Proc. UIST'09, 167--176.
    [32]
    Stelarc. From zombies to cyborg bodies: exoskeleton, extra ear and avatars. Proc. C&C '99, 23.
    [33]
    Strojnik, P., Kralj, A., and Ursic, I., Programmed sixchannel electrical stimulator for complex stimulation of leg muscles during walking, IEEE Trans. Biomed. Eng. 26, 112, 1979.
    [34]
    Tamaki, E., Miyaki, T., and Rekimoto, J., Possessed Hand: techniques for controlling human hands using electrical muscles stimuli. Proc. CHI '11, 543--552.
    [35]
    Terrault, S., Lecolinet, E., Eagan, J., and Guiard, Y. Watchit: simple gestures and eyes-free interaction for wristwatches and bracelets. Proc. CHI'13, 1451--1460.
    [36]
    TsetserUnited Kingdomou, D., Sato, K., and Tachi, S. ExoInterfaces: novel exosceleton haptic interfaces for virtual reality, augmented sport and rehabilitation. Proc. AH '10, 1--6.
    [37]
    Walsh, L., Smith, J., Gandevia, S, and Taylor, J. The combined effect of muscle contraction history and motor commands on human position sense. Journal of Experimental Brain Research, 2009; 195(4): 603--10.
    [38]
    Wigdor, D., and Wixon, D, Brave NUI World: Designing Natural User Interfaces for Touch and Gesture. Morgan Kaufmann Publishers Inc., 2011.

    Cited By

    View all
    • (2024)Electrical Muscle Stimulation for Kinesthetic Feedback in AR/VR: A Systematic Literature ReviewMultimodal Technologies and Interaction10.3390/mti80200078:2(7)Online publication date: 25-Jan-2024
    • (2024)Exploring Shared Bodily Control: Designing Augmented Human Systems for Intra- and Inter-CorporealityProceedings of the Augmented Humans International Conference 202410.1145/3652920.3653037(318-323)Online publication date: 4-Apr-2024
    • (2024)Sonic Entanglements with Electromyography: Between Bodies, Signals, and RepresentationsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661572(2691-2707)Online publication date: 1-Jul-2024
    • Show More Cited By

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems
    April 2015
    4290 pages
    ISBN:9781450331456
    DOI:10.1145/2702123
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 18 April 2015

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. io
    2. muscle actuation
    3. proprioception

    Qualifiers

    • Research-article

    Conference

    CHI '15
    Sponsor:
    CHI '15: CHI Conference on Human Factors in Computing Systems
    April 18 - 23, 2015
    Seoul, Republic of Korea

    Acceptance Rates

    CHI '15 Paper Acceptance Rate 486 of 2,120 submissions, 23%;
    Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)163
    • Downloads (Last 6 weeks)11
    Reflects downloads up to 09 Aug 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Electrical Muscle Stimulation for Kinesthetic Feedback in AR/VR: A Systematic Literature ReviewMultimodal Technologies and Interaction10.3390/mti80200078:2(7)Online publication date: 25-Jan-2024
    • (2024)Exploring Shared Bodily Control: Designing Augmented Human Systems for Intra- and Inter-CorporealityProceedings of the Augmented Humans International Conference 202410.1145/3652920.3653037(318-323)Online publication date: 4-Apr-2024
    • (2024)Sonic Entanglements with Electromyography: Between Bodies, Signals, and RepresentationsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661572(2691-2707)Online publication date: 1-Jul-2024
    • (2024)Shared Bodily Fusion: Leveraging Inter-Body Electrical Muscle Stimulation for Social PlayProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660723(2088-2106)Online publication date: 1-Jul-2024
    • (2024)Exploring Superpower Design Through Wi-Fi TwingeProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633352(1-16)Online publication date: 11-Feb-2024
    • (2024)PneuMa: Designing Pneumatic Bodily Extensions for Supporting Movement in Everyday LifeProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633349(1-16)Online publication date: 11-Feb-2024
    • (2024)PneuMa: Designing Pneumatic Bodily Extensions for Supporting Movement in Everyday LifeExtended Abstracts of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613905.3649125(1-4)Online publication date: 11-May-2024
    • (2024)Paired-EMS: Enhancing Electrical Muscle Stimulation (EMS)-based Force Feedback Experience by Stimulating Both Muscles in Antagonistic PairsProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642841(1-7)Online publication date: 11-May-2024
    • (2024)Motionless Movement: Towards Vibrotactile Kinesthetic DisplaysProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642499(1-16)Online publication date: 11-May-2024
    • (2024)Fingerhinter Takes Center Stage: User Experience Insights from Informal Encounters with a Finger-Augmentation Device2024 IEEE International Conference on Artificial Intelligence and eXtended and Virtual Reality (AIxVR)10.1109/AIxVR59861.2024.00044(265-269)Online publication date: 17-Jan-2024
    • Show More Cited By

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media