research-article

DualRing: Enabling Subtle and Expressive Hand Interaction with Dual IMU Rings

Authors:

Yuanchun ShiAuthors Info & Claims

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, Volume 5, Issue 3

Article No.: 115, Pages 1 - 27

https://doi.org/10.1145/3478114

Published: 14 September 2021 Publication History

Abstract

We present DualRing, a novel ring-form input device that can capture the state and movement of the user's hand and fingers. With two IMU rings attached to the user's thumb and index finger, DualRing can sense not only the absolute hand gesture relative to the ground but also the relative pose and movement among hand segments. To enable natural thumb-to-finger interaction, we develop a high-frequency AC circuit for on-body contact detection. Based on the sensing information of DualRing, we outline the interaction space and divide it into three sub-spaces: within-hand interaction, hand-to-surface interaction, and hand-to-object interaction. By analyzing the accuracy and performance of our system, we demonstrate the informational advantage of DualRing in sensing comprehensive hand gestures compared with single-ring-based solutions. Through the user study, we discovered the interaction space enabled by DualRing is favored by users for its usability, efficiency, and novelty.

Supplementary Material

liang (liang.zip)

Supplemental movie, appendix, image and software files for, DualRing: Enabling Subtle and Expressive Hand Interaction with Dual IMU Rings

Download
75.57 MB

References

[1]

Daniel Ashbrook, Carlos Tejada, Dhwanit Mehta, Anthony Jiminez, Goudam Muralitharam, Sangeeta Gajendra, and Ross Tallents. 2016. Bitey: An Exploration of Tooth Click Gestures for Hands-Free User Interface Control. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (Florence, Italy) (MobileHCI '16). Association for Computing Machinery, New York, NY, USA, 158--169. https://doi.org/10.1145/2935334.2935389

Digital Library

[2]

Joanna Bergström and Kasper Hornbæk. 2019. Human-Computer Interaction on the Skin. ACM Comput. Surv. 52, 4, Article 77 (Aug. 2019), 14 pages. https://doi.org/10.1145/3332166

Digital Library

[3]

Alex Butler, Shahram Izadi, and Steve Hodges. 2008. SideSight: Multi-"Touch" Interaction Around Small Devices. In Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology (Monterey, CA, USA) (UIST '08). ACM, New York, NY, USA, 201--204. https://doi.org/10.1145/1449715.1449746

Digital Library

[4]

Liwei Chan, Yi-Ling Chen, Chi-Hao Hsieh, Rong-Hao Liang, and Bing-Yu Chen. 2015. CyclopsRing: Enabling Whole-Hand and Context-Aware Interactions Through a Fisheye Ring. https://doi.org/10.1145/2807442.2807450

[5]

Liwei Chan, Rong-Hao Liang, Ming-Chang Tsai, Kai-Yin Cheng, Chao-Huai Su, Mike Y. Chen, Wen-Huang Cheng, and Bing-Yu Chen. 2013. FingerPad: Private and Subtle Interaction Using Fingertips. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (St. Andrews, Scotland, United Kingdom) (UIST '13). Association for Computing Machinery, New York, NY, USA, 255--260. https://doi.org/10.1145/2501988.2502016

Digital Library

[6]

Wook Chang, Kee Eung Kim, and Hyunjeong Lee. 2006. Recognition of Grip-Patterns by Using Capacitive Touch Sensors. 4 (2006), 2936--2941.

[7]

Ke-Yu Chen, Shwetak N. Patel, and Sean Keller. 2016. Finexus: Tracking Precise Motions of Multiple Fingertips Using Magnetic Sensing. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (San Jose, California, USA) (CHI '16). Association for Computing Machinery, New York, NY, USA, 1504--1514. https://doi.org/10.1145/2858036.2858125

Digital Library

[8]

Ashley Colley, Virve Inget, Inka Rantala, and Jonna Häkkilä. 2017. Investigating Interaction with a Ring Form Factor. In Proceedings of the 16th International Conference on Mobile and Ubiquitous Multimedia (Stuttgart, Germany) (MUM '17). Association for Computing Machinery, New York, NY, USA, 107--111. https://doi.org/10.1145/3152832.3152870

Digital Library

[9]

Barrett Ens, Ahmad Byagowi, Teng Han, Juan David Hincapié-Ramos, and Pourang Irani. 2016. Combining Ring Input with Hand Tracking for Precise, Natural Interaction with Spatial Analytic Interfaces. In Proceedings of the 2016 Symposium on Spatial User Interaction (Tokyo, Japan) (SUI '16). Association for Computing Machinery, New York, NY, USA, 99--102. https://doi.org/10.1145/2983310.2985757

Digital Library

[10]

Masaaki Fukumoto and Yasuhito Suenaga. 1994. "FingeRing": A Full-Time Wearable Interface. In Conference Companion on Human Factors in Computing Systems (Boston, Massachusetts, USA) (CHI '94). Association for Computing Machinery, New York, NY, USA, 81--82. https://doi.org/10.1145/259963.260056

Digital Library

[11]

Jun Gong, Yang Zhang, Xia Zhou, and Xing-Dong Yang. 2017. Pyro: Thumb-Tip Gesture Recognition Using Pyroelectric Infrared Sensing. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (Québec City, QC, Canada) (UIST '17). Association for Computing Machinery, New York, NY, USA, 553--563. https://doi.org/10.1145/3126594.3126615

Digital Library

[12]

Changzhan Gu and Jaime Lien. 2017. A Two-Tone Radar Sensor for Concurrent Detection of Absolute Distance and Relative Movement for Gesture Sensing. IEEE Sensors Letters 1, 3 (2017), 1--4. https://doi.org/10.1109/LSENS.2017.2696520

[13]

Yizheng Gu, Chun Yu, Zhipeng Li, Weiqi Li, Shuchang Xu, Xiaoying Wei, and Yuanchun Shi. 2019. Accurate and Low-Latency Sensing of Touch Contact on Any Surface with Finger-Worn IMU Sensor. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST '19). Association for Computing Machinery, New York, NY, USA, 1059--1070. https://doi.org/10.1145/3332165.3347947

Digital Library

[14]

Yizheng Gu, Chun Yu, Zhipeng Li, Zhaoheng Li, Xiaoying Wei, and Yuanchun Shi. 2020. QwertyRing: Text Entry on Physical Surfaces Using a Ring. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 4, 4, Article 128 (Dec. 2020), 29 pages. https://doi.org/10.1145/3432204

Digital Library

[15]

Chris Harrison, Desney Tan, and Dan Morris. 2010. Skinput: Appropriating the Body as an Input Surface. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Atlanta, Georgia, USA) (CHI '10). Association for Computing Machinery, New York, NY, USA, 453--462. https://doi.org/10.1145/1753326.1753394

Digital Library

[16]

Sandra G Hart and Lowell E Staveland. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Advances in psychology. Vol. 52. Elsevier, 139--183.

[17]

Christian Holz, Tovi Grossman, George Fitzmaurice, and Anne Agur. 2012. Implanted User Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI '12). Association for Computing Machinery, New York, NY, USA, 503--512. https://doi.org/10.1145/2207676.2207745

Digital Library

[18]

Hsin-Liu (Cindy) Kao, Christian Holz, Asta Roseway, Andres Calvo, and Chris Schmandt. 2016. DuoSkin: Rapidly Prototyping on-Skin User Interfaces Using Skin-Friendly Materials. In Proceedings of the 2016 ACM International Symposium on Wearable Computers (Heidelberg, Germany) (ISWC '16). Association for Computing Machinery, New York, NY, USA, 16--23. https://doi.org/10.1145/2971763.2971777

Digital Library

[19]

Naoaki Kashiwagi, Yuta Sugiura, Natsuki Miyata, Mitsunori Tada, Maki Sugimoto, and Hideo Saito. 2017. Measuring Grasp Posture Using an Embedded Camera. In Applications of Computer Vision Workshops. 42--47.

[20]

Wolf Kienzle and Ken Hinckley. 2014. LightRing: Always-Available 2D Input on Any Surface. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (Honolulu, Hawaii, USA) (UIST '14). Association for Computing Machinery, New York, NY, USA, 157--160. https://doi.org/10.1145/2642918.2647376

Digital Library

[21]

Jonghwa Kim, Stephan Mastnik, and Elisabeth André. 2008. EMG-Based Hand Gesture Recognition for Realtime Biosignal Interfacing. In Proceedings of the 13th International Conference on Intelligent User Interfaces (Gran Canaria, Spain) (IUI '08). Association for Computing Machinery, New York, NY, USA, 30--39. https://doi.org/10.1145/1378773.1378778

Digital Library

[22]

Roman V. Krems. 2018. Direction Cosine Matrix.

[23]

Gierad Laput, Robert Xiao, and Chris Harrison. 2016. ViBand: High-Fidelity Bio-Acoustic Sensing Using Commodity Smartwatch Accelerometers. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST '16). Association for Computing Machinery, New York, NY, USA, 321--333. https://doi.org/10.1145/2984511.2984582

Digital Library

[24]

Chen Liang, Chun Yu, Xiaoying Wei, Xuhai Xu, Yongquan Hu, Yuntao Wang, and Yuanchun Shi. 2021. Auth+Track: Enabling Authentication Free Interaction on Smartphone by Continuous User Tracking. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3411764.3445624

Digital Library

[25]

Jaime Lien, Nicholas Gillian, M. Emre Karagozler, Patrick Amihood, Carsten Schwesig, Erik Olson, Hakim Raja, and Ivan Poupyrev. 2016. Soli: Ubiquitous Gesture Sensing with Millimeter Wave Radar. ACM Trans. Graph. 35, 4, Article 142 (July 2016), 19 pages. https://doi.org/10.1145/2897824.2925953

Digital Library

[26]

Shu-Yang Lin, Chao-Huai Su, Kai-Yin Cheng, Rong-Hao Liang, Tzu-Hao Kuo, and Bing-Yu Chen. 2011. Pub - Point upon Body: Exploring Eyes-Free Interaction and Methods on an Arm. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (Santa Barbara, California, USA) (UIST '11). Association for Computing Machinery, New York, NY, USA, 481--488. https://doi.org/10.1145/2047196.2047259

Digital Library

[27]

Guanhong Liu, Yizheng Gu, Yiwen Yin, Chun Yu, Yuntao Wang, Haipeng Mi, and Yuanchun Shi. 2020. Keep the Phone in Your Pocket: Enabling Smartphone Operation with an IMU Ring for Visually Impaired People. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 4, 2, Article 58 (June 2020), 23 pages. https://doi.org/10.1145/3397308

Digital Library

[28]

Yilin Liu, Shijia Zhang, and Mahanth Gowda. 2021. NeuroPose: 3D Hand Pose Tracking Using EMG Wearables. In Proceedings of the Web Conference 2021 (Ljubljana, Slovenia) (WWW '21). Association for Computing Machinery, New York, NY, USA, 1471--1482. https://doi.org/10.1145/3442381.3449890

Digital Library

[29]

Yiqin Lu, Bingjian Huang, Chun Yu, Guahong Liu, and Yuanchun Shi. 2020. Designing and Evaluating Hand-to-Hand Gestures with Dual Commodity Wrist-Worn Devices. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 4, 1, Article 20 (March 2020), 27 pages. https://doi.org/10.1145/3380984

Digital Library

[30]

Franziska Mueller, Florian Bernard, Oleksandr Sotnychenko, Dushyant Mehta, Srinath Sridhar, Dan Casas, and Christian Theobalt. 2018. Ganerated hands for real-time 3d hand tracking from monocular RGB. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 49--59.

[31]

Adiyan Mujibiya, Xiang Cao, Desney S. Tan, Dan Morris, Shwetak N. Patel, and Jun Rekimoto. 2013. The Sound of Touch: On-Body Touch and Gesture Sensing Based on Transdermal Ultrasound Propagation. In Proceedings of the 2013 ACM International Conference on Interactive Tabletops and Surfaces (St. Andrews, Scotland, United Kingdom) (ITS '13). Association for Computing Machinery, New York, NY, USA, 189--198. https://doi.org/10.1145/2512349.2512821

Digital Library

[32]

Jakub Nalepa and Michal Kawulok. 2014. Fast and Accurate Hand Shape Classification. In Beyond Databases, Architectures, and Structures, Stanislaw Kozielski, Dariusz Mrozek, Pawel Kasprowski, Bozena Malysiak-Mrozek, and Daniel Kostrzewa (Eds.). Communications in Computer and Information Science, Vol. 424. Springer, 364--373. https://doi.org/10.1007/978-3-319-06932-6_35

[33]

Pedro L. D. Peres, Ivanil S. Bonatti, and Amauri Lopes. 1998. Transmission Line Modeling: A Circuit Theory Approach. Siam Review 40, 2 (1998), 347--352.

Digital Library

[34]

Munehiko Sato, Ivan Poupyrev, and Chris Harrison. 2012. Touché: Enhancing Touch Interaction on Humans, Screens, Liquids, and Everyday Objects. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI '12). Association for Computing Machinery, New York, NY, USA, 483--492. https://doi.org/10.1145/2207676.2207743

Digital Library

[35]

Yilei Shi, Haimo Zhang, Kaixing Zhao, Jiashuo Cao, Mengmeng Sun, and Suranga Nanayakkara. 2020. Ready, Steady, Touch! Sensing Physical Contact with a Finger-Mounted IMU. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 4, 2, Article 59 (June 2020), 25 pages. https://doi.org/10.1145/3397309

Digital Library

[36]

A. Sinha, C. Choi, and K. Ramani. 2016. DeepHand: Robust Hand Pose Estimation by Completing a Matrix Imputed with Deep Features. In 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Vol. 00. 4150--4158. https://doi.org/10.1109/CVPR.2016.450

[37]

Mohamed Soliman, Franziska Mueller, Lena Hegemann, Joan Sol Roo, Christian Theobalt, and Jürgen Steimle. 2018. FingerInput: Capturing Expressive Single-Hand Thumb-to-Finger Microgestures. In Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces (Tokyo, Japan) (ISS '18). Association for Computing Machinery, New York, NY, USA, 177--187. https://doi.org/10.1145/3279778.3279799

Digital Library

[38]

D. Tang, J. Taylor, P. Kohli, C. Keskin, T. Kim, and J. Shotton. 2015. Opening the Black Box: Hierarchical Sampling Optimization for Estimating Human Hand Pose. In 2015 IEEE International Conference on Computer Vision (ICCV). 3325--3333. https://doi.org/10.1109/ICCV.2015.380

[39]

Hsin-Ruey Tsai, Min-Chieh Hsiu, Jui-Chun Hsiao, Lee-Ting Huang, Mike Chen, and Yi-Ping Hung. 2016. TouchRing: Subtle and Always-Available Input Using a Multi-Touch Ring. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (Florence, Italy) (MobileHCI '16). Association for Computing Machinery, New York, NY, USA, 891--898. https://doi.org/10.1145/2957265.2961860

Digital Library

[40]

Hsin-Ruey Tsai, Cheng-Yuan Wu, Lee-Ting Huang, and Yi-Ping Hung. 2016. ThumbRing: Private Interactions Using One-Handed Thumb Motion Input on Finger Segments. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (Florence, Italy) (MobileHCI '16). Association for Computing Machinery, New York, NY, USA, 791--798. https://doi.org/10.1145/2957265.2961859

Digital Library

[41]

Saiwen Wang, Jie Song, Jaime Lien, Ivan Poupyrev, and Otmar Hilliges. 2016. Interacting with Soli: Exploring Fine-Grained Dynamic Gesture Recognition in the Radio-Frequency Spectrum. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (Tokyo, Japan) (UIST '16). Association for Computing Machinery, New York, NY, USA, 851--860. https://doi.org/10.1145/2984511.2984565

Digital Library

[42]

Yuntao Wang, Ke Sun, Lu Sun, Chun Yu, and Yuanchun Shi. 2016. SkinMotion: What Does Skin Movement Tell Us?. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct (Heidelberg, Germany) (UbiComp '16). Association for Computing Machinery, New York, NY, USA, 914--917. https://doi.org/10.1145/2968219.2979132

Digital Library

[43]

Y. Wang, C. Yu, L. Du, J. Huang, and Y. Shi. 2014. BodyRC: Exploring Interaction Modalities Using Human Body as Lossy Signal Transmission Medium. In 2014 IEEE 11th Intl Conf on Ubiquitous Intelligence and Computing and 2014 IEEE 11th Intl Conf on Autonomic and Trusted Computing and 2014 IEEE 14th Intl Conf on Scalable Computing and Communications and Its Associated Workshops. 260--267.

[44]

Martin Weigel, Aditya Shekhar Nittala, Alex Olwal, and Jürgen Steimle. 2017. SkinMarks: Enabling Interactions on Body Landmarks Using Conformal Skin Electronics. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (Denver, Colorado, USA) (CHI '17). Association for Computing Machinery, New York, NY, USA, 3095--3105. https://doi.org/10.1145/3025453.3025704

Digital Library

[45]

G. Welch. 2001. Kalman Filter. Siggraph Tutorial (2001).

[46]

Yueting Weng, Chun Yu, Yingtian Shi, Yuhang Zhao, Yukang Yan, and Yuanchun Shi. 2021. FaceSight: Enabling Hand-to-Face Gesture Interaction on AR Glasses with a Downward-Facing Camera Vision. Association for Computing Machinery, New York, NY, USA. https://doi.org/10.1145/3411764.3445484

[47]

Eric Whitmire, Mohit Jain, Divye Jain, Greg Nelson, Ravi Karkar, Shwetak Patel, and Mayank Goel. 2017. DigiTouch: Reconfigurable Thumb-to-Finger Input and Text Entry on Head-Mounted Displays. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 113 (Sept. 2017), 21 pages. https://doi.org/10.1145/3130978

Digital Library

[48]

Mathias Wilhelm, Daniel Krakowczyk, Frank Trollmann, and Sahin Albayrak. 2015. ERing: Multiple Finger Gesture Recognition with One Ring Using an Electric Field. In Proceedings of the 2nd International Workshop on Sensor-Based Activity Recognition and Interaction (Rostock, Germany) (iWOAR '15). Association for Computing Machinery, New York, NY, USA, Article 7, 6 pages. https://doi.org/10.1145/2790044.2790047

Digital Library

[49]

Erwin Wu, Ye Yuan, Hui-Shyong Yeo, Aaron Quigley, Hideki Koike, and Kris M. Kitani. 2020. Back-Hand-Pose: 3D Hand Pose Estimation for a Wrist-Worn Camera via Dorsum Deformation Network. Association for Computing Machinery, New York, NY, USA, 1147--1160. https://doi.org/10.1145/3379337.3415897

[50]

Chi Xu, Lakshmi Narasimhan Govindarajan, Yu Zhang, and Li Cheng. 2016. Lie-X: Depth Image Based Articulated Object Pose Estimation, Tracking, and Action Recognition on Lie Groups. CoRR abs/1609.03773 (2016). arXiv:1609.03773 http://arxiv.org/abs/1609.03773

[51]

Xuhai Xu, Haitian Shi, Xin Yi, WenJia Liu, Yukang Yan, Yuanchun Shi, Alex Mariakakis, Jennifer Mankoff, and Anind K. Dey. 2020. EarBuddy: Enabling On-Face Interaction via Wireless Earbuds. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--14. https://doi.org/10.1145/3313831.3376836

Digital Library

[52]

Zheer Xu, Weihao Chen, Dongyang Zhao, Jiehui Luo, Te-Yen Wu, Jun Gong, Sicheng Yin, Jialun Zhai, and Xing-Dong Yang. 2020. BiTipText: Bimanual Eyes-Free Text Entry on a Fingertip Keyboard. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--13. https://doi.org/10.1145/3313831.3376306

Digital Library

[53]

Zheer Xu, Pui Chung Wong, Jun Gong, Te-Yen Wu, Aditya Shekhar Nittala, Xiaojun Bi, Jürgen Steimle, Hongbo Fu, Kening Zhu, and Xing-Dong Yang. 2019. TipText: Eyes-Free Text Entry on a Fingertip Keyboard. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST '19). Association for Computing Machinery, New York, NY, USA, 883--899. https://doi.org/10.1145/3332165.3347865

Digital Library

[54]

Yui-Pan Yau, Lik Hang Lee, Zheng Li, Tristan Braud, Yi-Hsuan Ho, and Pan Hui. 2020. How Subtle Can It Get? A Trimodal Study of Ring-Sized Interfaces for One-Handed Drone Control. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 4, 2, Article 63 (June 2020), 29 pages. https://doi.org/10.1145/3397319

Digital Library

[55]

Chun Yu, Xiaoying Wei, Shubh Vachher, Yue Qin, Chen Liang, Yueting Weng, Yizheng Gu, and Yuanchun Shi. 2019. HandSee: Enabling Full Hand Interaction on Smartphone with Front Camera-Based Stereo Vision. Association for Computing Machinery, New York, NY, USA, 1--13. https://doi.org/10.1145/3290605.3300935

Digital Library

[56]

Cheng Zhang, Anandghan Waghmare, Pranav Kundra, Yiming Pu, Scott Gilliland, Thomas Ploetz, Thad E. Starner, Omer T. Inan, and Gregory D. Abowd. 2017. FingerSound: Recognizing Unistroke Thumb Gestures Using a Ring. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 1, 3, Article 120 (Sept. 2017), 19 pages. https://doi.org/10.1145/3130985

Digital Library

[57]

Xu Zhang, Xiang Chen, Wen-hui Wang, Ji-hai Yang, Vuokko Lantz, and Kong-qiao Wang. 2009. Hand Gesture Recognition and Virtual Game Control Based on 3D Accelerometer and EMG Sensors. In Proceedings of the 14th International Conference on Intelligent User Interfaces (Sanibel Island, Florida, USA) (IUI '09). Association for Computing Machinery, New York, NY, USA, 401--406. https://doi.org/10.1145/1502650.1502708

Digital Library

[58]

Yang Zhang, Wolf Kienzle, Yanjun Ma, Shiu S. Ng, Hrvoje Benko, and Chris Harrison. 2019. ActiTouch: Robust Touch Detection for On-Skin AR/VR Interfaces. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology (New Orleans, LA, USA) (UIST '19). Association for Computing Machinery, New York, NY, USA, 1151--1159. https://doi.org/10.1145/3332165.3347869

Digital Library

Cited By

Chaffangeon Caillet AGoguey ANigay L(2025)Microgesture ＋ GraspInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103398195:COnline publication date: 1-Jan-2025
https://dl.acm.org/doi/10.1016/j.ijhcs.2024.103398
Zhang ZSong DZhou AMa H(2024)airTac: A Contactless Digital Tactile Receptor for Detecting Material and Roughness via Terahertz SensingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785868:3(1-37)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678586
Kim DWhitmire EBoldu RKienzle WBenko HKostakos VKay JHoang T(2024)SoundScroll: Robust Finger Slide Detection Using Friction Sound and Wrist-Worn MicrophonesProceedings of the 2024 ACM International Symposium on Wearable Computers10.1145/3675095.3676614(63-70)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675095.3676614
Show More Cited By

Index Terms

DualRing: Enabling Subtle and Expressive Hand Interaction with Dual IMU Rings
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
    2. Interaction techniques
      1. Gestural input

Recommendations

Physically based grasping and manipulation method using pre-contact grasping quality measure
VRST '09: Proceedings of the 16th ACM Symposium on Virtual Reality Software and Technology

While the human hand is the most natural tool for interacting with objects, hand interaction with virtual objects is still a challenging research field. We recognize that common hand interaction involves two separate stages with different aspects: One ...
Hand with Sensing Sphere: Body-Centered Spatial Interactions with a Hand-Worn Spherical Camera
SUI '20: Proceedings of the 2020 ACM Symposium on Spatial User Interaction

We propose a novel body-centered interaction system making use of a spherical camera attached to a hand. Its broad and unique field of view enables an all-in-one approach to sensing multiple pieces of contextual information in hand-based spatial ...
Influence of hand representation on a grasping task in augmented reality
ICMI '23: Proceedings of the 25th International Conference on Multimodal Interaction

Research has shown that modifying the aspect of the virtual hand in immersive virtual reality can convey objects properties to users. Whether we can achieve the same results in augmented reality is still to be determined since the user’s real hand is ...

Comments

Information & Contributors

Information

Published In

cover image Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies Volume 5, Issue 3

Sept 2021

1443 pages

EISSN:2474-9567

DOI:10.1145/3486621

Issue’s Table of Contents

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 September 2021

Published in IMWUT Volume 5, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Funding Sources

Natural Science Foundation of China
National Key R&D Program of China

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

38
Total Citations
View Citations
1,243
Total Downloads

Downloads (Last 12 months)313
Downloads (Last 6 weeks)36

Reflects downloads up to 03 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Chaffangeon Caillet AGoguey ANigay L(2025)Microgesture ＋ GraspInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2024.103398195:COnline publication date: 1-Jan-2025
https://dl.acm.org/doi/10.1016/j.ijhcs.2024.103398
Zhang ZSong DZhou AMa H(2024)airTac: A Contactless Digital Tactile Receptor for Detecting Material and Roughness via Terahertz SensingProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36785868:3(1-37)Online publication date: 9-Sep-2024
https://dl.acm.org/doi/10.1145/3678586
Kim DWhitmire EBoldu RKienzle WBenko HKostakos VKay JHoang T(2024)SoundScroll: Robust Finger Slide Detection Using Friction Sound and Wrist-Worn MicrophonesProceedings of the 2024 ACM International Symposium on Wearable Computers10.1145/3675095.3676614(63-70)Online publication date: 5-Oct-2024
https://dl.acm.org/doi/10.1145/3675095.3676614
Li ZQi WChen JZhang YShu YLiu JTan RHe YChen J(2024)Poster Abstract: Liquid Identification via Container Acoustic ResonanceProceedings of the 22nd ACM Conference on Embedded Networked Sensor Systems10.1145/3666025.3699403(851-852)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3666025.3699403
Li ZLuo WZhang YChen JShu YZhang YShu YLiu JTan RHe YChen J(2024)ASLiquid: Non-Intrusive Liquid Counterfeit Identification with Your EarphonesProceedings of the 22nd ACM Conference on Embedded Networked Sensor Systems10.1145/3666025.3699321(41-53)Online publication date: 4-Nov-2024
https://dl.acm.org/doi/10.1145/3666025.3699321
Takahashi RWhitmire EBoldu RNg SKienzle WBenko H(2024)picoRing: battery-free rings for subtle thumb-to-index inputProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676365(1-11)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676365
Chen BNolan JZhang XGanesan DLane NShi W(2024)MetaBioLiq: A Wearable Passive Metasurface Aided mmWave Sensing Platform for BioFluidsProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3690687(1192-1206)Online publication date: 4-Dec-2024
https://dl.acm.org/doi/10.1145/3636534.3690687
Lin CWang ZXiong JLi FWu GGanesan DLane NShi W(2024)Fine-grained Textile Moisture Sensing with Commodity UWBProceedings of the 30th Annual International Conference on Mobile Computing and Networking10.1145/3636534.3690679(1074-1088)Online publication date: 4-Dec-2024
https://dl.acm.org/doi/10.1145/3636534.3690679
Wang XFan GDing RJin HHao WTao M(2024)Water Salinity Sensing with UAV-Mounted IR-UWB RadarACM Transactions on Sensor Networks10.1145/363351520:4(1-37)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3633515
Chang LYang XLiu RXie GWang FWang J(2024)FSS-TagProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314577:4(1-24)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631457
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Issue’s Table of Contents