Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3654777.3676344acmotherconferencesArticle/Chapter ViewAbstractPublication PagesuistConference Proceedingsconference-collections
research-article
Open access

TouchpadAnyWear: Textile-Integrated Tactile Sensors for Multimodal High Spatial-Resolution Touch Inputs with Motion Artifacts Tolerance

Published: 11 October 2024 Publication History

Abstract

This paper presents TouchpadAnyWear, a novel family of textile-integrated force sensors capable of multi-modal touch input, encompassing micro-gesture detection, two-dimensional (2D) continuous input, and force-sensitive strokes. This thin (<1.5 mm) and conformal device features high spatial resolution sensing and motion artifact tolerance through its unique capacitive sensor architecture. The sensor consists of a knitted textile compressive core, sandwiched by stretchable silver electrodes, and conductive textile shielding layers on both sides. With a high-density sensor pixel array (25/cm2), TouchpadAnyWear can detect touch input locations and sizes with millimeter-scale spatial resolution and a wide range of force inputs (0.05 N to 20 N). The incorporation of miniature polymer domes, referred to as “poly-islands”, onto the knitted textile locally stiffens the sensing areas, thereby reducing motion artifacts during deformation. These poly-islands also provide passive tactile feedback to users, allowing for eyes-free localization of the active sensing pixels. Design choices and sensor performance are evaluated using in-depth mechanical characterization. Demonstrations include an 8-by-8 grid sensor as a miniature high-resolution touchpad and a T-shaped sensor for thumb-to-finger micro-gesture input. User evaluations validate the effectiveness and usability of TouchpadAnyWear in daily interaction contexts, such as tapping, forceful pressing, swiping, 2D cursor control, and 2D stroke-based gestures. This paper further discusses potential applications and explorations for TouchpadAnyWear in wearable smart devices, gaming, and augmented reality devices.

Supplemental Material

MP4 File
Video Figure

References

[1]
Roland Aigner, Andreas Pointner, Thomas Preindl, Patrick Parzer, and Michael Haller. 2020. Embroidered resistive pressure sensors: A novel approach for textile interfaces. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems. 1–13.
[2]
Asli Atalay, Vanessa Sanchez, Ozgur Atalay, Daniel M Vogt, Florian Haufe, Robert J Wood, and Conor J Walsh. 2017. Batch fabrication of customizable silicone-textile composite capacitive strain sensors for human motion tracking. Advanced Materials Technologies 2, 9 (2017), 1700136.
[3]
G. Bradski. 2000. The OpenCV Library. Dr. Dobb’s Journal of Software Tools (2000).
[4]
Tian Carey, Stefania Cacovich, Giorgio Divitini, Jiesheng Ren, Aida Mansouri, Jong M Kim, Chaoxia Wang, Caterina Ducati, Roman Sordan, and Felice Torrisi. 2017. Fully inkjet-printed two-dimensional material field-effect heterojunctions for wearable and textile electronics. Nature communications 8, 1 (2017), 1–11.
[5]
Géry Casiez, Nicolas Roussel, and Daniel Vogel. 2012. 1€ filter: a simple speed-based low-pass filter for noisy input in interactive systems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2527–2530.
[6]
Liwei Chan, Rong-Hao Liang, Ming-Chang Tsai, Kai-Yin Cheng, Chao-Huai Su, Mike Y. Chen, Wen-Huang Cheng, and Bing-Yu Chen. 2013. FingerPad: private and subtle interaction using fingertips. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (St. Andrews, Scotland, United Kingdom) (UIST ’13). Association for Computing Machinery, New York, NY, USA, 255–260. https://doi.org/10.1145/2501988.2502016
[7]
Tingyu Cheng, Zhihan Zhang, Bingrui Zong, Yuhui Zhao, Zekun Chang, Yejun Kim, Clement Zheng, Gregory D Abowd, and HyunJoo Oh. 2023. SwellSense: Creating 2.5 D interactions with micro-capsule paper. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–13.
[8]
Rajkumar Darbar, Prasanta Kr Sen, and Debasis Samanta. 2016. PressTact: Side pressure-based input for smartwatch interaction. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems. 2431–2438.
[9]
Sarah J Dempsey, Marek Szablewski, and Del Atkinson. 2015. Tactile sensing in human–computer interfaces: The inclusion of pressure sensitivity as a third dimension of user input. Sensors and Actuators A: Physical 232 (2015), 229–250.
[10]
Minpyo Kang, Jejung Kim, Bongkyun Jang, Youngcheol Chae, Jae-Hyun Kim, and Jong-Hyun Ahn. 2017. Graphene-based three-dimensional capacitive touch sensor for wearable electronics. ACS nano 11, 8 (2017), 7950–7957.
[11]
Hsin-Liu Kao, Artem Dementyev, Joseph A Paradiso, and Chris Schmandt. 2015. NailO: fingernails as an input surface. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 3015–3018.
[12]
Thorsten Karrer, Moritz Wittenhagen, Leonhard Lichtschlag, Florian Heller, and Jan Borchers. 2011. Pinstripe: eyes-free continuous input on interactive clothing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 1313–1322.
[13]
Daehwa Kim and Chris Harrison. 2022. EtherPose: Continuous hand pose tracking with wrist-worn antenna impedance characteristic sensing. In Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology. 1–12.
[14]
David Kim, Otmar Hilliges, Shahram Izadi, Alex D Butler, Jiawen Chen, Iason Oikonomidis, and Patrick Olivier. 2012. Digits: freehand 3D interactions anywhere using a wrist-worn gloveless sensor. In Proceedings of the 25th annual ACM symposium on User interface software and technology. 167–176.
[15]
Riku Kitamura, Takumi Yamamoto, and Yuta Sugiura. 2023. TouchLog: Finger Micro Gesture Recognition Using Photo-Reflective Sensors. In Proceedings of the 2023 ACM International Symposium on Wearable Computers. 92–97.
[16]
Jacob Kornerup and Taylor Hall. 1994. Mapping powerlists onto hypercubes. Univ., Department of Computer Sciences.
[17]
Weilun Li, Zhili Xiao, Junyi Zhao, Kenji Aono, Stephanie Pizzella, Zichao Wen, Yong Wang, Chuan Wang, and Shantanu Chakrabartty. 2023. A portable and a scalable multi-channel wireless recording system for wearable electromyometrial imaging. IEEE Transactions on Biomedical Circuits and Systems (2023).
[18]
Weilun Li, Junyi Zhao, Yong Wang, Chuan Wang, and Shantanu Chakrabartty. 2024. A Low-Power Impedance-to-Frequency Converter for Frequency-Multiplexed Wearable Sensors. IEEE Transactions on Biomedical Circuits and Systems (2024).
[19]
Li-Wei Lo, Junyi Zhao, Kenji Aono, Weilun Li, Zichao Wen, Stephanie Pizzella, Yong Wang, Shantanu Chakrabartty, and Chuan Wang. 2022. Stretchable sponge electrodes for long-term and motion-artifact-tolerant recording of high-quality electrophysiologic signals. ACS nano 16, 8 (2022), 11792–11801.
[20]
Li-Wei Lo, Junyi Zhao, Haochuan Wan, Yong Wang, Shantanu Chakrabartty, and Chuan Wang. 2021. An inkjet-printed PEDOT: PSS-based stretchable conductor for wearable health monitoring device applications. ACS Applied Materials & Interfaces 13, 18 (2021), 21693–21702.
[21]
Li-Wei Lo, Junyi Zhao, Haochuan Wan, Yong Wang, Shantanu Chakrabartty, and Chuan Wang. 2022. A soft sponge sensor for multimodal sensing and distinguishing of pressure, strain, and temperature. ACS Applied Materials & Interfaces 14, 7 (2022), 9570–9578.
[22]
Yiyue Luo, Kui Wu, Tomás Palacios, and Wojciech Matusik. 2021. KnitUI: Fabricating interactive and sensing textiles with machine knitting. In Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. 1–12.
[23]
Yiyue Luo, Junyi Zhu, Kui Wu, Cedric Honnet, Stefanie Mueller, and Wojciech Matusik. 2023. MagKnitic: Machine-knitted Passive and Interactive Haptic Textiles with Integrated Binary Sensing. In Proceedings of the 36th Annual ACM Symposium on User Interface Software and Technology. 1–13.
[24]
Eric J Markvicka, Michael D Bartlett, Xiaonan Huang, and Carmel Majidi. 2018. An autonomously electrically self-healing liquid metal–elastomer composite for robust soft-matter robotics and electronics. Nature materials 17, 7 (2018), 618–624.
[25]
Jagan Singh Meena, Su Bin Choi, Tran Duc Khanh, Hyun Sik Shin, Jun Sang Choi, Jinho Joo, and Jong-Woong Kim. 2023. Highly stretchable and robust textile-based capacitive mechanical sensor for human motion detection. Applied Surface Science 613 (2023), 155961.
[26]
Viet Nguyen, Siddharth Rupavatharam, Luyang Liu, Richard Howard, and Marco Gruteser. 2019. HandSense: capacitive coupling-based dynamic, micro finger gesture recognition. In Proceedings of the 17th Conference on Embedded Networked Sensor Systems (New York, New York) (SenSys ’19). Association for Computing Machinery, New York, NY, USA, 285–297. https://doi.org/10.1145/3356250.3360040
[27]
Farshid Salemi Parizi, Eric Whitmire, and Shwetak Patel. 2019. Auraring: Precise electromagnetic finger tracking. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 3, 4 (2019), 1–28.
[28]
Pornthep Preechayasomboon. [n. d.]. Bricklayer - Experiment Structures for User Studies in Unity. https://github.com/prnthp/experiment-structures
[29]
Christian Rendl, Patrick Greindl, Kathrin Probst, Martin Behrens, and Michael Haller. 2014. Presstures: exploring pressure-sensitive multi-touch gestures on trackpads. In Proceedings of the SIGCHI conference on human factors in computing systems. 431–434.
[30]
Mohamed Soliman, Franziska Mueller, Lena Hegemann, Joan Sol Roo, Christian Theobalt, and Jürgen Steimle. 2018. FingerInput: Capturing Expressive Single-Hand Thumb-to-Finger Microgestures. In Proceedings of the 2018 ACM International Conference on Interactive Surfaces and Spaces (Tokyo, Japan) (ISS ’18). Association for Computing Machinery, New York, NY, USA, 177–187. https://doi.org/10.1145/3279778.3279799
[31]
Paul Strohmeier, Jarrod Knibbe, Sebastian Boring, and Kasper Hornbæk. 2018. zPatch: Hybrid resistive/capacitive etextile input. In Proceedings of the Twelfth International Conference on Tangible, Embedded, and Embodied Interaction. 188–198.
[32]
Hsin-Ruey Tsai, Cheng-Yuan Wu, Lee-Ting Huang, and Yi-Ping Hung. 2016. ThumbRing: private interactions using one-handed thumb motion input on finger segments. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (Florence, Italy) (MobileHCI ’16). Association for Computing Machinery, New York, NY, USA, 791–798. https://doi.org/10.1145/2957265.2961859
[33]
Radu-Daniel Vatavu, Lisa Anthony, and Jacob O Wobbrock. 2018. $Q: A super-quick, articulation-invariant stroke-gesture recognizer for low-resource devices. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services. 1–12.
[34]
Chi Cuong Vu and Jooyong Kim. 2020. Simultaneous sensing of touch and pressure by using highly elastic e-fabrics. Applied Sciences 10, 3 (2020), 989.
[35]
Anandghan Waghmare, Youssef Ben Taleb, Ishan Chatterjee, Arjun Narendra, and Shwetak Patel. 2023. Z-Ring: Single-Point Bio-Impedance Sensing for Gesture, Touch, Object and User Recognition. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems. 1–18.
[36]
Martin Weigel, Tong Lu, Gilles Bailly, Antti Oulasvirta, Carmel Majidi, and Jürgen Steimle. 2015. Iskin: flexible, stretchable and visually customizable on-body touch sensors for mobile computing. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. 2991–3000.
[37]
Eric Whitmire, Mohit Jain, Divye Jain, Greg Nelson, Ravi Karkar, Shwetak Patel, and Mayank Goel. 2017. Digitouch: Reconfigurable thumb-to-finger input and text entry on head-mounted displays. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies 1, 3 (2017), 1–21.
[38]
Anusha Withana, Daniel Groeger, and Jürgen Steimle. 2018. Tacttoo: A thin and feel-through tattoo for on-skin tactile output. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology. 365–378.
[39]
Jianguo Xi, Huaiwen Yang, Xinyu Li, Ruilai Wei, Taiping Zhang, Lin Dong, Zhenjun Yang, Zuqing Yuan, Junlu Sun, and Qilin Hua. 2024. Recent Advances in Tactile Sensory Systems: Mechanisms, Fabrication, and Applications. Nanomaterials 14, 5 (2024), 465.
[40]
Ruidong Xu, Minghua She, Jiaxu Liu, Shikang Zhao, Jisheng Zhao, Xueji Zhang, Lijun Qu, and Mingwei Tian. 2023. Skin-friendly and wearable iontronic touch panel for virtual-real handwriting interaction. ACS nano 17, 9 (2023), 8293–8302.
[41]
Zheer Xu, Pui Chung Wong, Jun Gong, Te-Yen Wu, Aditya Shekhar Nittala, Xiaojun Bi, Jürgen Steimle, Hongbo Fu, Kening Zhu, and Xing-Dong Yang. 2019. Tiptext: Eyes-free text entry on a fingertip keyboard. In Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. 883–899.
[42]
Guang Yang, Renquan Xing, Yafang Li, Chongqi Ma, Bowen Cheng, Jing Yan, and Xupin Zhuang. 2021. Toward high-performance multifunctional electronics: Knitted fabric-based composite with electrically conductive anisotropy and self-healing capacity. Chemical Engineering Journal 426 (2021), 131931.
[43]
Shanshan Yao, Ji Yang, Felipe R Poblete, Xiaogang Hu, and Yong Zhu. 2019. Multifunctional electronic textiles using silver nanowire composites. ACS applied materials & interfaces 11, 34 (2019), 31028–31037.
[44]
Sang Ho Yoon, Ke Huo, Vinh P Nguyen, and Karthik Ramani. 2015. TIMMi: Finger-worn textile input device with multimodal sensing in mobile interaction. In Proceedings of the Ninth International Conference on Tangible, Embedded, and Embodied Interaction. 269–272.
[45]
Sang Ho Yoon, Ke Huo, and Karthik Ramani. 2014. Plex: finger-worn textile sensor for mobile interaction during activities. In Proceedings of the 2014 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct Publication. 191–194.
[46]
Yang Zhang, Junhan Zhou, Gierad Laput, and Chris Harrison. 2016. Skintrack: Using the body as an electrical waveguide for continuous finger tracking on the skin. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 1491–1503.
[47]
Zhihan Zhang, Mallory Parker, Kuotian Liao, Jerry Cao, Anandghan Waghmare, Joseph Breda, Chris Matsumura, Serena Eley, Eleftheria Roumeli, Shwetak Patel, and Vikram Iyer. 2024. Biodegradable Interactive Materials. arxiv:2404.03130 [cs.HC] https://arxiv.org/abs/2404.03130
[48]
Junyi Zhao, Chansoo Kim, Weilun Li, Zichao Wen, Zhili Xiao, Yong Wang, Shantanu Chakrabartty, and Chuan Wang. 2024. 3D E-textile for Exercise Physiology and Clinical Maternal Health Monitoring. arxiv:2407.07954 [physics.med-ph] https://arxiv.org/abs/2407.07954
[49]
Junyi Zhao, Li-Wei Lo, Haochuan Wan, Pengsu Mao, Zhibin Yu, and Chuan Wang. 2021. High-Speed Fabrication of All-Inkjet-Printed Organometallic Halide Perovskite Light-Emitting Diodes on Elastic Substrates. Advanced Materials 33, 48 (2021), 2102095.
[50]
Junyi Zhao, Li-Wei Lo, Zhibin Yu, and Chuan Wang. 2023. Handwriting of perovskite optoelectronic devices on diverse substrates. Nature Photonics 17, 11 (2023), 964–971.
[51]
Mengjia Zhu, Amirhossein H Memar, Aakar Gupta, Majed Samad, Priyanshu Agarwal, Yon Visell, Sean J Keller, and Nicholas Colonnese. 2020. Pneusleeve: In-fabric multimodal actuation and sensing in a soft, compact, and expressive haptic sleeve. In Proceedings of the 2020 CHI conference on human factors in computing systems. 1–12.

Index Terms

  1. TouchpadAnyWear: Textile-Integrated Tactile Sensors for Multimodal High Spatial-Resolution Touch Inputs with Motion Artifacts Tolerance

        Recommendations

        Comments

        Information & Contributors

        Information

        Published In

        cover image ACM Other conferences
        UIST '24: Proceedings of the 37th Annual ACM Symposium on User Interface Software and Technology
        October 2024
        2334 pages
        ISBN:9798400706288
        DOI:10.1145/3654777
        This work is licensed under a Creative Commons Attribution International 4.0 License.

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        Published: 11 October 2024

        Check for updates

        Author Tags

        1. Capacitive
        2. Fabrication
        3. Gesture Recognition
        4. High Resolution
        5. Motion Artifacts
        6. Multimodal
        7. Printing
        8. Soft Wearable
        9. Tactile Display
        10. Textile
        11. Touch Sensor

        Qualifiers

        • Research-article
        • Research
        • Refereed limited

        Conference

        UIST '24

        Acceptance Rates

        Overall Acceptance Rate 561 of 2,567 submissions, 22%

        Contributors

        Other Metrics

        Bibliometrics & Citations

        Bibliometrics

        Article Metrics

        • 0
          Total Citations
        • 601
          Total Downloads
        • Downloads (Last 12 months)601
        • Downloads (Last 6 weeks)225
        Reflects downloads up to 30 Dec 2024

        Other Metrics

        Citations

        View Options

        View options

        PDF

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format.

        HTML Format

        Login options

        Media

        Figures

        Other

        Tables

        Share

        Share

        Share this Publication link

        Share on social media