research-article

Open access

E-Textile Microinteractions: Augmenting Twist with Flick, Slide and Grasp Gestures for Soft Electronics

Authors:

Gowa MaininiAuthors Info & Claims

CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

Pages 1 - 13

https://doi.org/10.1145/3313831.3376236

Published: 23 April 2020 Publication History

All formats PDF

Abstract

E-textile microinteractions advance cord-based interfaces by enabling the simultaneous use of precise continuous control and casual discrete gestures. We leverage the recently introduced I/O Braid sensing architecture to enable a series of user studies and experiments which help design suitable interactions and a real-time gesture recognition pipeline. Informed by a gesture elicitation study with 36 participants, we developed a user-dependent classifier for eight discrete gestures with 94% accuracy for 12 participants. In a formal evaluation we show that we can enable precise manipulation with the same architecture. Our quantitative targeting experiment suggests that twisting is faster than existing headphone button controls and is comparable in speed to a capacitive touch surface. Qualitative interview feedback indicates a preference for I/O Braid's interaction over that of in-line headphone controls. Our applications demonstrate how continuous and discrete gestures can be combined to form new, integrated e-textile microinteraction techniques for real-time continuous control, discrete actions and mode switching.

Supplementary Material

ZIP File (paper109vfc.zip)

Video figure captions

Download
1.83 KB

MP4 File (paper109vf.mp4)

Supplemental video

Download
196.45 MB

MP4 File (paper109pv.mp4)

Preview video

Download
20.34 MB

MP4 File (a109-olwal.mp4)

Download
87.18 MB

References

[1]

Daniel L. Ashbrook. 2010. Enabling mobile microinteractions, Doctoral dissertation, Georgia Institute of Technology.

Digital Library

[2]

Matthew Bell. 2010. Flexible Object Manipulation. Ph.D. Dissertation. Dartmouth College, Hanover, NH, USA. Advisor(s) Devin Balkcom. AAI3397916.

[3]

Joanna Berzowska. 2005. Electronic Textiles: Wearable Computers, Reactive Fashion, and Soft Computation, TEXTILE, 3:1, 58--75.

[4]

Ravin Balakrishnan, George Fitzmaurice, Gordon Kurtenbach, and Karan Singh. 1999. Exploring interactive curve and surface manipulation using a bend and twist sensitive input strip. In Proceedings of Interactive 3D Graphics (I3D '99), 111--118. http://dx.doi.org/10.1145/300523.300536

Digital Library

[5]

Gabor Blasko, Chandra Narayanaswami, and Steven Feiner. 2006. Prototyping retractable string-based interaction techniques for dual-display mobile devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '06), 369--372. http://dx.doi.org/10.1145/1124772.1124827

Digital Library

[6]

Mark R. Cutkosky. 1989. On grasp choice, grasp models, and the design of hands for manufacturing tasks. In IEEE Transactions on Robotics and Automation, vol. 5, no. 3, pp. 269--279, June 1989.

[7]

Marco Cuturi. 2011. Fast global alignment kernels. In Proceedings of the 28th International Conference on International Conference on Machine Learning (ICML'11), Lise Getoor and Tobias Scheffer (Eds.). Omnipress, USA, 929--936.

Digital Library

[8]

Thomas Feix, Javier Romero, Heinz-Bodo Schmiedmayer, Aaron M. Dollar, and Danica Kragic. 2016. The GRASP Taxonomy of Human Grasp Types. In IEEE Transactions on Human-Machine Systems, vol. 46, no. 1, pp. 66--77, Feb. 2016.

[9]

Scott Gilliland, Nicholas Komor, Thad Starner, and Clint Zeagler. 2010. The textile interface swatchbook: creating graphical user interface-like widgets with conductive embroidery. In Proceedings of the IEEE International Symposium on Wearable Computers (ISWC'10). 1--8. http://dx.doi.org/10.1109/ISWC.2010.5665876

[10]

Thorsten Karrer, Moritz Wittenhagen, Leonhard Lichtschlag, Florian Heller, and Jan Borchers. 2011. Pinstripe: eyes-free continuous input on interactive clothing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11), 1313--1322. https://doi.org/10.1145/1978942.1979137

Digital Library

[11]

Sunyoung Kim, Eric Paulos, and Mark D. Gross. 2010. WearAir: expressive t-shirts for air quality sensing. In Proceedings of the SIGCHI Conference on Tangible, Embedded, and Embodied Interaction (TEI '10), 295296. http://dx.doi.org/10.1145/1709886.1709949

Digital Library

[12]

Erik Koch and Hendrik Witt. 2008. Prototyping a chest-worn string-based wearable input device. In Proceedings of the IEEE International Symposium on World of Wireless, Mobile and Multimedia Networks,1--6. https://doi.org/10.1109/WOWMOM.2008.4594882

Digital Library

[13]

Sang-Su Lee, Sohyun Kim, Bopil Jin, Eunji Choi, Boa Kim, Xu Jia, Daeeop Kim, and Kun-pyo Lee. 2010. How users manipulate deformable displays as input devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, NY, NY, USA, 1647--1656.

Digital Library

[14]

Jakan. 2020. https://urbanears.com/us/en/jakan.html. Urban Ears.

[15]

Joanne Leong, Patrick Parzer, Florian Perteneder, Teo Babic, Christian Rendl, Anita Vogl, Hubert Egger, Alex Olwal, and Michael Haller. 2016. proCover: sensory augmentation of prosthetic limbs using smart textile covers. In Proceedings of the SIGCHI Symposium on User Interface Software and Technology (UIST '16), 335--346. https://doi.org/10.1145/2984511.2984572

Digital Library

[16]

Diana Marculescu, Radu Marculescu, Nicholas H. Zamora, Phillip Stanley-Marbell, Pradeep K. Khosla, Sungmee Park, Sundaresan Jayaraman, Stefan Jung, Christl Lauterbach, Werner Weber, Tünde Kirstein, Didier Cottet, Janusz Grzyb, Gerhard Troster, Mark Jones, Tom Martin, Zahi Nakad. 2003. Electronic textiles: a platform for pervasive computing. Proceedings of the IEEE, 91, 12: 1995--2018.

[17]

Jussi Mikkonen and Riikka Townsend. 2019. Frequency-Based Design of Smart Textiles. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, NY, NY, USA, Paper 294, 12 pages.

Digital Library

[18]

Alex Olwal, Jon Moeller, Greg Priest-Dorman, Thad Starner, and Ben Carroll. 2018. I/O Braid: Scalable Touch-Sensitive Lighted Cords Using Spiraling, Repeating Sensing Textiles and Fiber Optics. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST '18). ACM, NY, NY, USA, 485--497.

Digital Library

[19]

Patrick Parzer, Florian Perteneder, Kathrin Probst, Christian Rendl, Joanne Leong, Sarah Schuetz, Anita Vogl, Reinhard Schwoediauer, Martin Kaltenbrunner, Siegfried Bauer, and Michael Haller. 2018. RESi: A Highly Flexible, Pressure-Sensitive, Imperceptible Textile Interface Based on Resistive Yarns. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST '18). ACM, NY, NY, USA, 745--756.

Digital Library

[20]

Patrick Parzer, Kathrin Probst, Teo Babic, Christian Rendl, Anita Vogl, Alex Olwal, and Michael Haller. 2016. FlexTiles: a flexible, stretchable, formable, pressure-sensitive, tactile input sensor. In Extended Abstracts of the SIGCHI Conference on Human Factors in Computing Systems (CHI EA '16), 37543757. https://doi.org/10.1145/2851581.2890253

Digital Library

[21]

Patrick Parzer, Adwait Sharma, Anita Vogl, Jürgen Steimle, Alex Olwal, and Michael Haller. 2017. SmartSleeve: real-time sensing of surface and deformation gestures on flexible, interactive textiles, using a hybrid gesture detection pipeline. In Proceedings of the SIGCHI Symposium on User Interface Software and Technology (UIST '17), 565--57. https://doi.org/10.1145/3126594.3126652

Digital Library

[22]

Fabian Pedregosa, Gaël Varoquaux, Alexandre Gramfort, Vincent Michel, Bertrand Thirion, Olivier Grisel, Mathieu Blondel, Peter Prettenhofer, Ron Weiss, Vincent Dubourg, Jake Vanderplas, Alexandre Passos, David Cournapeau, Matthieu Brucher, Matthieu Perrot, and Édouard Duchesnay. 2011. Scikitlearn: Machine Learning in Python, Journal of Machine Learning Research, 12(October), pp. 2825--2830.

Digital Library

[23]

Pixel Buds. 2020. https://www.blog.google/products/pixel/pixel-buds/. Google.

[24]

Norman Pohl, Steve Hodges, John Helmes, Nicolas Villar, and Tim Paek. 2013. An interactive belt-worn badge with a retractable string-based input mechanism In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13), 1465--1468. https://doi.org/10.1145/2470654.2466194

Digital Library

[25]

E. Rehmi Post, Maggie Orth, Peter R. Russo and Neil Gershenfeld. 2000. E-broidery: design and fabrication of textile-based computing. IBM Systems Journal, 39, 3--4: 840--860. http://dx.doi.org/10.1147/sj.393.0840

Digital Library

[26]

Ivan Poupyrev, Nan-Wei Gong, Shiho Fukuhara, Mustafa Emre Karagozler, Carsten Schwesig, and Karen E. Robinson. 2016. Project Jacquard: interactive digital textiles at scale. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'16), 4216--4227. https://doi.org/10.1145/2858036.2858176

Digital Library

[27]

Cliff Randell, Ian Andersen, Henk Moore, Sharon Baurley. 2005. Sensor sleeve: sensing affective gestures. In Proceedings of the IEEE International Symposium on Wearable Computers - Workshop on On-Body Sensing, 117--123.

[28]

Jun Rekimoto. 2002. SmartSkin: an infrastructure for freehand manipulation on interactive surfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '02), 113--120. http://dx.doi.org/10.1145/503376.503397

Digital Library

[29]

Markus Rothmaier, Minh Phi Luong, and Frank Clemens. 2008. Textile pressure sensor made of flexible plastic optical fibers. Sensors 8, 7: 4318--4329. http://dx.doi.org/10.3390/s8074318

[30]

Jaime Ruiz, Yang Li, and Edward Lank. 2011. Userdefined motion gestures for mobile interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, NY, NY, USA, 197--206.

Digital Library

[31]

Stefan Schneegass and Alexandra Voit. 2016. GestureSleeve: using touch sensitive fabrics for gestural input on the forearm for controlling smartwatches. In Proceedings of the ACM International Symposium on Wearable Computers (ISWC '16), 108--115. https://doi.org/10.1145/2971763.2971797

Digital Library

[32]

Philipp Schoessler, Sang-won Leigh, Krithika Jagannath, Patrick van Hoof, and Hiroshi Ishii. 2015. Cord UIs: controlling devices with augmented cables In Proceedings of the SIGCHI Conference on Tangible, Embedded, and Embodied Interaction (TEI '15), 395398. https://doi.org/10.1145/2677199.2680601

Digital Library

[33]

Julia Schwarz, Chris Harrison, Scott Hudson, and Jennifer Mankoff. 2010. Cord input: an intuitive, high accuracy, multi-degree-of-freedom input method for mobile devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10), 1657--1660. https://doi.org/10.1145/1753326.1753573

Digital Library

[34]

Maximilian Sergio, Nicolo Manaresi, Marco Tartagni, Roberto Guerrieri and Roberto Canegallo. 2002. A textile based capacitive pressure sensor. IEEE Sensors, Orlando, FL, USA, 2002, pp. 1625--1630, vol.2. https://doi.org/10.1109/ICSENS.2002.1037367

[35]

Adwait Sharma, Joan Sol Roo, and Jürgen Steimle. 2019. Grasping Microgestures: Eliciting Single-hand Microgestures for Handheld Objects. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, NY, NY, USA, Paper 402, 13 pages.

Digital Library

[36]

Cátia Sousa and Ian Oakley. 2011. Integrating feedback into wearable controls. In Human-Computer Interaction (INTERACT'11). Lecture Notes in Computer Science, vol 6949. Springer. https://doi.org/10.1007/978--3--642- 23768--3_81

[37]

Romain Tavenard, Johann Faouzi and Gilles Vandewiele. 2017. tslearn: A machine learning toolkit dedicated to time-series data. tslearn.readthedocs.io. Last accessed 2020 01 01.

[38]

Raphael Wimmer and Patrick Baudisch. 2011. Modular and deformable touch-sensitive surfaces based on time domain reflectometry. In Proceedings of the 24th annual ACM symposium on User interface software and technology (UIST '11). ACM, NY, NY, USA, 517--526.

Digital Library

[39]

Jacob O. Wobbrock, Meredith Ringel Morris, and Andrew D. Wilson. 2009. User-defined gestures for surface computing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, NY, NY, USA, 1083--1092.

Digital Library

[40]

Clint Zeagler, Scott Gilliland, Haley Profita, and Thad Starner. 2012. Textile interfaces: embroidered jogwheel, beaded tilt sensor, twisted pair ribbon, and sound sequins. In Proceedings of the IEEE International Symposium on Wearable Computers (ISWC'12), 60--63.

Digital Library

[41]

Clint Zeagler, Scott Gilliland, Stephen Audy, and Thad Starner. 2013. Can i wash it?: the effect of washing conductive materials used in making textile based wearable electronic interfaces. In Proceedings of the 2013 International Symposium on Wearable Computers (ISWC '13). ACM, NY, NY, USA, 143--144.

Digital Library

[42]

Yang Zhang, Gierad Laput, and Chris Harrison. 2017. Electrick: Low-Cost Touch Sensing Using Electric Field Tomography. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, NY, NY, USA, 1--14.

Digital Library

Cited By

Ruston OSharma AFraser M(2024)SeamSleeve: Robust Arm Movement Sensing through Powered StitchingProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660726(1134-1147)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660726
Villarreal-Narvaez SSluÿters AVanderdonckt JVatavu R(2024)Brave New GES World: A Systematic Literature Review of Gestures and Referents in Gesture Elicitation StudiesACM Computing Surveys10.1145/363645856:5(1-55)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3636458
Zhan LXiong TZhang HGuo SChen XGong JLin JQin Y(2024)TouchEditorProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314547:4(1-29)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631454
Show More Cited By

Index Terms

E-Textile Microinteractions: Augmenting Twist with Flick, Slide and Grasp Gestures for Soft Electronics
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
    2. Interaction techniques
      1. Gestural input
  2. Interaction design
    1. Interaction design process and methods
      1. User interface design

Recommendations

Exploring Non-touchscreen Gestures for Smartwatches
CHI '16: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems

Although smartwatches are gaining popularity among mainstream consumers, the input space is limited due to their small form factor. The goal of this work is to explore how to design non-touchscreen gestures to extend the input space of smartwatches. We ...
Hands-free gesture control with a capacitive textile neckband
ISWC '14: Proceedings of the 2014 ACM International Symposium on Wearable Computers

We present a novel sensing modality for hands-free gesture controlled user interfaces, based on active capacitive sensing. Four capacitive electrodes are integrated into a textile neckband, allowing continuous unobtrusive head movement monitoring. We ...
Microinteractions to augment manual tasks
INTERACT'11: Proceedings of the 13th IFIP TC 13 international conference on Human-computer interaction - Volume Part IV

This paper summarizes the first nine months of progress on my Ph.D. project. The research focus of the project is on investigating microinteractions. a sub-topic of HCI and gesture research. The project will develop a framework for applications that use ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '20: Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems

April 2020

10688 pages

ISBN:9781450367080

DOI:10.1145/3313831

General Chairs:
Regina Bernhaupt
Eindhoven University of Technology, Netherlands
,
Florian 'Floyd' Mueller
Monash University, Australia
,
David Verweij
Newcastle University, UK
,
Josh Andres
RMIT, Australia
,
Program Chairs:
Joanna McGrenere
University of British Columbia, Canada
,
Andy Cockburn
University of Canterbury, New Zealand
,
Ignacio Avellino
University of Maryland Baltimore County, USA
,
Alix Goguey
Grenoble Alpes University, France
,
Pernille Bjørn
University of Copenhagen, Denmark
,
Shengdong (Shen) Zhao
National University of Singapore, Singapore
,
Briane Paul Samson
Future University Hakodate, Japan & De La Salle University, Philippines
,
Rafal Kocielnik
University of Washington, USA

Copyright © 2020 Owner/Author.

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike International 4.0 License.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 April 2020

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '20

Sponsor:

SIGCHI

CHI '20: CHI Conference on Human Factors in Computing Systems

April 25 - 30, 2020

HI, Honolulu, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

22
Total Citations
View Citations
3,122
Total Downloads

Downloads (Last 12 months)536
Downloads (Last 6 weeks)61

Reflects downloads up to 24 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ruston OSharma AFraser M(2024)SeamSleeve: Robust Arm Movement Sensing through Powered StitchingProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3660726(1134-1147)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3660726
Villarreal-Narvaez SSluÿters AVanderdonckt JVatavu R(2024)Brave New GES World: A Systematic Literature Review of Gestures and Referents in Gesture Elicitation StudiesACM Computing Surveys10.1145/363645856:5(1-55)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3636458
Zhan LXiong TZhang HGuo SChen XGong JLin JQin Y(2024)TouchEditorProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36314547:4(1-29)Online publication date: 12-Jan-2024
https://dl.acm.org/doi/10.1145/3631454
Li YZhou YShen CStewart RCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)E-textile Sleeve with Graphene Strain Sensors for Arm Gesture Classification of Mid-Air InteractionsProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633374(1-10)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3633374
Rallabandi VHaynes AReed CStrohmeier PCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)Base and Stitch: Evaluating eTextile Interfaces from a Material-Centric ViewProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633363(1-13)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3633363
Lin HLiu XJiang SWang QTao YWang GSun WHan TTian F(2024)TacTex: A Textile Interface with Seamlessly-Integrated Electrodes for High-Resolution Electrotactile StimulationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642873(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642873
Zhu JWinagle LKao H(2024)EcoThreads: Prototyping Biodegradable E-textiles Through Thread-based FabricationProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642718(1-17)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642718
Wang QZeng YZhang RYe NZhu LSun XHan T(2023)EmTex: Prototyping Textile-Based Interfaces through An Embroidered Construction KitProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606815(1-17)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606815
Yamamoto TMasai KWithana ASugiura Y(2023)Masktrap: Designing and Identifying Gestures to Transform Mask Strap into an Input InterfaceProceedings of the 28th International Conference on Intelligent User Interfaces10.1145/3581641.3584062(762-775)Online publication date: 27-Mar-2023
https://dl.acm.org/doi/10.1145/3581641.3584062
Fang FZhang HZhan LGuo SZhang MLin JQin YFu H(2023)Handwriting VelcroProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/35694616:4(1-31)Online publication date: 11-Jan-2023
https://dl.acm.org/doi/10.1145/3569461
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents