Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3025453.3025719acmconferencesArticle/Chapter ViewAbstractPublication PageschiConference Proceedingsconference-collections
research-article

GhostID: Enabling Non-Persistent User Differentiation in Frequency-Division Capacitive Multi-Touch Sensors

Published: 02 May 2017 Publication History

Abstract

Current touch devices are adept at tracking finger touches, but cannot distinguish if multiple touches are caused by different fingers on a single hand, by fingers from both hands of a single user, or by different users. This limitation significantly reduces the possibilities for interaction techniques in touch interfaces. We present GhostID, a capacitive sensor that can differentiate the origins of multiple simultaneous touches. Our approach analyzes the signal ghosting, already present as an artifact in a frequency-division touch controller, to differentiate touches from the same hand or different hands of a single user (77% reliability at 60 fps) or from two different users (95% reliability at 60 fps). In addition to GhostID, we also develop a framework of user-differentiation capabilities for touch input devices, and illustrate a set of interaction techniques enabled by GhostID.

Supplementary Material

suppl.mov (pn2328-file3.mp4)
Supplemental video
suppl.mov (pn2328p.mp4)
Supplemental video
MP4 File (p15-sahdev.mp4)

References

[1]
Christopher Ackad, Andrew Clayphan, Roberto Martinez Maldonado, and Judy Kay. 2012. Seamless and Continuous User Identification for Interactive Tabletops Using Personal Device Handshaking and Body Tracking. In CHI '12 Extended Abstracts on Human Factors in Computing Systems (CHI EA '12). ACM, New York, NY, USA, 1775--1780. http://dx.doi.org/10.1145/2212776.2223708
[2]
Michelle Annett, Tovi Grossman, Daniel Wigdor, and George Fitzmaurice. 2011. Medusa: A Proximity-aware Multi-touch Tabletop. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (UIST '11). ACM, New York, NY, USA, 337--346. http://dx.doi.org/10.1145/2047196.2047240
[3]
Hrvoje Benko, Meredith Ringel Morris, A. J. Brush, and Andy Wilson. 2009. Insights on Interactive Tabletops: A Survey of Researchers and Developers. Technical Report. Microsoft Research.
[4]
Bojan Blazicaa, Daniel Vladušica, and Dunja Mladenić. 2013. MTi: A Method for User Identification for Multitouch Displays. International Journal of Human-Computer Studies 71, 6 (2013), 691--702. http://dx.doi.org/10.1016/j.ijhcs.2013.03.002
[5]
Andrew Clayphan, Roberto Martinez-Maldonado, Christopher Ackad, and Judy Kay. 2013. An Approach for Designing and Evaluating a Plug-in Vision-based Tabletop Touch Identification System. In Proceedings of the 25th Australian Computer-Human Interaction Conference: Augmentation, Application, Innovation, Collaboration (OzCHI '13). ACM, New York, NY, USA, 373--382. http://dx.doi.org/10.1145/2541016.2541019
[6]
Padraig Cunningham and Sarah Jane Delany. 2007. k Nearest Neighbour Classifiers. Technical Report UCD-CSI-2007-4. University College Dublin.
[7]
Paul Dietz and Darren Leigh. 2001. DiamondTouch: A Multi-user Touch Technology. In Proceedings of the 14th Annual ACM Symposium on User Interface Software and Technology (UIST '01). ACM, New York, NY, USA, 219--226. http://dx.doi.org/10.1145/502348.502389
[8]
K. C. Dohse, Thomas Dohse, Jeremiah D. Still, and Derrick J. Parkhurst. 200 Enhancing Multi-user Interaction with Multi-touch Tabletop Displays Using Hand Tracking. In Proceedings of the First International Conference on Advances in Computer-Human Interaction (ACHI 2008). IEEE Computer Society, Washington, DC, USA, 297--302. http://dx.doi.org/10.1109/ACHI.2008.11
[9]
Philipp Ewerling, Alexander Kulik, and Bernd Froehlich. 2012. Finger and Hand Detection for Multi-touch Interfaces Based on Maximally Stable Extremal Regions. In Proceedings of the 2012 ACM International Conference on Interactive Tabletops and Surfaces (ITS '12). ACM, New York, NY, USA, 173--182. http://dx.doi.org/10.1145/2396636.2396663
[10]
Clifton Forlines and Chia Shen. 2005. DTLens: Multi-user Tabletop Spatial Data Exploration. In Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology (UIST '05). ACM, New York, NY, USA, 119--122. http://dx.doi.org/1145/1095034.1095055
[11]
Anhong Guo, Robert Xiao, and Chris Harrison. 2015. CapAuth: Identifying and Differentiating User Handprints on Commodity Capacitive Touchscreens. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces (ITS '15). ACM, New York, NY, USA, 59--62. http://dx.doi.org/10.1145/2817721.2817722
[12]
Jefferson Y. Han. 2005. Low-cost Multi-touch Sensing Through Frustrated Total Internal Reflection. In Proceedings of the 18th Annual ACM Symposium on User Interface Software and Technology (UIST '05). ACM, New York, NY, USA, 115--118. http://dx.doi.org/10.1145/1095034.1095054
[13]
Chris Harrison, Munehiko Sato, and Ivan Poupyrev. 2012. Capacitive Fingerprinting: Exploring User Differentiation by Sensing Electrical Properties of the Human Body. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). ACM, New York, NY, USA, 537--544. http://dx.doi.org/10.1145/2380116.2380183
[14]
Ken Hinckley, Michel Pahud, Hrvoje Benko, Pourang Irani, François Guimbretière, Marcel Gavriliu, Xiang 'Anthony' Chen, Fabrice Matulic, William Buxton, and Andrew Wilson. 20 Sensing Techniques for Tablet+Stylus Interaction. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, New York, NY, USA, 605--614. http://dx.doi.org/10.1145/2642918.2647379
[15]
Ken Hinckley, Seongkook Heo, Michel Pahud, Christian Holz, Hrvoje Benko, Abigail Sellen, Richard Banks, Kenton O'Hara, Gavin Smyth, and William Buxton. 2016. Pre-Touch Sensing for Mobile Interaction. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 2869--2881. http://dx.doi.org/10.1145/2858036.2858095
[16]
Christian Holz and Patrick Baudisch. 2013. Fiberio: A Touchscreen That Senses Fingerprints. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST '13). ACM, New York, NY, USA, 41--50. http://dx.doi.org/10.1145/2501988.2502021
[17]
Christian Holz, Senaka Buthpitiya, and Marius Knaust. 2015. Bodyprint: Biometric User Identification on Mobile Devices Using the Capacitive Touchscreen to Scan Body Parts. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 3011--3014. http://dx.doi.org/10.1145/2702123.2702518
[18]
Christian Holz and Marius Knaust. 2015. Biometric Touch Sensing: Seamlessly Augmenting Each Touch with Continuous Authentication. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST '15). ACM, New York, NY, USA, 303--312. http://dx.doi.org/10.1145/2807442.2807458
[19]
Gierad Laput, Chouchang Yang, Robert Xiao, Alanson Sample, and Chris Harrison. 2015. EM-Sense: Touch Recognition of Uninstrumented, Electrical and Electromechanical Objects. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology (UIST '15). ACM, New York, NY, USA, 157--166. http://dx.doi.org/10.1145/2807442.2807481
[20]
Darren Leigh, Clifton Forlines, Ricardo Jota, Steven Sanders, and Daniel Wigdor. 2014. High Rate, Low-latency Multi-touch Sensing with Simultaneous Orthogonal Multiplexing. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, New York, NY, USA, 355--364. http://dx.doi.org/10.1145/2642918.2647353
[21]
Nicolai Marquardt, Johannes Kiemer, David Ledo, Sebastian Boring, and Saul Greenberg. 2011. Designing User-, Hand-, and Handpart-aware Tabletop Interactions with the TouchID Toolkit. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '11). ACM, New York, NY, USA, 21--30. http://dx.doi.org/10.1145/2076354.2076358
[22]
Paul McAvinney. 1986. The Sensor Frame - A Gesture-Based Device for the Manipulation of Graphic Objects. Carnegie-Mellon University.
[23]
Tobias Meyer and Dominik Schmidt. 2010. IdWristbands: IR-based User Identification on Multi-touch Surfaces. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '10). ACM, New York, NY, USA, 277--278. http://dx.doi.org/10.1145/1936652.1936714
[24]
Philipp Mock, Jörg Edelmann, Andreas Schilling, and Wolfgang Rosenstiel. 2014. User Identification Using Raw Sensor Data from Typing on Interactive Displays. In Proceedings of the 19th International Conference on Intelligent User Interfaces (IUI '14). ACM, New York, NY, USA, 67--72. http://dx.doi.org/10.1145/2557500.2557503
[25]
Meredith Ringel Morris. 2006. Supporting Effective Interaction with Tabletop Groupware. Ph.D. Dissertation. Stanford University.
[26]
Meredith Ringel Morris, Anthony Cassanego, Andreas Paepcke, Terry Winograd, Ann Marie Piper, and Anqi Huang. 2006. Mediating Group Dynamics through Tabletop Interface Design. IEEE Computer Graphics and Applications 26, 5 (Sept 2006), 65--73. http://dx.doi.org/10.1109/MCG.2006.114
[27]
Meredith Ringel Morris, Anqi Huang, Andreas Paepcke, and Terry Winograd. 2006. Cooperative Gestures: Multi-user Gestural Interactions for Co-located Groupware. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '06). ACM, New York, NY, USA, 1201--1210. http://dx.doi.org/10.1145/1124772.1124952
[28]
Sundar Murugappan, Vinayak, Niklas Elmqvist, and Karthik Ramani. 2012. Extended Multitouch: Recovering Touch Posture and Differentiating Users Using a Depth Camera. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). ACM, New York, NY, USA, 487--496. http://dx.doi.org/10.1145/2380116.2380177
[29]
Raf Ramakers, Davy Vanacken, Kris Luyten, Karin Coninx, and Johannes Schöning. 2012. Carpus: A Non-intrusive User Identification Technique for Interactive Surfaces. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST '12). ACM, New York, NY, USA, 35--44. http://dx.doi.org/10.1145/2380116.2380123
[30]
Stephan Richter, Christian Holz, and Patrick Baudisch. 2012. Bootstrapper: Recognizing Tabletop Users by Their Shoes. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 1249--1252. http://dx.doi.org/10.1145/2207676.2208577
[31]
Volker Roth, Philipp Schmidt, and Benjamin Güldenring. 2010. The IR Ring: Authenticating Users' Touches on a Multi-touch Display. In Proceedings of the 23Nd Annual ACM Symposium on User Interface Software and Technology (UIST '10). ACM, New York, NY, USA, 259--262. http://dx.doi.org/10.1145/1866029.1866071
[32]
Kathy Ryall, Clifton Forlines, Chia Shen, Meredith Ringel Morris, and Katherine Everitt. 2006. Experiences with and Observations of Direct-Touch Tabletops. In Proceedings of the First IEEE International Workshop on Horizontal Interactive Human-Computer Systems (TABLETOP '06). IEEE Computer Society, Washington, DC, USA, 89--96. http://dx.doi.org/10.1109/TABLETOP.2006.12
[33]
Napa Sae-Bae, Kowsar Ahmed, Katherine Isbister, and Nasir Memon. 2012. Biometric-rich Gestures: A Novel Approach to Authentication on Multi-touch Devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 977--986. http://dx.doi.org/10.1145/2207676.2208543
[34]
Munehiko Sato, Ivan Poupyrev, and Chris Harrison. 2012. Touché: Enhancing Touch Interaction on Humans, Screens, Liquids, and Everyday Objects. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 483--492. http://dx.doi.org/10.1145/2207676.2207743
[35]
Dominik Schmidt, Fadi Chehimi, Enrico Rukzio, and Hans Gellersen. 2010. PhoneTouch: A Technique for Direct Phone Interaction on Surfaces. In Proceedings of the 23nd Annual ACM Symposium on User Interface Software and Technology (UIST '10). ACM, New York, NY, USA, 13--16. http://dx.doi.org/10.1145/1866029.1866034
[36]
Dominik Schmidt, Ming Ki Chong, and Hans Gellersen. 2010. HandsDown: Hand-contour-based User Identification for Interactive Surfaces. In Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries (NordiCHI '10). ACM, New York, NY, USA, 432--441. http://dx.doi.org/10.1145/1868914.1868964
[37]
Chia Shen, Katherine Everitt, and Kathleen Ryall. 2003. UbiTable: Impromptu Face-to-Face Collaboration on Horizontal Interactive Surfaces. In Proceedings of Ubiquitous Computing: 5th Inter-national Conference (UbiComp 2003). Springer Berlin Heidelberg, Berlin, Germany, 281--288. http://dx.doi.org/10.1007/978-3-540-39653-6_22
[38]
Daniel Vogel and Ravin Balakrishnan. 2004. Interactive Public Ambient Displays: Transitioning from Implicit to Explicit, Public to Personal, Interaction with Multiple Users. In Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology (UIST '04). ACM, New York, NY, USA, 137--146. http://dx.doi.org/10.1145/1029632.1029656
[39]
Ulrich von Zadow, Patrick Reipschläger, Daniel Bösel, Anita Sellent, and Raimund Dachselt. 2016. YouTouch! Low-Cost User Identification at an Interactive Display Wall. In Proceedings of the International Working Conference on Advanced Visual Interfaces (AVI '16). ACM, New York, NY, USA, 144--151. http://dx.doi.org/10.1145/2909132.2909258
[40]
Tam Vu, Akash Baid, Simon Gao, Marco Gruteser, Richard Howard, Janne Lindqvist, Predrag Spa-sojevic, and Jeffrey Walling. 2012. Distinguishing Users with Capacitive Touch Communication. In Proceedings of the 18th Annual International Conference on Mobile Computing and Networking (MobiCom '12). ACM, New York, NY, USA, 197--208. http://dx.doi.org/10.1145/2348543.2348569
[41]
Cody Watts, Ehud Sharlin, and Peter Woytiuk. 2009. Matchmaker: Interpersonal Touch in Gaming. In Proceedings of the 4th International Conference on E-Learning and Games (Edutainment 2009). Springer Berlin Heidelberg, Berlin, Germany, 13--24. http://dx.doi.org/10.1007/978-3-642-03364-3_2
[42]
Wayne Westerman. 1999. Hand Tracking, Finger Identification, and Chordic Manipulation on a Multi-touch Surface. Ph.D. Dissertation. University of Delaware.
[43]
Daniel Wigdor, Sarah Williams, Michael Cronin, Robert Levy, Katie White, Maxim Mazeev, and Hrvoje Benko. 2009. Ripples: Utilizing Per-contact Visualizations to Improve User Interaction with Touch Displays. In Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology (UIST '09). ACM, New York, NY, USA, 3--12. http://dx.doi.org/10.1145/1622176.1622180
[44]
Daniel Wigdor and Dennis Wixon. 2011. Brave NUI World: Designing Natural User Interfaces for Touch and Gesture. Elsevier, New York, NY, USA.
[45]
Andrew D. Wilson. 2010. Using a Depth Camera as a Touch Sensor. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (ITS '10). ACM, New York, NY, USA, 69--72. http://dx.doi.org/10.1145/1936652.1936665
[46]
Hong Zhang, Xing-Dong Yang, Barrett Ens, Hai-Ning Liang, Pierre Boulanger, and Pourang Irani. 2012. See Me, See You: A Lightweight Method for Discriminating User Touches on Tabletop Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 2327--2336. http://dx.doi.org/10.1145/2207676.2208392
[47]
Zhensong Zhang, Fengjun Zhang, Hui Chen, Jiasheng Liu, Hongan Wang, and Guozhong Dai. 2014. Left and Right Hand Distinction for Multi-touch Tabletop Interactions. In Proceedings of the 19th International Conference on Intelligent User Interfaces (IUI '14). ACM, New York, NY, USA, 47--56. http://dx.doi.org/10.1145/2557500.2557525

Cited By

View all
  • (2020)CapacitivoProceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology10.1145/3379337.3415829(649-661)Online publication date: 20-Oct-2020
  • (2019)Sensing Posture-Aware Pen+Touch Interaction on TabletsProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300285(1-14)Online publication date: 2-May-2019
  • (2018)FDSenseProceedings of the 31st Annual ACM Symposium on User Interface Software and Technology10.1145/3242587.3242644(809-823)Online publication date: 11-Oct-2018
  • Show More Cited By

Index Terms

  1. GhostID: Enabling Non-Persistent User Differentiation in Frequency-Division Capacitive Multi-Touch Sensors

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems
    May 2017
    7138 pages
    ISBN:9781450346559
    DOI:10.1145/3025453
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 02 May 2017

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. capacitive touch sensor
    2. mobility
    3. signal processing
    4. user differentiation

    Qualifiers

    • Research-article

    Conference

    CHI '17
    Sponsor:

    Acceptance Rates

    CHI '17 Paper Acceptance Rate 600 of 2,400 submissions, 25%;
    Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)21
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 15 Oct 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2020)CapacitivoProceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology10.1145/3379337.3415829(649-661)Online publication date: 20-Oct-2020
    • (2019)Sensing Posture-Aware Pen+Touch Interaction on TabletsProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300285(1-14)Online publication date: 2-May-2019
    • (2018)FDSenseProceedings of the 31st Annual ACM Symposium on User Interface Software and Technology10.1145/3242587.3242644(809-823)Online publication date: 11-Oct-2018
    • (2017)A Unified Model for User Identification on Multi-Touch Surfaces: A Survey and Meta-AnalysisACM Transactions on Computer-Human Interaction10.1145/314456924:6(1-39)Online publication date: 19-Dec-2017
    • (2017)Sensing, Privacy, and Things We Don't DiscussIEEE Pervasive Computing10.1109/MPRV.2017.294097116:3(7-11)Online publication date: 27-Jul-2017

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media