research-article

TUIC: enabling tangible interaction on capacitive multi-touch displays

Authors:

Sung-Sheng Tsai,

Lung-Pan Cheng,

Yi-Ping HungAuthors Info & Claims

CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 2995 - 3004

https://doi.org/10.1145/1978942.1979386

Published: 07 May 2011 Publication History

Abstract

We present TUIC, a technology that enables tangible interaction on capacitive multi-touch devices, such as iPad, iPhone, and 3M's multi-touch displays, without requiring any hardware modifications. TUIC simulates finger touches on capacitive displays using passive materials and active modulation circuits embedded inside tangible objects, and can be used with multi-touch gestures simultaneously. TUIC consists of three approaches to sense and track objects: spatial, frequency, and hybrid (spatial plus frequency). The spatial approach, also known as 2D markers, uses geometric, multi-point touch patterns to encode object IDs. Spatial tags are straightforward to construct and are easily tracked when moved, but require sufficient spacing between the multiple touch points. The frequency approach uses modulation circuits to generate high-frequency touches to encode object IDs in the time domain. It requires fewer touch points and allows smaller tags to be built. The hybrid approach combines both spatial and frequency tags to construct small tags that can be reliably tracked when moved and rotated. We show three applications demonstrating the above approaches on iPads and 3M's multi-touch displays.

Supplementary Material

MP4 File (paper206.mp4)

Download
78.85 MB

References

[1]

Barrett, G. and Omote, R. Projected-Capacitive Touch Technology. Information Display, March 2010/vol. 26, NO. 3, Society for Information Display, 17--18.

[2]

Baudisch, P., Becker, T., and Rudeck, F. Lumino: tangible blocks for tabletop computers based on glass fiber bundles. In Proc. of CHI 2010, 1165--1174.

Digital Library

[3]

Block, F., Haller, M., Gellersen, H., Gutwin, C., and Billinghurst, M. VoodooSketch - extending interactive surfaces with adaptable interface palettes. In Proc. of TEI 2008, 55--58.

Digital Library

[4]

Chang, A. Y., Lee, W. C., and Lee, W. Y. 2010. Touchscreen Stylus. U.S. Patent US 2010/0053120 A1. Mar. 2010.

[5]

Dietz, P. and Leigh, D. (2001). DiamondTouch: a multi-user touch technology. ACM UIST. 219--226.

Digital Library

[6]

Fiala, M. ARTag, a fiducial marker system using digital techniques. In Proc. of IEEE CVPR 2005, 590--596 vol. 2.

Digital Library

[7]

Fitzmaurice, W.G., Ishii, H., and Buxton, W. Bricks: laying the foundations for graspable user interfaces. In Proc. of CHI 1995, 442--449.

Digital Library

[8]

GestureWorks. http://gestureworks.com.

[9]

Guo, C. and Sharlin, E. Exploring the use of tangible user interfaces for human-robot interaction: a comparative study. In Proc. of CHI 2008, 121--130.

Digital Library

[10]

Hinckley, K., Yatani, K., Pahud, M., Rodenhouse, J., Wilson, A., Benko, H., and Buxton, B. Pen + touch = new tools. In Proc. of UIST 2010, 27--36.

Digital Library

[11]

Ishii, H., Tangible bits: beyond pixels, In Proc. of TEI 2008, xv-xxv.

Digital Library

[12]

Ishii, H. The tangible user interface and its evolution. Communications of the ACM 2008, 32--36.

Digital Library

[13]

Izadi, S., Hodges, S., Butler, A., Rrustemi, A., and Buxton, B. ThinSight: integrated optical multi-touch sensing through thin form-factor displays. In Proc. of EDT 2007, Art. NO. 6.

Digital Library

[14]

Jordà, S., Geiger, G., Alonso, M., and Kaltenbrunner, M. The reacTable: exploring the synergy between live music performance and tabletop tangible interfaces. In Proc. of TEI 2007, 139--146.

Digital Library

[15]

Jordà, S., Julià, F. C., and Gallardo, D. Interactive surfaces and tangibles. XRDS: Crossroads, The ACM Magazine for Students 2010, vol. 16 (4), 21--28.

Digital Library

[16]

Liu, Y. C. and Tseng, H. H. 2009. Stylus and Electronic Device. U.S. Patent 2009/0167727 A1. Jul. 2009.

[17]

Minami, M., Fukuju, Y., Hirasawa, K., Yokoyama, S., Mizumachi, M., Morikawa, H., and Aoyama, T. Dolphin: A practical approach for implementing a fully distributed indoor ultrasonic positioning system. In Proc. of UBICOMP 2004, 347--356.

[18]

NET.2971 - The Microsoft Surface domino tag. http://www.xs4all.nl/~wrb/Main/Index.htm.

[19]

Orit Shaer and Eva Hornecker. Tangible User Interfaces: Past, Present, and Future Directions. In Foundations and Trends in Human-Computer Interaction 3,1 (2010) 1--138.

Digital Library

[20]

Patten, J., Ishii, H., Hines, J., and Pangaro, G. Sensetable: A Wireless Object Tracking Platform for Tangible User Interfaces. In Proc. of CHI 2001, 253--260.

Digital Library

[21]

Patten, J., Ishii, H., and Recht, B. Audiopad: a tag-based interface for musical performance. In Proc. of NIME 2002, 1--6.

Digital Library

[22]

QR code. http://www.qrcode.com/index-e.html.

[23]

Rekimoto, J. (2002). SmartSkin: an infrastructure for freehand manipulation on interactive surfaces. ACM CHI. 113--120.

Digital Library

[24]

Rice, C. A., Cain, B. C., and Fawcett, K. J. Dependable coding for fiducial tags. In Proc. of UCS 2004, 155--163.

[25]

Rice, C. A., Harle, K. R., and Beresford, R. A. Analysing fundamental properties of marker-based vision system designs. In PerCom 2006, 453--471.

[26]

Ullmer, B., Ishii, H., and Glas, D. mediaBlocks: physical containers, transports, and controls for online media. In Proc. of SIGGRAPH 1998, 379--386.

Digital Library

[27]

Ullmer, B., and Ishii, H. The metaDESK: models and prototypes for tangible user interfaces. In Proc. of UIST 1997, 223--232.

Digital Library

[28]

Underkoffler, J., and Ishii, H. Urp: a luminous-tangible workbench for urban planning and design. In Proc. of CHI 1999, 386--393.

Digital Library

[29]

Vogel, D. and Baudisch, P. 2007. Shift: A Technique for Operating Pen-Based Interfaces Using Touch. In Proc. CHI'07, 657--666.

Digital Library

[30]

Weiss, M., Wagner, J., Jennings, R., Jansen, Y., Khoshabeh, R., Hollan, D. J., and Borchers, J. SLAP widgets: bridging the gap between virtual and physical controls on tabletops. In Proc. of CHI 2009, 3229--3234.

Digital Library

[31]

Wilson, D. A. PlayAnywhere: a compact interactive tabletop projection-vision system. In Proc. of UIST 2005, 83--92.

Digital Library

[32]

Xu, D., Read, C. J., Mazzone, E., and Brown, M. Designing and testing a tangible interface prototype. In Proc. of IDC 2007, 25--28.

Digital Library

[33]

Zimmerman, D. T., Smith, R. J., Paradiso, A. J., Allport, D. and Gershenfeld, N. Applying electric field sensing to human-computer interfaces. In Proc. of CHI 1995, 280--287.

Digital Library

Cited By

Chen WLin SPeng ZParizi FHeo SPatel SMatusik WZhao WStankovic J(2024)ViObjectProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435478:1(1-26)Online publication date: 6-Mar-2024
https://dl.acm.org/doi/10.1145/3643547
Steuerlein BMayer S(2022)Conductive Fiducial Tangibles for EveryoneProceedings of the ACM on Human-Computer Interaction10.1145/35467186:MHCI(1-22)Online publication date: 20-Sep-2022
https://dl.acm.org/doi/10.1145/3546718
Okamoto MMurao K(2022)A Finger Sleeve with Fabricated Electrodes that Generates Multi-touch Interactions on Touch ScreenProceedings of the 2022 ACM International Symposium on Wearable Computers10.1145/3544794.3558473(54-58)Online publication date: 11-Sep-2022
https://dl.acm.org/doi/10.1145/3544794.3558473
Show More Cited By

Index Terms

TUIC: enabling tangible interaction on capacitive multi-touch displays
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens

Index terms have been assigned to the content through auto-classification.

Recommendations

Using tangible drawing tools on a capacitive multi-touch display
BCS-HCI '12: Proceedings of the 26th Annual BCS Interaction Specialist Group Conference on People and Computers

We present an innovative drawing tool that can detect tangible drawing instruments on a capacitive multi-touch tablet. There are three core components to the system: the tangible hardware, the recognizer used to identify the tangibles, and the drawing ...
Graspables revisited: multi-touch vs. tangible input for tabletop displays in acquisition and manipulation tasks
CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

We present an experimental comparison of multi-touch and tangible user interfaces for basic interface actions. Twelve participants completed manipulation and acquisition tasks on an interactive surface in each of three conditions: tangible user ...
Enabling tangible interaction on capacitive touch panels
UIST '10: Adjunct proceedings of the 23nd annual ACM symposium on User interface software and technology

We propose two approaches to sense tangible objects on capacitive touch screens, which are used in off-the-shelf multi-touch devices such as Apple iPad, iPhone, and 3M's multi-touch displays. We seek for the approaches that do not require modifications ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

May 2011

3530 pages

ISBN:9781450302289

DOI:10.1145/1978942

General Chair:
Desney Tan
Microsoft Research
,
Program Chairs:
Geraldine Fitzpatrick
Vienna University of Technology
,
Carl Gutwin
University of Saskatchewan
,
Bo Begole
PARC
,
Wendy A. Kellogg
IBM Research

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '11

Sponsor:

SIGCHI

CHI '11: CHI Conference on Human Factors in Computing Systems

May 7 - 12, 2011

BC, Vancouver, Canada

Acceptance Rates

CHI '11 Paper Acceptance Rate 410 of 1,532 submissions, 27%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

71
Total Citations
View Citations
2,603
Total Downloads

Downloads (Last 12 months)38
Downloads (Last 6 weeks)5

Reflects downloads up to 06 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chen WLin SPeng ZParizi FHeo SPatel SMatusik WZhao WStankovic J(2024)ViObjectProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36435478:1(1-26)Online publication date: 6-Mar-2024
https://dl.acm.org/doi/10.1145/3643547
Steuerlein BMayer S(2022)Conductive Fiducial Tangibles for EveryoneProceedings of the ACM on Human-Computer Interaction10.1145/35467186:MHCI(1-22)Online publication date: 20-Sep-2022
https://dl.acm.org/doi/10.1145/3546718
Okamoto MMurao K(2022)A Finger Sleeve with Fabricated Electrodes that Generates Multi-touch Interactions on Touch ScreenProceedings of the 2022 ACM International Symposium on Wearable Computers10.1145/3544794.3558473(54-58)Online publication date: 11-Sep-2022
https://dl.acm.org/doi/10.1145/3544794.3558473
Zhu ZLiu ZWang TZhang YQian XRaja PVillanueva ARamani K(2022)MechARspace: An Authoring System Enabling Bidirectional Binding of Augmented Reality with Toys in Real-timeProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545668(1-16)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526113.3545668
Yan YHuang ZXudu FYang Z(2022)Enabling Tangible Interaction on Non-touch Displays with Optical Mouse Sensor and Visible Light CommunicationProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517666(1-14)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517666
Dogan MTaka ALu MZhu YKumar AGupta AMueller S(2022)InfraredTags: Embedding Invisible AR Markers and Barcodes Using Low-Cost, Infrared-Based 3D Printing and Imaging ToolsProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501951(1-12)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501951
Seyed TYang XTang AGreenberg SGu JZhu BCao X(2022)CipherCard: A Token-Based Approach Against Camera-Based Shoulder Surfing Attacks on Common Touchscreen DevicesHuman-Computer Interaction – INTERACT 201510.1007/978-3-319-22668-2_34(436-454)Online publication date: 10-Mar-2022
https://dl.acm.org/doi/10.1007/978-3-319-22668-2_34
Okamoto MMurao K(2021)Multi-Touch Interaction Generation Device by Spatiotemporally Switching ElectrodesElectronics10.3390/electronics1012147510:12(1475)Online publication date: 19-Jun-2021
https://doi.org/10.3390/electronics10121475
Sun JFoley MXu QLi CLi JIrani PLi W(2021)PenShaft: Enabling Pen Shaft Detection and Interaction for Touchscreens12th Augmented Human International Conference10.1145/3460881.3460934(1-9)Online publication date: 27-May-2021
https://dl.acm.org/doi/10.1145/3460881.3460934
Wu TXu ZYang XHodges SSeyed TKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Project Tasca: Enabling Touch and Contextual Interactions with a Pocket-based Textile SensorProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445712(1-13)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445712
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents