research-article

Free access

Medusa: a proximity-aware multi-touch tabletop

Authors:

Michelle Annett,

George FitzmauriceAuthors Info & Claims

UIST '11: Proceedings of the 24th annual ACM symposium on User interface software and technology

Pages 337 - 346

https://doi.org/10.1145/2047196.2047240

Published: 16 October 2011 Publication History

Abstract

We present Medusa, a proximity-aware multi-touch tabletop. Medusa uses 138 inexpensive proximity sensors to: detect a user's presence and location, determine body and arm locations, distinguish between the right and left arms, and map touch point to specific users and specific hands. Our tracking algorithms and hardware designs are described. Exploring this unique design, we develop and report on a collection of interactions enabled by Medusa in support of multi-user collaborative design, specifically within the context of Proxi-Sketch, a multi-user UI prototyping tool. We discuss design issues, system implementation, limitations, and generalizable concepts throughout the paper.

Supplementary Material

JPG File (fp370.jpg)

Download
8.17 KB

MP4 File (fp370.mp4)

Download
33.30 MB

References

[1]

Augsten, T., Kaefer, K., Meusel, R., Fetzer, C., Kanitz, D., Stoff, T., Becker, T., Holz, C., and Baudisch, P. Multitoe: high-precision interaction with back-projected floors based on high-resolution multi-touch input. UIST '10, 209--218.

Digital Library

[2]

Ballendat, T., Marquardt, N., and Greenberg, S. Proxemic interaction: Designing for a proximity and orientation-aware environment. ITS '10, 121--130.

Digital Library

[3]

Benko, H., Saponas, T.S., Morris, D., and Tan, D. Enhancing input on and above the interactive surface with muscle sensing. ITS '09, 93--100.

Digital Library

[4]

Benko, H., Wilson, A.D., and Baudisch, P. Precise selection techniques for multi-touch screens. CHI '06, 1263--1272.

Digital Library

[5]

Brignull, H. and Rogers, Y. Enticing people to interact with large public displays in public spaces. INTERACT '03, 17--24.

[6]

Butler, A., Izadi, S., and Hodges, S. SideSight: multi-touch interaction around small devices. UIST '08, 201--204.

Digital Library

[7]

Buxton, W. A three-state model of graphical input. IFIP TC13 '90, 449--456.

Digital Library

[8]

Dang, C.T., Straud, M., and Andre, E. Hand distinction for multi-touch tabletop interaction. ITS '09, 101--108.

Digital Library

[9]

Dietz, P. and Leigh, D. DiamondTouch: a multi-user touch technology. UIST '01, 219--226.

Digital Library

[10]

Esenther, A. and Ryall, K. Fluid DTMouse: better mouse support for touch-based interactions. AVI '06, 112--115.

Digital Library

[11]

Forlines, C. and Shen, C. DTLens: Multi-user tabletop spatial data exploration. UIST '05, 119--122.

Digital Library

[12]

Freeman, D., Benko, H., Morris, M.R., and Wigdor, D. Shadow Guides: Visualizations for InSitu Learning of Multi-Touch and Whole-Hand Gestures. ITS '09, 165--172.

Digital Library

[13]

Grossman, T. and Wigdor, D. Going Deeper: A Taxonomy of 3-D on the Tabletop. ITS '07, 137--144.

[14]

Guiard, Y. Asymmetric division of labor in human skilled bimanual action: The kinematic chain as a model. Journal of Motor Behavior, 1987, 9(4), pp. 486--517.

[15]

Harrison, C. and Hudson, S.E. Abracadabra: Wireless, High-Precision, and Unpowered Finger Input for Very Small Mobile Devices. UIST '09, 121--124.

Digital Library

[16]

Hilliges, O., Izadi, S., Wilson, A.D., Hodges, S., Garcia-Mendoza, A., and Butz, A. Interactions in the air: adding further depth to interactive tabletops. UIST '09, 139--148.

Digital Library

[17]

Izadi, S., Hodges, S., Taylor, S., Rosenfeld, D., Villar, N., Butler, A., and Westhues, J. Going Beyond the Display: A Surface Technology with an Electronically Switchable Diffuser. UIST '08, 268--278.

Digital Library

[18]

Ju, W., Lee, B.A., and Klemmer, S.R. Range: exploring implicit interaction through electronic whiteboard design. CSCW '08, 17--26.

Digital Library

[19]

Kratz, S. and Rohs, M. HoverFlow: expanding the design space of around-device interaction. MobileHCI '09, 1--8.

Digital Library

[20]

Loclair, C., Gustafson, S., and Baudisch, P. Pinch-Watch: A Wearable Device for One-Handed Microinteractions. MobileHCI '10.

[21]

2Matejka, J., Grossman, T., Lo, J., and Fitzmaurice, G. The design and evaluation of multi-finger mouse emulation techniques. CHI '09, 1073--1082.

Digital Library

[22]

2Mueller-Tomfelde, C. Tabletops - Horizontal Interactive Displays. Springer. ISBN: 978--1--84996--112--7.

Digital Library

[23]

Pierce, J. Expanding the Interaction Lexicon for 3D Graphics. Ph.D. Thesis, Carnegie Mellon University, 2001.

Digital Library

[24]

Rekimoto, J. SmartSkin: An Infrastructure for Freehand Manipulation on Interactive Surfaces. CHI '02, 113--120.

Digital Library

[25]

Shen, C., Vernier, F.D., Forliens, C., and Ringel M. DiamondSpin: an extensible toolkit for around-the-table interaction. CHI '04, 167--174.

Digital Library

[26]

Starner, T., Auzier, J., Ashbrook, D., and Gandy, M. The gesture pendant: A self-illuminating, wearable, infrared computer vision system for home automation control and medical monitoring. ISWC '00, 87--94.

Digital Library

[27]

Takeoka, Y., Miyaki, T., and Rekimoto, J. Z-touch: an infrastructure for 3D gesture interaction in the proximity of tabletop surfaces. UIST '10, 91--94.

Digital Library

[28]

Tanase, C.A, Vatavu, R.D., Pentiuc, S.G., and Graur, A. Detecting and Tracking Multiple Users in the Proximity of Interactive Tabletops. Advances in Electrical and Computer Engineering, 2010, 61--64.

[29]

Vogel, D. and Balakrishnan, R. Interactive public ambient displays: transitioning from implicit to explicit, public to personal, interaction with multiple users. UIST '04, 137--146.

Digital Library

[30]

Vogel, D. Direct Pen Input and Hand Occlusion. PhD. Thesis, University of Toronto, 2010.

Digital Library

[31]

3Walther-Franks, B. Schwarten, L., Teichert, J., Krause, M., and Herrlich, M. User detection for a multi-touch table via proximity sensors. ITS '08 Posters.

[32]

3Wang, F., Cao, X., Ren, X., and Irani, P. Detecting and Leveraging Finger Orientation for Interaction with Direct-Touch Surfaces. UIST '09, 23--32.

Digital Library

[33]

3Wigdor, D., Forlines, C., Baudisch, P., Barnwell, J., and Shen, C. LucidTouch: a see-through mobile device. UIST '07, 269--278.

Digital Library

[34]

Wigdor, D., Williams, S., Cronin, M., Levy, R., White, K., Mazeev, M., and Benko, H. Ripples: utilizing per-contact visualizations to improve user interaction with touch displays. UIST '09, 3--12.

Digital Library

[35]

Wilson, A.D. and Benko, H. Combining multiple depth cameras and projectors for interactions on, above and between surfaces. UIST '10, 273--282.

Digital Library

[36]

Wilson, A.D., Izadi, S., Hilliges, O., Garcia-Mendoza, A., and Kirk, D. Bringing physics to the surface. UIST '08, 67--76.

Digital Library

Cited By

Sharma AIvanov ALai FGrossman TSantosa S(2024)GraspUI: Seamlessly Integrating Object-Centric Gestures within the Seven Phases of GraspingProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661551(1275-1289)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661551
Dupré CAppert CRey SSaidi HPietriga E(2024)TriPad: Touch Input in AR on Ordinary Surfaces with Hand Tracking OnlyProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642323(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642323
Li RSeyed TMarquardt NOfek EHodges SSinclair MRomat HPahud MSharma JBuxton WHinckley KRiche N(2023)AdHocProx: Sensing Mobile, Ad-Hoc Collaborative Device Formations using Dual Ultra-Wideband RadiosProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581300(1-18)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581300
Show More Cited By

Index Terms

Medusa: a proximity-aware multi-touch tabletop
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Pen + touch = new tools
UIST '10: Proceedings of the 23nd annual ACM symposium on User interface software and technology

We describe techniques for direct pen+touch input. We observe people's manual behaviors with physical paper and notebooks. These serve as the foundation for a prototype Microsoft Surface application, centered on note-taking and scrapbooking of ...
Pen + Mid-Air: An Exploration of Mid-Air Gestures to Complement Pen Input on Tablets
NordiCHI '16: Proceedings of the 9th Nordic Conference on Human-Computer Interaction

In this paper, we report on a series of studies, exploring the potential of pen and mid-air input on tablets. We describe a field study with an early prototype of a drawing application and follow-up inquiries, such as the development and comparison of ...
Tablets, tabletops, and smartphones: cross-platform comparisons of children’s touchscreen interactions
ICMI '17: Proceedings of the 19th ACM International Conference on Multimodal Interaction

The proliferation of smartphones and tablets has increased children’s access to and usage of touchscreen devices. Prior work on smartphones has shown that children’s touch interactions differ from adults’. However, larger screen devices like tablets ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '11: Proceedings of the 24th annual ACM symposium on User interface software and technology

October 2011

654 pages

ISBN:9781450307161

DOI:10.1145/2047196

General Chair:
Jeff Pierce
IBM Research, USA
,
Program Chairs:
Maneesh Agrawala
University of California, Berkeley, USA
,
Scott Klemmer
Stanford University, USA

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 October 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UIST '11

Sponsor:

UIST '11: The 24th Annual ACM Symposium on User Interface Software and Technology

October 16 - 19, 2011

California, Santa Barbara, USA

Acceptance Rates

UIST '11 Paper Acceptance Rate 67 of 262 submissions, 26%;

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

96
Total Citations
View Citations
1,977
Total Downloads

Downloads (Last 12 months)142
Downloads (Last 6 weeks)15

Reflects downloads up to 12 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Sharma AIvanov ALai FGrossman TSantosa S(2024)GraspUI: Seamlessly Integrating Object-Centric Gestures within the Seven Phases of GraspingProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661551(1275-1289)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661551
Dupré CAppert CRey SSaidi HPietriga E(2024)TriPad: Touch Input in AR on Ordinary Surfaces with Hand Tracking OnlyProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642323(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642323
Li RSeyed TMarquardt NOfek EHodges SSinclair MRomat HPahud MSharma JBuxton WHinckley KRiche N(2023)AdHocProx: Sensing Mobile, Ad-Hoc Collaborative Device Formations using Dual Ultra-Wideband RadiosProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581300(1-18)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581300
Park MYang JYeom MBae BBaek YYoo GLee K(2023) An artificial neuromuscular junction for enhanced reflexes and oculomotor dynamics based on a ferroelectric CuInP 2 S 6 /GaN HEMT Science Advances10.1126/sciadv.adh98899:38Online publication date: 22-Sep-2023
https://doi.org/10.1126/sciadv.adh9889
Nakamura FMurakami MSuzuki KFukuoka MMasai KSugimoto M(2023)Analyzing the Effect of Diverse Gaze and Head Direction on Facial Expression Recognition With Photo-Reflective Sensors Embedded in a Head-Mounted DisplayIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.317976629:10(4124-4139)Online publication date: 1-Oct-2023
https://doi.org/10.1109/TVCG.2022.3179766
Vatavu R(2023)Gesture-Based InteractionHandbook of Human Computer Interaction10.1007/978-3-319-27648-9_20-1(1-47)Online publication date: 9-Feb-2023
https://doi.org/10.1007/978-3-319-27648-9_20-1
Xia HGlueck MAnnett MWang MWigdor D(2022)Iteratively Designing Gesture Vocabularies: A Survey and Analysis of Best Practices in the HCI LiteratureACM Transactions on Computer-Human Interaction10.1145/350353729:4(1-54)Online publication date: 5-May-2022
https://dl.acm.org/doi/10.1145/3503537
Yan YHuang ZXudu FYang Z(2022)Enabling Tangible Interaction on Non-touch Displays with Optical Mouse Sensor and Visible Light CommunicationProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3517666(1-14)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3517666
Singh APeachey MKaur RHaltner PFrederick SAlnusayri MManco DMorris CBrownlee SMalloch JReilly D(2022)Supporting Spatial Thinking in Augmented Reality Narrative: A Field StudyInteractive Storytelling10.1007/978-3-031-22298-6_17(270-291)Online publication date: 2-Dec-2022
https://doi.org/10.1007/978-3-031-22298-6_17
Shavitt CKuzminykh ARidel ICauchard J(2021)Naturally Together: A Systematic Approach for Multi-User Interaction With Natural InterfacesProceedings of the ACM on Human-Computer Interaction10.1145/34760905:CSCW2(1-31)Online publication date: 18-Oct-2021
https://dl.acm.org/doi/10.1145/3476090
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents