Article

TouchLight: an imaging touch screen and display for gesture-based interaction

Author:

Andrew D. WilsonAuthors Info & Claims

ICMI '04: Proceedings of the 6th international conference on Multimodal interfaces

Pages 69 - 76

https://doi.org/10.1145/1027933.1027946

Published: 13 October 2004 Publication History

Abstract

A novel touch screen technology is presented. TouchLight uses simple image processing techniques to combine the output of two video cameras placed behind a semi-transparent plane in front of the user. The resulting image shows objects that are on the plane. This technique is well suited for application with a commercially available projection screen material (DNP HoloScreen) which permits projection onto a transparent sheet of acrylic plastic in normal indoor lighting conditions. The resulting touch screen display system transforms an otherwise normal sheet of acrylic plastic into a high bandwidth input/output surface suitable for gesture-based interaction. Image processing techniques are detailed, and several novel capabilities of the system are outlined.

References

[1]

Buxton, B., T. Moran, EuroPARC's Integrated Interactive Intermedia Facility (IIIF): Early Experiences. in IFIP WG8.4 Conference on Multi-User Interfaces and Applications, (1990), 11--34.

Digital Library

[2]

de la Hammette, P., P. Lukowicz, G. Tröster, T. Svoboda, Fingermouse: A Wearable Hand Tracking System. in Ubicomp 2003: Ubiquitous Computing, (2002).

[3]

Dietz, P.H., D. L. Leigh, DiamondTouch: A Multi-User Touch Technology. in ACM Symposium on User Interface Software and Technology (UIST), (2001), 219--226.

Digital Library

[4]

Ferscha A., M.K., DigiScope: An Invisible Worlds Window. in Adjunct Proceedings, The Fifth International Conference on Ubiquitous Computing, (Seattle, 2003), 261--264.

[5]

Horn, B.K.P. Robot Vision. MIT Press, Cambridge, MA, 1986.

Digital Library

[6]

Ishii, H., M. Kobayashi, ClearBoard: A Seamless Media for Shared Drawing and Conversation with Eye-Contact. in Conference on Human Factors in Computing Systems (CHI), (1992), 525--532.

Digital Library

[7]

Kang, S.B. Radial Distortion Snakes. IEICE Transactions on Information and Systems, E84-D (12). 1603--1611.

[8]

Klemmer, S.R., M. W. Newman, R. Farrell, M. Bilezikjian, J. A. Landay, The Designer's Output: A Tangible Interface for Collaborative Web Site Design. in ACM Syposium on User Interface Software and Technology, (2001), 1--10.

Digital Library

[9]

Matsushita, N., J. Rekimoto, HoloWall: Designing a Finger, Hand, Body and Object Sensitive Wall. in ACM Symposium on User Interface Software and Technology (UIST), (1997).

Digital Library

[10]

Paradiso, J.A., C. K. Leo, N. Checka, K. Hsiao, Passive Acoustic Knock Tracking for Interactive Windows. in ACM Conference on Human Factors in Computing: CHI 2002, (2002), 732--733.

Digital Library

[11]

Ringel, M., K. Ryall, C. Shen, C. Forlines, F. Vernier, Release, Rotate, Reorient, Resize: Fluid Techniques for Document Sharing on Multi-User Interactive Tables. in Short Paper, ACM Conference on Human Factors in Computing Systems, (2004).

Digital Library

[12]

Shen, C., F.D. Vernier, C. Forlines, M. Ringel, DiamondSpin: An Extensible Toolkit for Around-the-Table Interaction. in ACM Conference on Human Factors in Computing Systems (CHI), (2004).

Digital Library

[13]

Ullmer, B., H. Ishii, The metaDESK: Models and Prototypes for Tangible User Interfaces. in ACM Symposium on User Interface Software and Technology, (1997), 223--232.

Digital Library

[14]

Wren, C.R., Y. A. Ivanov, Volumetric Operations with Surface Margins. in Computer Vision and Pattern Recognition: Technical Sketches, (2001).

[15]

Wu, M., R. Balakrishnan, Multi-Finger and Whole Hand Gestural Interaction Techniques for Multi-User Tabletop Displays. in ACM Symposium on User Interface Software and Technology, (2003), 193--202.

Digital Library

Cited By

Liu XZhang YTong X(2024)Touchscreen-based Hand Tracking for Remote Whiteboard InteractionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676412(1-14)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676412
Dupré CAppert CRey SSaidi HPietriga E(2024)TriPad: Touch Input in AR on Ordinary Surfaces with Hand Tracking OnlyProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642323(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642323
Liang CWang XLi ZHsia CFan MYu CShi Y(2023)ShadowTouch: Enabling Free-Form Touch-Based Hand-to-Surface Interaction with Wrist-Mounted Illuminant by Shadow ProjectionProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606785(1-14)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606785
Show More Cited By

Index Terms

TouchLight: an imaging touch screen and display for gesture-based interaction
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision tasks
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens

Recommendations

3D Freehand Gestural Navigation for Interactive Public Displays

Users increasingly expect more-interactive experiences with public displays for applications including learning, gaming, urban visualization, and planning. However, user interaction with applications on public displays is challenging and often doesn't ...
GWindows: robust stereo vision for gesture-based control of windows
ICMI '03: Proceedings of the 5th international conference on Multimodal interfaces

Perceptual user interfaces promise modes of fluid computer-human interaction that complement the mouse and keyboard, and have been especially motivated in non-desktop scenarios, such as kiosks or smart rooms. Such interfaces, however, have been slow to ...
Vision-enhanced Immersive Interaction and Remote Collaboration with Large Touch Displays
MM '15: Proceedings of the 23rd ACM international conference on Multimedia

Large displays are becoming commodity, and more and more, they are touch-enabled. In this keynote, we describe a system called ViiBoard (Vision-enhanced Immersive Interaction with touch Board) that enables natural interaction and immersive remote ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICMI '04: Proceedings of the 6th international conference on Multimodal interfaces

October 2004

368 pages

ISBN:1581139950

DOI:10.1145/1027933

General Chairs:
Rajeev Sharma
Advanced Interfaces
,
Trevor Darrell
Massachusetts Institute of Technology
,
Program Chairs:
Mary Harper
Purdue University, West Lafayette, IN
,
Gianni Lazzari
ITC-IRST
,
Matthew Turk
University of California, Santa Barbara, CA

Copyright © 2004 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 October 2004

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

ICMI04

Sponsor:

ICMI04: Sixth International Conference on Multimodal Interfaces 2004

October 13 - 15, 2004

PA, State College, USA

Acceptance Rates

Overall Acceptance Rate 453 of 1,080 submissions, 42%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

185
Total Citations
View Citations
4,404
Total Downloads

Downloads (Last 12 months)70
Downloads (Last 6 weeks)4

Reflects downloads up to 12 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Liu XZhang YTong X(2024)Touchscreen-based Hand Tracking for Remote Whiteboard InteractionProceedings of the 37th Annual ACM Symposium on User Interface Software and Technology10.1145/3654777.3676412(1-14)Online publication date: 13-Oct-2024
https://dl.acm.org/doi/10.1145/3654777.3676412
Dupré CAppert CRey SSaidi HPietriga E(2024)TriPad: Touch Input in AR on Ordinary Surfaces with Hand Tracking OnlyProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642323(1-18)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642323
Liang CWang XLi ZHsia CFan MYu CShi Y(2023)ShadowTouch: Enabling Free-Form Touch-Based Hand-to-Surface Interaction with Wrist-Mounted Illuminant by Shadow ProjectionProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606785(1-14)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606785
Benjamin JBruder GNeumann CReiners DCruz-Neira CWelch G(2023)Perception and Proxemics with Virtual Humans on Transparent Display Installations in Augmented Reality2023 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR59233.2023.00053(386-395)Online publication date: 16-Oct-2023
https://doi.org/10.1109/ISMAR59233.2023.00053
Alkayyali AIravantchi YHerskovitz JSample A(2022)UbiChromics: Enabling Ubiquitously Deployable Interactive Displays with Photochromic PaintProceedings of the ACM on Human-Computer Interaction10.1145/35677146:ISS(118-142)Online publication date: 14-Nov-2022
https://dl.acm.org/doi/10.1145/3567714
Shen VHarrison C(2022)Pull Gestures with Coordinated Graphics on Dual-Screen DevicesProceedings of the 2022 International Conference on Multimodal Interaction10.1145/3536221.3556620(270-277)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3536221.3556620
Shultz CKim DAhuja KHarrison C(2022)TriboTouch: Micro-Patterned Surfaces for Low Latency TouchscreensProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502069(1-13)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3502069
Shen VSpann JHarrison C(2021)FarOut Touch: Extending the Range of ad hoc Touch Sensing with Depth CamerasProceedings of the 2021 ACM Symposium on Spatial User Interaction10.1145/3485279.3485281(1-12)Online publication date: 9-Nov-2021
https://dl.acm.org/doi/10.1145/3485279.3485281
Yang ASankaranarayanan A(2021)Designing Display Pixel Layouts for Under-Panel CamerasIEEE Transactions on Pattern Analysis and Machine Intelligence10.1109/TPAMI.2021.307597843:7(2245-2256)Online publication date: 1-Jul-2021
https://doi.org/10.1109/TPAMI.2021.3075978
Tsuji MKubo HJayasuriya SFunatomi TMukaigawa Y(2021)Touch Sensing for a Projected Screen Using Slope Disparity GatingIEEE Access10.1109/ACCESS.2021.30999019(106005-106013)Online publication date: 2021
https://doi.org/10.1109/ACCESS.2021.3099901
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents