research-article

PhotoelasticTouch: transparent rubbery tangible interface using an LCD and photoelasticity

Authors:

Kentaro FukuchiAuthors Info & Claims

UIST '09: Proceedings of the 22nd annual ACM symposium on User interface software and technology

Pages 43 - 50

https://doi.org/10.1145/1622176.1622185

Published: 04 October 2009 Publication History

Abstract

PhotoelasticTouch is a novel tabletop system designed to intuitively facilitate touch-based interaction via real objects made from transparent elastic material. The system utilizes vision-based recognition techniques and the photoelastic properties of the transparent rubber to recognize deformed regions of the elastic material. Our system works with elastic materials over a wide variety of shapes and does not require any explicit visual markers. Compared to traditional interactive surfaces, our 2.5 dimensional interface system enables direct touch interaction and soft tactile feedback. In this paper we present our force sensing technique using photoelasticity and describe the implementation of our prototype system. We also present three practical applications of PhotoelasticTouch, a force-sensitive touch panel, a tangible face application, and a paint application.

References

[1]

Microsoft Surface. http://www.microsoft.com/surface/.

[2]

Paul Dietz and Darren Leigh. Diamondtouch: a multiuser touch technology. In UIST '01: Proceedings of the 14th annual ACM symposium on User interface software and technology, pages 219--226, New York, NY, USA, 2001. ACM.

Digital Library

[3]

Jefferson Y. Han. Low-cost multi-touch sensing through frustrated total internal reflection. In UIST '05: Proceedings of the 18th annual ACM symposium on User interface software and technology, pages 115--118, New York, NY, USA, 2005. ACM.

Digital Library

[4]

David Holman and Roel Vertegaal. Organic user interfaces: designing computers in any way, shape, or form. Commun. ACM, 51(6):48--55, 2008.

Digital Library

[5]

Hiroshi Ishii and Brygg Ullmer. Tangible bits: towards seamless interfaces between people, bits and atoms. In CHI '97: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 234--241, New York, NY, USA, 1997. ACM.

Digital Library

[6]

Takayuki Iwamoto, Mari Tatezono, Takayuki Hoshi, and Hiroyuki Shinoda. Airborne ultrasound tactile display. In SIGGRAPH '08: ACM SIGGRAPH 2008 new tech demos, pages 1--1, New York, NY, USA, 2008. ACM.

Digital Library

[7]

Kensei Jo, Yasuaki Kakehi, Kouta Minamizawa, Hideaki Nii, Naoki Kawakami, and Susumu Tachi. Arforce: a marker-based augmented reality system for force distribution input. In ACE '08: Proceedings of the 2008 International Conference on Advances in Computer Entertainment Technology, pages 160--165, New York, NY, USA, 2008. ACM.

Digital Library

[8]

Yasuaki Kakehi, Makoto Iida, and Takeshi Naemura. Tablescape plus: upstanding tiny displays on tabletop display. In SIGGRAPH '06: ACM SIGGRAPH 2006 Sketches, page 12, New York, NY, USA, 2006. ACM.

Digital Library

[9]

Kazuto Kamiyama, Hiroyuki Kajimoto, Kevin Vlack, Naoki Kawakami, Terukazu Mizota, and Susumu Tachi. Gelforce. In SIGGRAPH '04: ACM SIGGRAPH 2004 Emerging Technologies, page 5, New York, NY, USA, 2004. ACM.

Digital Library

[10]

Hideki Koike, Shinichiro Nagashima, Yasuto Nakanishi, and Yoichi Sato. Enhancedtable: Supporting a small meeting in ubiquitous and augmented environment. In Pacific Rim Conference on Multimedia, 2004.

Digital Library

[11]

Hideki Koike, Wataru Nishikawa, and Kentaro Fukuchi. Transparent 2-D markers on an LCD tabletop system. In CHI '09: Proceedings of the 27th International Conference on Human Factors in Computing Systems, pages 163--172, New York, NY, USA, 2009. ACM.

Digital Library

[12]

Hongen Liao, Yosuke Ito, Kiyoshi Matsumiya, Ken Masamune, and Takeyoshi Dohi. Object based image rendering and synthesis for computer generated integral videography. In SIGGRAPH '06: ACM SIGGRAPH 2006 Research posters, page 123, New York, NY, USA, 2006. ACM.

Digital Library

[13]

Nobuyuki Matsushita and Jun Rekimoto. Holowall: designing a finger, hand, body, and object sensitive wall. In UIST '97: Proceedings of the 10th annual ACM symposium on User interface software and technology, pages 209--210, New York, NY, USA, 1997. ACM.

Digital Library

[14]

Ben Piper, Carlo Ratti, and Hiroshi Ishii. Illuminating clay: a 3-D tangible interface for landscape analysis. In CHI '02: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 355--362, New York, NY, USA, 2002. ACM.

Digital Library

[15]

Jun Rekimoto. Smartskin: an infrastructure for freehand manipulation on interactive surfaces. In CHI '02: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 113--120, New York, NY, USA, 2002. ACM.

Digital Library

[16]

Katsunari Sato, Kouta Minamizawa, Naoki Kawakami, and Susumu Tachi. Haptic telexistence. In SIGGRAPH '07: ACM SIGGRAPH 2007 emerging technologies, page 10, New York, NY, USA, 2007. ACM.

Digital Library

[17]

Yoichi Sato, Yoshinori Kobayashi, and Hideki Koike. Fast tracking of hands and fingertips in infrared images for augmented desk interface. In FG '00: Proceedings of the Fourth IEEE International Conference on Automatic Face and Gesture Recognition 2000, page 462, Washington, DC, USA, 2000. IEEE Computer Society.

Digital Library

[18]

Brygg Ullmer and Hiroshi Ishii. The metadesk: models and prototypes for tangible user interfaces. In UIST '97: Proceedings of the 10th annual ACM symposium on User interface software and technology, pages 223--232, New York, NY, USA, 1997. ACM.

Digital Library

[19]

Malte Weiss, Julie Wagner, Yvonne Jansen, Roger Jennings, Ramsin Khoshabeh, James D. Hollan, and Jan Borchers. Slap widgets: bridging the gap between virtual and physical controls on tabletops. In CHI '09: Proceedings of the 27th international conference on Human factors in computing systems, pages 481--490, New York, NY, USA, 2009. ACM.

Digital Library

[20]

Ruigang Yang, Xinyu Huang, Sifang Li, and Christopher Jaynes. Toward the light field display: Autostereoscopic rendering via a cluster of projectors. IEEE Transactions on Visualization and Computer Graphics, 14(1):84--96, 2008.

Digital Library

[21]

Ben Piper Carlo Ratti Yao Wang, Assaf Biderman and Professor Hiroshi Ishii. SandScape. http://tangible.media.mit.edu/projects/sandscape/.

Cited By

Getschmann CEchtler FCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)LensLeech: On-Lens Interaction for Arbitrary Camera DevicesProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633382(1-10)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3633382
Sethapakdi THuang LChan VCheng LDall'Agnol FLeake MMueller S(2023)Polagons: Designing and Fabricating Polarized Light Mosaics with User-Defined Color-Changing BehaviorsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580639(1-14)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580639
Mukashev DZhuzbay NKoshkinbayeva AOrazbayev BKappassov Z(2022)PhotoElasticFinger: Robot Tactile Fingertip Based on Photoelastic EffectSensors10.3390/s2218680722:18(6807)Online publication date: 8-Sep-2022
https://doi.org/10.3390/s22186807
Show More Cited By

Index Terms

PhotoelasticTouch: transparent rubbery tangible interface using an LCD and photoelasticity
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Touch screens
    2. Interaction paradigms
      1. Graphical user interfaces

Recommendations

Fluid DTMouse: better mouse support for touch-based interactions
AVI '06: Proceedings of the working conference on Advanced visual interfaces

Although computer mice have evolved physically (i.e., new form factors, multiple buttons, scroll-wheels), their basic metaphor remains the same: a single-point of interaction, with modifiers used to control the interaction. Many of today's novel input ...
Shadow tracking on multi-touch tables
AVI '08: Proceedings of the working conference on Advanced visual interfaces

Multi-touch interfaces have been a focus of research in recent years, resulting in development of various innovative UI concepts. Support for existing WIMP interfaces, however, should not be overlooked. Although several approaches exist, there is still ...
Curve: revisiting the digital desk
NordiCHI '10: Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries

Current desktop workspace environments consist of a vertical area (e.g., a screen with a virtual desktop) and a horizontal area (e.g., the physical desk). Daily working activities benefit from different intrinsic properties of both of these areas. ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '09: Proceedings of the 22nd annual ACM symposium on User interface software and technology

October 2009

278 pages

ISBN:9781605587455

DOI:10.1145/1622176

General Chair:
Andrew Wilson
Microsoft Research, USA
,
Program Chair:
François Guimbretière
Cornell University, USA

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 October 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UIST '09

Sponsor:

UIST '09: The 22nd Annual ACM Symposium on User Interface Software and Technology

October 4 - 7, 2009

BC, Victoria, Canada

Acceptance Rates

Overall Acceptance Rate 561 of 2,567 submissions, 22%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

61
Total Citations
View Citations
1,644
Total Downloads

Downloads (Last 12 months)50
Downloads (Last 6 weeks)11

Reflects downloads up to 09 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Getschmann CEchtler FCiolfi LHogan TDöring TJenkins Tvan Dijk JHuron SLi ZCoyle DSigner B(2024)LensLeech: On-Lens Interaction for Arbitrary Camera DevicesProceedings of the Eighteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3623509.3633382(1-10)Online publication date: 11-Feb-2024
https://dl.acm.org/doi/10.1145/3623509.3633382
Sethapakdi THuang LChan VCheng LDall'Agnol FLeake MMueller S(2023)Polagons: Designing and Fabricating Polarized Light Mosaics with User-Defined Color-Changing BehaviorsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580639(1-14)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580639
Mukashev DZhuzbay NKoshkinbayeva AOrazbayev BKappassov Z(2022)PhotoElasticFinger: Robot Tactile Fingertip Based on Photoelastic EffectSensors10.3390/s2218680722:18(6807)Online publication date: 8-Sep-2022
https://doi.org/10.3390/s22186807
Mitsuzuka MTakarada JKawahara IMorimoto RWang ZKawamura STajitsu Y(2022)Application of High-Photoelasticity Polyurethane to Tactile Sensor for Robot HandsPolymers10.3390/polym1423505714:23(5057)Online publication date: 22-Nov-2022
https://doi.org/10.3390/polym14235057
Lu CHsieh HLiang RLee CYang LXue MGuo JHsieh MChen BKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)Combining Touchscreens with Passive Rich-ID Building Blocks to Support Context Construction in Touchscreen InteractionsProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445722(1-14)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445722
Nishino TMatsuura A(2020)Magic Bounce: Playful Interaction on Superelastic Display2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW)10.1109/VRW50115.2020.00191(680-681)Online publication date: Mar-2020
https://doi.org/10.1109/VRW50115.2020.00191
Boem ATroiano GHarrison SBardzell SNeustaedter CTatar D(2019)Non-Rigid HCIProceedings of the 2019 on Designing Interactive Systems Conference10.1145/3322276.3322347(885-906)Online publication date: 18-Jun-2019
https://dl.acm.org/doi/10.1145/3322276.3322347
Kammer DMüller MWojdziak JFranke I(2018)New Impressions in Interaction Design: A Task Taxonomy for Elastic Displaysi-com10.1515/icom-2018-002117:3(247-255)Online publication date: 14-Nov-2018
https://doi.org/10.1515/icom-2018-0021
Yanagawa YIkematsu KSuga CSasagawa MMatoba YSiio IBrereton M(2017)AnamorphiconsProceedings of the 29th Australian Conference on Computer-Human Interaction10.1145/3152771.3156157(457-461)Online publication date: 28-Nov-2017
https://dl.acm.org/doi/10.1145/3152771.3156157
Parzer PSharma AVogl ASteimle JOlwal AHaller MGajos KMankoff JHarrison C(2017)SmartSleeveProceedings of the 30th Annual ACM Symposium on User Interface Software and Technology10.1145/3126594.3126652(565-577)Online publication date: 20-Oct-2017
https://dl.acm.org/doi/10.1145/3126594.3126652
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents