research-article

tPad: designing transparent-display mobile interactions

Authors:

Juan David Hincapié-Ramos,

Sophie Roscher,

Wolfgang Büschel,

Raimund Dachselt,

Pourang IraniAuthors Info & Claims

DIS '14: Proceedings of the 2014 conference on Designing interactive systems

Pages 161 - 170

https://doi.org/10.1145/2598510.2598578

Published: 21 June 2014 Publication History

Abstract

As a novel class of mobile devices with rich interaction capabilities we introduce tPads -- transparent display tablets. tPads are the result of a systematic design investigation into the ways and benefits of interacting with transparent mobiles which goes beyond traditional mobile interactions and augmented reality (AR) applications. Through a user-centered design process we explored interaction techniques for transparent-display mobiles and classified them into four categories: overlay, dual display & input, surface capture and model-based interactions. We investigated the technical feasibility of such interactions by designing and building two touch-enabled semi-transparent tablets called tPads and a range of tPad applications. Further, a user study shows that tPad interactions applied to everyday mobile tasks (application switching and image capture) outperform current mobile interactions and were preferred by users. Our hands-on design process and experimental evaluation demonstrate that transparent displays provide valuable interaction opportunities for mobile devices.

Supplementary Material

suppl.mov (dis0446-file3.mp4)

Supplemental video

Download
42.96 MB

References

[1]

Abileah, A., Den Boer, W., and Green, P. 2010. Light sensitive display. U.S. Patent No. 7,830,461. 9 Nov. 2010.

[2]

Alahi, A. and Ortiz, R. and Vandergheynst, P. 2012. FREAK: Fast Retina Keypoint. In Proc. CVPR '12. IEEE.

Digital Library

[3]

Azuma, R., Baillot, Y., Behringer, R., Feiner, S., Julier, S., and MacIntyre, B. 2001. Recent Advances in Augmented Reality. Computer Graphics. 21, 6. IEEE.

Digital Library

[4]

Bier, E. A., Stone, M. C., Pier, K., Buxton, W., and DeRose, T. D. 1993. Toolglass and magic lenses: the seethrough interface. In Proc. SIGGRAPH '93.

Digital Library

[5]

Bimber, O. and Raskar, R. 2005. Spatial Augmented Reality: Merging Real and Virtual Worlds. A. K. Peters, Ltd., Natick, MA, USA.

Digital Library

[6]

Böhmer, M., Hecht, B., Schöning, J., Krüger, A. and Bauer, G. 2011. Falling asleep with Angry Birds, Facebook and Kindle -- A large scale study on mobile application usage. In Proc. MobileHCI '11, ACM.

Digital Library

[7]

Concept Phones. (2013, March 17). Transparent Phones. {Website}. Retrieved from http://www.conceptphones.com/tag/transparent-phone/.

[8]

Concept Vending Machine With See-through Display (2013, September 13). Youtube {Website}. Retrieved from http://www.youtube.com/watch?v=8pPCIPHTe3M.

[9]

Corning Incorporated. (2013, March 17). A Day Made of Glass 2: Unpacked. The Story Behind Corning's Vision. (2012) {Website}. Retrieved from http://www.youtube.com/watch?v=X-GXO_urMow.

[10]

Dachselt, R. and Al-Saiegh, S. 2011. Interacting with printed books using digital pens and smart mobile projection. In Proc. of the Workshop on Mobile and Personal Projection (MP2) @ ACM CHI '11.

[11]

Dunlop, M. and Brewster, S. 2002. The Challenge of Mobile Devices for Human Computer Interaction. Personal Ubiquitous Computing. 6, 4.

Digital Library

[12]

Gabbard, J.L., Swan, J.E., Zedlitz, J., and Winchester, W.W. 2010. More than meets the eye: An engineering study to empirically examine the blending of real and virtual color spaces. In Proc. VR '10. IEEE.

Digital Library

[13]

Hilliges, O., Kim, D., Izadi, S., Weiss, M., and Wilson, A. 2012. HoloDesk: direct 3d interactions with a situated see-through display. In Proc CHI '12. ACM.

Digital Library

[14]

Hinckley, K., Dixon, M., Sarin, R., Guimbretiere, F., and Balakrishnan, B. 2009. Codex: a dual screen tablet computer. In Proc. CHI '09. ACM.

Digital Library

[15]

Hinckley, K., and Song, H. 2011. Sensor synaesthesia: touch in motion, and motion in touch. In Proc. CHI '11. ACM.

Digital Library

[16]

Kim, K., and Elmqvist, N. 2012. Embodied lenses for collaborative visual queries on tabletop displays. Information Visualization, 11(4), 319--338.

Digital Library

[17]

Kindberg, T., Spasojevic, M., Fleck, R., and Sellen, A. 2005. The Ubiquitous Camera: An In-Depth Study of Camera Phone Use. IEEE Pervasive Computing.

Digital Library

[18]

Lee, J., Olwal, A., Ishii, H., and Boulanger, C. 2013. SpaceTop: integrating 2D and spatial 3D interactions in a see-through desktop environment. In Proc CHI '13. ACM.

Digital Library

[19]

Lee, J.H., Bae, S.H., Jung, J., and Choi, H. 2012. Transparent display interaction without binocular parallax. In Adjunct Proc. UIST '12. ACM.

Digital Library

[20]

Levia, L.A., Böhmer, M., Gehring, S. and Krüger, A. 2012. Back to the app: The costs of mobile application interrruptions. In Proc. MobileHCI '12, ACM.

Digital Library

[21]

Li, Y., Hinckley, K., Guan, Z., and Landay, J. A. 2005. Experimental analysis of mode switching techniques in pen-based user interfaces. In Proc. CHI '05. ACM.

Digital Library

[22]

Liao, C., Liu, Q., Liew, B., and Wilcox, L. 2010. Pacer: fine-grained interactive paper via camera-touch hybrid gestures on a cell phone. In Proc. CHI '10. ACM.

Digital Library

[23]

Mackay, W.E., Pothier, G., Letondal, C., Bøegh, K., and Sørensen, H.E. 2002. The missing link: augmenting biology laboratory notebooks. In Proc. UIST '02. ACM.

Digital Library

[24]

Ohtani, T., Hashida, T., Kakehi, Y., and Naemura, T. 2011. Comparison of front touch and back touch while using transparent double-sided touch display. In ACM SIGGRAPH 2011 Posters (SIGGRAPH '11). ACM.

Digital Library

[25]

Olwal, A., Lindfors, C., Gustafsson, J., Kjellberg, T., and Mattsson, L. 2005. ASTOR: An autostereoscopic optical see-thru augmented reality system. In Proc. ISMAR '05. IEEE.

Digital Library

[26]

Rosten, E. and Drummond, T. 2006. Machine learning for high-speed corner detection. In Proc. ECCV '06. Springer Berlin Heidelberg.

Digital Library

[27]

Ruiz, J., and Li, Y. 2011. DoubleFlip: a motion gesture delimiter for mobile interaction. In Proc. CHI '11. ACM.

Digital Library

[28]

Schilit, B. N., Golovchinsky, G., and Price, M. N. 1998. Beyond paper: supporting active reading with free form digital ink annotations. In Proc. CHI '98. ACM.

Digital Library

[29]

Schmalstieg, D., Encarnação, L. M., and Szalavári, Z. 1999. Using transparent props for interaction with the virtual table. In Proc. I3D '99. ACM.

Digital Library

[30]

Sharma, A., Liu, L., and Maes, P. 2013. Glassified: An Augmented Ruler based on a Transparent Display for Real-time Interactions with Paper. In Proc. UIST '13 Demos.

Digital Library

[31]

Spindler, M., Tominski, C., Schumann, H., and Dachselt, R. 2010. Tangible views for information visualization. In Proc. ITS '10. ACM.

Digital Library

[32]

Sridharan, S.K., Hincapié-Ramos, J.D., Flatla, D., and Irani, P. 2013. Color Correction for Optical See-Through Displays Using Display Color Profiles. In Proc. VRST '13. ACM.

Digital Library

[33]

Transparent dual-touch display Android smartphone prototype #DigInfo. (2012). {Website}. Retrieved from http://www. youtube.com/watch?v=Xbyoool5ZwY.

[34]

Uy, M. 2009. Integrated sensing display. U.S. Patent No. 7,535,468. 19 May 2009.

[35]

Wigdor, D., Forlines, C., Baudisch, P., Barnwell, J., and Shen, C. 2007. Lucid touch: a see-through mobile device. In Proc. UIST '07. ACM.

Digital Library

Cited By

Tsai YDai HYan YOu‐Yang M(2024)Fusion information refresh rate improvement based on adaptive visual tracking in vehicle augmented reality sightseeing interactive systemJournal of the Society for Information Display10.1002/jsid.127632:8(545-554)Online publication date: 10-Mar-2024
https://doi.org/10.1002/jsid.1276
Sun ZWang SLiu CMa X(2022)Metaphoraction: Support Gesture-based Interaction Design with Metaphorical MeaningsACM Transactions on Computer-Human Interaction10.1145/351189229:5(1-33)Online publication date: 20-Oct-2022
https://dl.acm.org/doi/10.1145/3511892
Qian JSun QWigington CHan HSun THealey JTompkin JHuang J(2022)Dually Noted: Layout-Aware Annotations with Smartphone Augmented RealityProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502026(1-15)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3502026
Show More Cited By

Index Terms

tPad: designing transparent-display mobile interactions
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Glassified: an augmented ruler based on a transparent display for real-time interactions with paper
UIST '13 Adjunct: Adjunct Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology

We introduce Glassified, a modified ruler with a transparent display to supplement physical strokes made on paper with virtual graphics. Because the display is transparent, both the physical strokes and the virtual graphics are visible in the same ...
A two-sided collaborative transparent display supporting workspace awareness

Transparent displays naturally support workspace awareness during face-to-face interactions. Viewers see another persons actions through the display: gestures, gaze, body movements, and what one is manipulating on the display. Yet we can design even ...
Demonstrating CleAR Sight: Transparent Interaction Panels for Augmented Reality
CHI EA '23: Extended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems

In this work, we demonstrate our concepts for transparent interaction panels in augmented-reality environments. Mobile devices can support interaction with head-mounted displays by providing additional input channels, such as touch & pen input and ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

DIS '14: Proceedings of the 2014 conference on Designing interactive systems

June 2014

1102 pages

ISBN:9781450329026

DOI:10.1145/2598510

General Chairs:
Ron Wakkary
Simon Fraser University
,
Steve Harrison
Virginia Tech
,
Program Chairs:
Carman Neustaedter
Simon Fraser University
,
Shaowen Bardzell
Indiana University
,
Eric Paulos
UC Berkeley

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 21 June 2014

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Deutsche Forschungsgemeinschaft
Natural Sciences and Engineering Research Council of Canada
LEIF Transatlantic Exchange Partnership project

Conference

DIS '14

Sponsor:

SIGCHI

DIS '14: Designing Interactive Systems Conference 2014

June 21 - 25, 2014

BC, Vancouver, Canada

Acceptance Rates

DIS '14 Paper Acceptance Rate 107 of 402 submissions, 27%;

Overall Acceptance Rate 1,158 of 4,684 submissions, 25%

Upcoming Conference

DIS '25

Sponsor:
sigchi

Designing Interactive Systems Conference

July 5 - 9, 2025

Funchal , Portugal

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
419
Total Downloads

Downloads (Last 12 months)18
Downloads (Last 6 weeks)3

Reflects downloads up to 27 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Tsai YDai HYan YOu‐Yang M(2024)Fusion information refresh rate improvement based on adaptive visual tracking in vehicle augmented reality sightseeing interactive systemJournal of the Society for Information Display10.1002/jsid.127632:8(545-554)Online publication date: 10-Mar-2024
https://doi.org/10.1002/jsid.1276
Sun ZWang SLiu CMa X(2022)Metaphoraction: Support Gesture-based Interaction Design with Metaphorical MeaningsACM Transactions on Computer-Human Interaction10.1145/351189229:5(1-33)Online publication date: 20-Oct-2022
https://dl.acm.org/doi/10.1145/3511892
Qian JSun QWigington CHan HSun THealey JTompkin JHuang J(2022)Dually Noted: Layout-Aware Annotations with Smartphone Augmented RealityProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3502026(1-15)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3502026
Krug KBuschel WKlamka KDachselt R(2022)CleAR Sight: Exploring the Potential of Interacting with Transparent Tablets in Augmented Reality2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR55827.2022.00034(196-205)Online publication date: Oct-2022
https://doi.org/10.1109/ISMAR55827.2022.00034
Mohr PTatzgern MGrubert JSchmalstieg DKalkofen D(2017)Adaptive user perspective rendering for Handheld Augmented Reality2017 IEEE Symposium on 3D User Interfaces (3DUI)10.1109/3DUI.2017.7893336(176-181)Online publication date: 2017
https://doi.org/10.1109/3DUI.2017.7893336
Grbac JKljun MPucihar KGombač L(2016)Collaborative Annotation Sharing in Physical and Digital WorldsTechnology and Intimacy: Choice or Coercion10.1007/978-3-319-44805-3_24(303-313)Online publication date: 25-Aug-2016
https://doi.org/10.1007/978-3-319-44805-3_24
Kong XXiong SXiong SZhu ZLong G(2016)A Field Evaluation: The Effects of Rear-Camera-On Mode for Texting While WalkingAdvances in The Human Side of Service Engineering10.1007/978-3-319-41947-3_26(275-285)Online publication date: 17-Jul-2016
https://doi.org/10.1007/978-3-319-41947-3_26
Bianchi ABan SOakley IBegole BKim JInkpen KWoo W(2015)Designing a Physical Aid to Support Active Reading on TabletsProceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems10.1145/2702123.2702303(699-708)Online publication date: 18-Apr-2015
https://dl.acm.org/doi/10.1145/2702123.2702303
Dumesny JTomitsch MLeong T(2014)Reconciling paper and tabletsProceedings of the 26th Australian Computer-Human Interaction Conference on Designing Futures: the Future of Design10.1145/2686612.2686641(184-193)Online publication date: 2-Dec-2014
https://dl.acm.org/doi/10.1145/2686612.2686641
Hincapié-Ramos JRoscher SBüschel WKister UDachselt RIrani PBoring SQuigley A(2014)cARProceedings of The International Symposium on Pervasive Displays10.1145/2611009.2611014(80-85)Online publication date: 3-Jun-2014
https://dl.acm.org/doi/10.1145/2611009.2611014

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten