research-article

HideOut: mobile projector interaction with tangible objects and surfaces

Authors:

Karl D. D. Willis,

Takaaki Shiratori,

Moshe MahlerAuthors Info & Claims

TEI '13: Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction

Pages 331 - 338

https://doi.org/10.1145/2460625.2460682

Published: 10 February 2013 Publication History

Abstract

HideOut is a mobile projector-based system that enables new applications and interaction techniques with tangible objects and surfaces. HideOut uses a device mounted camera to detect hidden markers applied with infrared-absorbing ink. The obtrusive appearance of fiducial markers is avoided and the hidden marker surface doubles as a functional projection surface. We present example applications that demonstrate a wide range of interaction scenarios, including media navigation tools, interactive storytelling applications, and mobile games. We explore the design space enabled by the HideOut system and describe the hidden marker prototyping process. HideOut brings tangible objects to life for interaction with the physical world around us.

References

[1]

Audet, S., and Okutomi, M. A user-friendly method to geometrically calibrate projector-camera systems. In Proc. IEEE Procams (2009), 47--54.

[2]

Bandyopadhyay, D., Raskar, R., and Fuchs, H. Dynamic shader lamps: Painting on movable objects. In Proc. IEEE ISAR (2001), 207--216.

Digital Library

[3]

Bimber, O., and Raskar, R. Spatial Augmented Reality: Merging Real and Virtual Worlds. A K Peters, 2005.

Digital Library

[4]

Cao, X., and Balakrishnan, R. Interacting with dynamically defined information spaces using a handheld projector and a pen. In Proc. ACM UIST (2006), 225--234.

Digital Library

[5]

Cao, X., Forlines, C., and Balakrishnan, R. Multi-user interaction using handheld projectors. In Proc. ACM UIST (2007), 43--52.

Digital Library

[6]

Cowan, L. G., and Li, K. A. Shadowpuppets: Supporting collocated interaction with mobile projector phones using hand shadows. In CHI '11, ACM (2011), 2707--2716.

Digital Library

[7]

Harrison, C., Benko, H., and Wilson, A. D. OmniTouch: Wearable multitouch interaction everywhere. In Proc. ACM UIST (2011), 441--450.

Digital Library

[8]

Hartley, R. I., and Zisserman, A. Multiple View Geometry in Computer Vision. Cambridge University Press, 2004.

Digital Library

[9]

Huber, J., Steiml, J., Liao, C., Li, Q., and Mühlhäuser, M. Lightbeam: Nomadic pico projector interaction with real world objects. In Proc. ACM CHI '12 (2012).

Digital Library

[10]

Hyakutake, A., Ozaki, K., Kitani, K. M., and Koike, H. 3-D interaction with a large wall display using transparent markers. In Proc. ACM AVI (2010), 97--100.

Digital Library

[11]

Izadi, S., Hodges, S., Taylor, S., Rosenfeld, D., Villar, N., Butler, A., and Westhues, J. Going beyond the display: A surface technology with an electronically switchable diffuser. In Proc. ACM UIST (2008), 269--278.

Digital Library

[12]

Izadi, S., Kim, D., Hilliges, O., Molyneaux, D., Newcombe, R., Kohli, P., Shotton, J., Hodges, S., Freeman, D., Davison, A., and Fitzgibbon, A. KinectFusion: Real-time 3D reconstruction and interaction using a moving depth camera. In Proc. ACM UIST (2011), 559--568.

Digital Library

[13]

Jacob, R. J., Girouard, A., Hirshfield, L. M., Horn, M. S., Shaer, O., Solovey, E. T., and Zigelbaum, J. Reality-based interaction: A framework for post-WIMP interfaces. In Proc. ACM CHI (2008), 201--210.

Digital Library

[14]

Kane, S. K., Avrahami, D., Wobbrock, J. O., Harrison, B., Rea, A. D., Philipose, M., and LaMarca, A. Bonfire: A nomadic system for hybrid laptop-tabletop interaction. In Proc. ACM UIST (2009), 129--138.

Digital Library

[15]

Koike, H., Nishikawa, W., and Fukuchi, K. Transparent 2-D markers on an LCD tabletop system. In Proc. ACM CHI (2009), 163--172.

Digital Library

[16]

Lee, J. C., Hudson, S. E., Summet, J. W., and Dietz, P. H. Moveable interactive projected displays using projector based tracking. In Proc. ACM UIST (2005), 63--72.

Digital Library

[17]

Lee, J. C., Hudson, S. E., and Tse, E. Foldable interactive displays. In Proc. ACM UIST, UIST '08 (2008), 287--290.

Digital Library

[18]

Lee, J.-E., Miyashita, S., Azuma, K., Lee, J.-H., and Park, G.-T. Anamorphosis projection by ubiquitous display in intelligent space. In Proc. UAHCI (2009), 209--217.

Digital Library

[19]

Markets and Markets. Pico projector by application, technology & products market, 2010. http://www.marketsandmarkets.com/Market-Reports/pico-projector-market-196.html.

[20]

Mistry, P., Maes, P., and Chang, L. Wuw - wear ur world - a wearable gestural interface. In Ext. Abstracts ACM CHI '09 (2009), 4111--4116.

Digital Library

[21]

Molyneaux, D., Izadi, S., Kim, D., Hilliges, O., Hodges, S., Cao, X., Butler, A., and Gellersen, H. Interactive environment-aware handheld projectors for pervasive computing spaces. In Proc. Pervasive (2012).

Digital Library

[22]

Nakazato, Y., Kanbara, M., and Yokoya, N. Localization system for large indoor environments using invisible markers. In Proc. ACM VRST (2008), 295--296.

Digital Library

[23]

Nam, T. Sketch-based rapid prototyping platform for hardware-software integrated interactive products. In Proc. ACM CHI Ext. Abstracts (2005), 1689--1692.

Digital Library

[24]

Ni, T., Karlson, A. K., and Wigdor, D. AnatOnMe: facilitating doctor-patient communication using a projection-based handheld device. In Proc. ACM CHI (2011), 3333--3342.

Digital Library

[25]

Park, H., and Park, J.-I. Invisible marker tracking for AR. In Proc. IEEE/ACM ISMAR (2004), 272--273.

Digital Library

[26]

Park, H., and Park, J.-I. Invisible marker based augmented reality system. In Proc. SPIE VCIP, vol. 5960 (2005), 501--508.

[27]

Park, H., and Park, J.-I. Invisible marker-based augmented reality. International Journal of Human-Computer Interaction 26, 9 (2010), 829--848.

[28]

Pinhanez, C. S. The everywhere displays projector: A device to create ubiquitous graphical interfaces. In Proc. ACM UbiComp (2001), 315--331.

Digital Library

[29]

Rapp, S., Michelitsch, G., Osen, M., Williams, J., Barbisch, M., Bohan, R., Valsan, Z., and Emele, M. Spotlight navigation: Interaction with a handheld projection device. In Proc. Pervasive, video paper (2004).

[30]

Raskar, R., Beardsley, P., van Baar, J., Wang, Y., Dietz, P., Lee, J., Leigh, D., and Willwacher, T. RFIG lamps: Interacting with a self-describing world via photosensing wireless tags and projectors. ACM Trans. on Graphics 23, 3 (2004), 406--415.

Digital Library

[31]

Raskar, R., Welch, G., Low, K.-L., and Bandyopadhyay, D. Shader lamps: Animating real objects with image-based illumination. In Proc. Eurographics Workshop on Rendering Techniques (2001), 89--102.

Digital Library

[32]

Rekimoto, J., and Saitoh, M. Augmented surfaces: A spatially continuous work space for hybrid computing environments. In Proc. ACM CHI (1999), 378--385.

Digital Library

[33]

Rosner, D. K., and Ryokai, K. Spyn: Augmenting knitting to support storytelling and reflection. In Proc. ACM UbiComp (2008), 340--349.

Digital Library

[34]

Song, H., Guimbretiere, F., Grossman, T., and Fitzmaurice, G. MouseLight: Bimanual interactions on digital paper using a pen and a spatially-aware mobile projector. In Proc. ACM CHI (2010), 2451--2460.

Digital Library

[35]

Spindler, M., Tominski, C., Schumann, H., and Dachselt, R. Tangible views for information visualization. In Proc. ACM ITS (2010), 157--166.

Digital Library

[36]

Willis, K. D., Poupyrev, I., Hudson, S. E., and Mahler, M. SideBySide: Ad-hoc multi-user interaction with handheld projectors. In Proc. ACM UIST (2011), 431--440.

Digital Library

[37]

Willis, K. D., Poupyrev, I., and Shiratori, T. Motion-Beam: A metaphor for character interaction with handheld projectors. In Proc. ACM CHI (2011), 1031--1040.

Digital Library

[38]

Wilson, A. D. PlayAnywhere: A compact interactive tabletop projection-vision system. In Proc. ACM UIST (2005), 83--92.

Digital Library

[39]

Wilson, A. D., and Benko, H. Combining multiple depth cameras and projectors for interactions on, above and between surfaces. In Proc. ACM UIST (2010), 273--282.

Digital Library

[40]

Yoshida, T., Hirobe, Y., Nii, H., Kawakami, N., and Tachi, S. Twinkle: Interacting with physical surfaces using handheld projector. In Proc. IEEE VR (2010), 87--90.

Digital Library

Cited By

Ranjan KEisenberg AFiedler BGreenberg JSmith TMoore E(2025)Physical Computing with Paper Playground: Exploring a Multimodal PlatformProceedings of the Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3689050.3705981(1-7)Online publication date: 4-Mar-2025
https://dl.acm.org/doi/10.1145/3689050.3705981
He FHu XQian XZhu ZRamani K(2024)AdapTUI: Adaptation of Geometric-Feature-Based Tangible User Interfaces in Augmented RealityProceedings of the ACM on Human-Computer Interaction10.1145/36981278:ISS(44-69)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698127
Chen YCasiez GMalacria SVogel D(2024)LuxAR: A Direct Manipulation Projected Display to Extend and Augment Desktop ComputingProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670981(1-12)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670981
Show More Cited By

Index Terms

HideOut: mobile projector interaction with tangible objects and surfaces
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

3-D interaction with a large wall display using transparent markers
AVI '10: Proceedings of the International Conference on Advanced Visual Interfaces

In this paper we proposed a new interface for interacting with large displays via small video devices such as a cell phone. We estimate the location of the camera relative to the display using a matrix of transparent markers embedded on display. As a ...
Rock-paper-fibers: bringing physical affordance to mobile touch devices
CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

We explore how to bring physical affordance to mobile touch devices. We present Rock-Paper-Fibers, a device that is functionally equivalent to a touchpad, yet that users can reshape so as to best match the interaction at hand. For efficiency, users ...
Exploring Expressive NFC-Based Mobile Phone Interaction with Large Dynamic Displays
NFC '09: Proceedings of the 2009 First International Workshop on Near Field Communication

Inherent obstacles in current mobile applications are the limited input and output capabilities of mobile phones. In many ways, e.g. in terms of display capabilities and processing power, today’s mobile phones are quite versatile and provide opportunity ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

TEI '13: Proceedings of the 7th International Conference on Tangible, Embedded and Embodied Interaction

February 2013

439 pages

ISBN:9781450318983

DOI:10.1145/2460625

Conference Chairs:
Sergi Jordà
Universitat Pompeu Fabra, Barcelona, Spain
,
Narcis Parés
Universitat Pompeu Fabra, Barcelona, Spain

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 10 February 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

TEI'13

Sponsor:

SIGCHI

TEI'13: Seventh International Conference on Tangible, Embedded, and Embodied Interaction

February 10 - 13, 2013

Barcelona, Spain

Acceptance Rates

TEI '13 Paper Acceptance Rate 48 of 136 submissions, 35%;

Overall Acceptance Rate 393 of 1,367 submissions, 29%

Upcoming Conference

TEI '25

Sponsor:
sigchi

Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction

March 4 - 7, 2025

Bordeaux / Talence , France

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

63
Total Citations
View Citations
1,037
Total Downloads

Downloads (Last 12 months)75
Downloads (Last 6 weeks)10

Reflects downloads up to 25 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Ranjan KEisenberg AFiedler BGreenberg JSmith TMoore E(2025)Physical Computing with Paper Playground: Exploring a Multimodal PlatformProceedings of the Nineteenth International Conference on Tangible, Embedded, and Embodied Interaction10.1145/3689050.3705981(1-7)Online publication date: 4-Mar-2025
https://dl.acm.org/doi/10.1145/3689050.3705981
He FHu XQian XZhu ZRamani K(2024)AdapTUI: Adaptation of Geometric-Feature-Based Tangible User Interfaces in Augmented RealityProceedings of the ACM on Human-Computer Interaction10.1145/36981278:ISS(44-69)Online publication date: 24-Oct-2024
https://dl.acm.org/doi/10.1145/3698127
Chen YCasiez GMalacria SVogel D(2024)LuxAR: A Direct Manipulation Projected Display to Extend and Augment Desktop ComputingProceedings of the 50th Graphics Interface Conference10.1145/3670947.3670981(1-12)Online publication date: 3-Jun-2024
https://dl.acm.org/doi/10.1145/3670947.3670981
Liang Rvan Iterson HKrueger HToeters MFeijs L(2024)Chic-Marker: Fashionably Fusing Fiducial Markers into Apparel and AccessoriesProceedings of the 9th ACM Symposium on Computational Fabrication10.1145/3639473.3665790(1-15)Online publication date: 7-Jul-2024
https://dl.acm.org/doi/10.1145/3639473.3665790
Patnaik BPeng HElmqvist N(2024)VisTorch: Interacting with Situated Visualizations using Handheld ProjectorsProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642857(1-13)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642857
Yasumoto M(2024)Shadow Shooter: All-Around Game with e-Yumi 3DEncyclopedia of Computer Graphics and Games10.1007/978-3-031-23161-2_63(1634-1637)Online publication date: 5-Jan-2024
https://doi.org/10.1007/978-3-031-23161-2_63
Dogan MGarcia-Martin RHaertel PO'Keefe JTaka AAurora ASanchez-Reillo RMueller S(2023)BrightMarker: 3D Printed Fluorescent Markers for Object TrackingProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606758(1-13)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606758
Dogan MSiu AHealey JWigington CXiao CSun T(2023)StandARone: Infrared-Watermarked Documents as Portable Containers of AR Interaction and PersonalizationExtended Abstracts of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544549.3585905(1-7)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544549.3585905
Fukuda SKagami SHashimoto K(2022)Evaluation of Perceptual Difference in Dynamic Projection Mapping with and without Movement of the Target SurfaceJournal of Robotics and Mechatronics10.20965/jrm.2022.p114134:5(1141-1151)Online publication date: 20-Oct-2022
https://doi.org/10.20965/jrm.2022.p1141
Xu RSato TMiyafuji SKoike HBottoni PPanizzi E(2022)OmniLantern: Design and Implementations of a Portable and Coaxial Omnidirectional Projector-Camera SystemProceedings of the 2022 International Conference on Advanced Visual Interfaces10.1145/3531073.3531126(1-5)Online publication date: 6-Jun-2022
https://dl.acm.org/doi/10.1145/3531073.3531126
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten