abstract

FreeTop: Finding Free Spots for Projective Augmentation

Authors:

Mohammadreza Khalilbeigi,

Martin Schmitz,

Sebastian Doeweling,

Florian Müller,

Max MühlhäuserAuthors Info & Claims

CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

Pages 1598 - 1606

https://doi.org/10.1145/2851581.2892321

Published: 07 May 2016 Publication History

Abstract

Augmenting the physical world using projection technologies or head-worn displays becomes increasingly popular in research and commercial applications. However, a common problem is interference between the physical surface's texture and the projection. In this paper, we present FreeTop, a combined approach to finding areas suitable for projection, which considers multiple aspects influencing projection quality, like visual texture and physical surface structure. FreeTop can be used in stationary and mobile settings for locating free areas in arbitrary physical settings suitable for projective augmentation and touch interaction.

References

[1]

Blaine Bell, Steven Feiner, and Tobias Höllerer. 2001. View Management for Virtual and Augmented Reality. In Proceedings of the 14th Annual ACM Symposium on User Interface Software and Technology (UIST '01). ACM, New York, NY, USA, 101-110.

Digital Library

[2]

Daniel Cotting and Markus Gross. 2006. Interactive environment-aware display bubbles. In Proceedings of the 19th annual ACM symposium on User interface software and technology (UIST '06). ACM, New York, NY, USA, 245-254.

Digital Library

[3]

Barrett Ens, Eyal Ofek, Neil Bruce, and Pourang Irani. 2015. Spatial Constancy of Surface-Embedded Layouts Across Multiple Environments. In Proceedings of the 3rd ACM Symposium on Spatial User Interaction (SUI '15). ACM, New York, NY, USA, 65-68. org/10.1145/2788940.2788954

Digital Library

[4]

Euan Freeman and Stephen Brewster. 2013. Messy Tabletops: Clearing Up the Occlusion Problem. In CHI '13 Extended Abstracts on Human Factors in Computing Systems (CHI EA '13). ACM, New York, NY, USA, 1515-1520.

Digital Library

[5]

Kensaku Fujii, Michael D. Grossberg, and Shree K. Nayar. 2005. A ProjectorCamera System with Real-Time Photometric Adaptation for Dynamic Environments. In Computer Vision and Pattern Recognition, 2005. CVPR 2005. IEEE Computer Society Conference on, Vol. 2. IEEE Computer Society, Washington, DC, USA, 1180 vol. 2-.

Digital Library

[6]

Genki Furumi, Daisuke Sakamoto, and Takeo Igarashi. 2012. SnapRail: a tabletop user interface widget for addressing occlusion by physical objects. In Proceedings of the 2012 ACM international conference on Interactive tabletops and surfaces (ITS '12). ACM, New York, NY, USA, 193-196.

Digital Library

[7]

Raphael Grasset, Tobias Langlotz, Denis Kalkofen, Markus Tatzgern, and Dieter Schmalstieg. 2012. Imagedriven View Management for Augmented Reality Browsers. In Proceedings of the 2012 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) (ISMAR '12). IEEE Computer Society, Washington, DC, USA, 177-186. 2012.6402555

[8]

M.D. Grossberg, H. Peri, S.K. Nayar, and P.N. Belhumeur. 2004. Making one object look like another: controlling appearance using a projector-camera system. In Computer Vision and Pattern Recognition, 2004. CVPR 2004. Proceedings of the 2004 IEEE Computer Society Conference on, Vol. 1. IEEE Computer Society, Washington, DC, USA, I-452-I-459 Vol.1.

[9]

Björn Hartmann, Meredith Ringel Morris, Hrvoje Benko, and Andrew D. Wilson. 2010. Pictionaire: Supporting Collaborative Design Work by Integrating Physical and Digital Artifacts. In Proceedings of the 2010 ACM Conference on Computer Supported Cooperative Work (CSCW '10). ACM, New York, NY, USA, 421-424.

Digital Library

[10]

Jochen Huber, Jürgen Steimle, Chunyuan Liao, Qiong Liu, and Max Mühlhäuser. 2012. LightBeam: Interacting with Augmented Real-world Objects in Pico Projections. In Proceedings of the 11th International Conference on Mobile and Ubiquitous Multimedia (MUM '12). ACM, New York, NY, USA, Article 16, 10 pages. //dx.doi.org/10.1145/2406367.2406388

Digital Library

[11]

Waqas Javed, KyungTae Kim, Sohaib Ghani, and Niklas Elmqvist. 2011. Evaluating Physical/Virtual Occlusion Management Techniques for Horizontal Displays. In Human-Computer Interaction INTERACT 2011, Pedro Campos, Nicholas Graham, Joaquim Jorge, Nuno Nunes, Philippe Palanque, and Marco Winckler (Eds.). Lecture Notes in Computer Science, Vol. 6948. Springer Berlin Heidelberg, Heidelberg, Germany, 391-408.

[12]

Shaun K. Kane, Daniel Avrahami, Jacob O. Wobbrock, Beverly Harrison, Adam D. Rea, Matthai Philipose, and Anthony LaMarca. 2009. Bonfire: A Nomadic System for Hybrid Laptop-tabletop Interaction. In Proceedings of the 22Nd Annual ACM Symposium on User Interface Software and Technology (UIST '09). ACM, New York, NY, USA, 129-138. 1622176.1622202

Digital Library

[13]

Mohammadreza Khalilbeigi, Jürgen Steimle, Jan Riemann, Niloofar Dezfuli, Max Mühlhäuser, and James D. Hollan. 2013. ObjecTop: occlusion awareness of physical objects on interactive tabletops. In Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces (ITS '13). ACM, New York, NY, USA, 255-264.

Digital Library

[14]

H. Koike, Y. Sato, and Y. Kobayashi. 2001. Integrating paper and digital information on EnhancedDesk: a method for realtime finger tracking on an augmented desk system. ACM Trans. Comput.-Hum. Interact. 8, 4 (Dec. 2001), 307-322. 504704.504706

Digital Library

[15]

Chunyuan Liao, Hao Tang, Qiong Liu, Patrick Chiu, and Francine Chen. 2010. FACT: fine-grained cross-media interaction with documents via a portable hybrid paperlaptop interface. In Proceedings of the international conference on Multimedia (MM '10). ACM, New York, NY, USA, 361-370.

Digital Library

[16]

H. Mitsuhara, Y. Yano, and T. Moriyama. 2010. Papertop interface for supporting note-taking and its preliminary experiment. In Systems Man and Cybernetics (SMC), 2010 IEEE International Conference on. IEEE Computer Society, Washington, DC, USA, 3456-3462.

[17]

Shree K. Nayar, Harish Peri, Michael D. Grossberg, and Peter N. Belhumeur. 2003. A projection system with radiometric compensation for screen imperfections. In IEEE ICCV Workshop on Projector-Camera Systems (PROCAMS). IEEE Computer Society, Washington, DC, USA, 8.

[18]

Jason Orlosky, Kiyoshi Kiyokawa, and Haruo Takemura. 2013. Dynamic Text Management for See-through Wearable and Heads-up Display Systems. In Proceedings of the 2013 International Conference on Intelligent User Interfaces (IUI '13). ACM, New York, NY, USA, 363-370.

Digital Library

[19]

Jan Riemann, Mohammadreza Khalilbeigi, and Max Mühlhäuser. 2015. In-Situ Occlusion Resolution for Hybrid Tabletop Environments. In Human-Computer Interaction - INTERACT 2015, Julio Abascal, Simone Barbosa, Mirko Fetter, Tom Gross, Philippe Palanque, and Marco Winckler (Eds.). Lecture Notes in Computer Science, Vol. 9298. Springer International Publishing, Cham, Switzerland, 278-295.

[20]

Jan Riemann, Mohammadreza Khalilbeigi, and Max Mühlhäuser. 2013. PeriTop: extending back-projected tabletops with top-projected peripheral displays. In Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces (ITS '13). ACM, New York, NY, USA, 349-352. 1145/2512349.2512397

Digital Library

[21]

Thitirat Siriborvornratanakul and Masanori Sugimoto. 2008. Clutter-aware Adaptive Projection Inside a Dynamic Environment. In Proceedings of the 2008 ACM Symposium on Virtual Reality Software and Technology (VRST '08). ACM, New York, NY, USA, 241-242.

Digital Library

[22]

Jürgen Steimle, Mohammadreza Khalilbeigi, Max Mühlhäuser, and James D. Hollan. 2010. Physical and digital media usage patterns on interactive tabletop surfaces. In ACM International Conference on Interactive Tabletops and Surfaces (ITS '10). ACM, New York, NY, USA, 167-176.

Digital Library

[23]

K. Tanaka, Y. Kishino, M. Miyamae, T. Terada, and S. Nishio. 2007. An Information Layout Method for an Optical See-through HMD Considering the Background. In Wearable Computers, 2007 11th IEEE International Symposium on. IEEE Computer Society, Washington, DC, USA, 109-110. 2007.4373791

[24]

Vineet Thanedar and Tobias Höllerer. 2004. Semiautomated Placement of Annotations in Videos. Technical Report 2004--11. UC, Santa Barbara.

[25]

Pierre Wellner. 1993. Interacting with Paper on the DigitalDesk. Commun. ACM 36, 7 (July 1993), 87-96.

Digital Library

[26]

Robert Xiao, Chris Harrison, and Scott E. Hudson. 2013. WorldKit: Rapid and Easy Creation of Ad-hoc Interactive Applications on Everyday Surfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 879-888.

Digital Library

Cited By

De Pace FManuri FBosco MSanna AKaufmann H(2024)Supporting Human–Robot Interaction by Projected Augmented Reality and a Brain InterfaceIEEE Transactions on Human-Machine Systems10.1109/THMS.2024.341420854:5(599-608)Online publication date: Oct-2024
https://doi.org/10.1109/THMS.2024.3414208
Ichihashi KFujinami K(2019)Estimating Visibility of Annotations for View Management in Spatial Augmented Reality Based on Machine-Learning TechniquesSensors10.3390/s1904093919:4(939)Online publication date: 22-Feb-2019
https://doi.org/10.3390/s19040939
Riemann JSchmitz MHendrich AMühlhäuser M(2018)FlowPutProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/31917632:1(1-23)Online publication date: 26-Mar-2018
https://dl.acm.org/doi/10.1145/3191763

Index Terms

FreeTop: Finding Free Spots for Projective Augmentation
1. Human-centered computing

Recommendations

PeriTop: extending back-projected tabletops with top-projected peripheral displays
ITS '13: Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces

Integrating digital tabletops into homes or desktop environments will give rise to a set of problems emerging from placing everyday objects on interactive tabletops. Chief among them is the arbitrary placement of physical objects that considerably ...
An Evaluation of Hybrid Stacking on Interactive Tabletops
SmartObject '17: Proceedings of the 2017 ACM Workshop on Interacting with Smart Objects

Stacking is a common practice of organizing documents in the physical world. With the recent advent of interactive tabletops, physical documents can now coexist with digital documents on the same surface. As a result, systems were developed and studied ...
ObjecTop: occlusion awareness of physical objects on interactive tabletops
ITS '13: Proceedings of the 2013 ACM international conference on Interactive tabletops and surfaces

In this paper, we address the challenges of occlusion created by physical objects on interactive tabletops. We contribute an integrated set of interaction techniques designed to cope with the physical occlusion problem as well as facilitate organizing ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI EA '16: Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems

May 2016

3954 pages

ISBN:9781450340823

DOI:10.1145/2851581

General Chairs:
Jofish Kaye
Yahoo
,
Allison Druin
University of Maryland / National Park Service
,
Program Chairs:
Cliff Lampe
University of Michigan
,
Dan Morris
Microsoft
,
Juan Pablo Hourcade
University of Iowa

Copyright © 2016 Owner/Author.

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 May 2016

Check for updates

Author Tags

Qualifiers

Abstract

Conference

CHI'16

Sponsor:

SIGCHI

CHI'16: CHI Conference on Human Factors in Computing Systems

May 7 - 12, 2016

California, San Jose, USA

Acceptance Rates

CHI EA '16 Paper Acceptance Rate 1,000 of 5,000 submissions, 20%;

Overall Acceptance Rate 6,164 of 23,696 submissions, 26%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
259
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)0

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

De Pace FManuri FBosco MSanna AKaufmann H(2024)Supporting Human–Robot Interaction by Projected Augmented Reality and a Brain InterfaceIEEE Transactions on Human-Machine Systems10.1109/THMS.2024.341420854:5(599-608)Online publication date: Oct-2024
https://doi.org/10.1109/THMS.2024.3414208
Ichihashi KFujinami K(2019)Estimating Visibility of Annotations for View Management in Spatial Augmented Reality Based on Machine-Learning TechniquesSensors10.3390/s1904093919:4(939)Online publication date: 22-Feb-2019
https://doi.org/10.3390/s19040939
Riemann JSchmitz MHendrich AMühlhäuser M(2018)FlowPutProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/31917632:1(1-23)Online publication date: 26-Mar-2018
https://dl.acm.org/doi/10.1145/3191763
Fender AHerholz PAlexa MMüller JMandryk RHancock MPerry MCox A(2018)OptiSpaceProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3173843(1-11)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3173843

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents