research-article

MUSTARD: a multi user see through AR display

Authors:

Abhijit Karnik,

Walterio Mayol-Cuevas,

Sriram SubramanianAuthors Info & Claims

CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 2541 - 2550

https://doi.org/10.1145/2207676.2208641

Published: 05 May 2012 Publication History

Abstract

We present MUSTARD, a multi-user dynamic random hole see-through display, capable of delivering viewer dependent information for objects behind a glass cabinet. Multiple viewers are allowed to observe both the physical object(s) being augmented and their location dependent annotations at the same time. The system consists of two liquid-crystal (LC) panels within which physical objects can be placed. The back LC panel serves as a dynamic mask while the front panel serves as the data. We first describe the principle of MUSTARD and then examine various functions that can be used to minimize crosstalk between multiple viewer positions. We compare different conflict management strategies using PSNR and the quality mean opinion score of HDR-VDP2. Finally, through a user-study we show that users can clearly identify images and objects even when the images are shown with strong conflicting regions; demonstrating that our system works even in the most extreme of circumstances.

Supplementary Material

MOV File (paperfile634-3.mov)

Supplemental video for “MUSTARD: a multi user see through AR display”

Download
15.90 MB

References

[1]

Bridson, R. Fast Poisson disk sampling in arbitrary dimensions. In SIGGRAPH 2007 Sketches.

Digital Library

[2]

Chandrasekaran, R. and Tamir, A. Open questions concerning Weiszfeld's algorithm for the Fermat-Weber location problem. Mathematical Programming (1989).

[3]

Ferscha, A. and Keller, M. DigiScope: An Invisible Worlds Window. In Ubicomp 2003 (2003), 261--264.

[4]

Hirakawa, M., Kojima, Y. and Yoshitaka, A. Transparent interface: a seamless media space integrating the real and virtual worlds. In Proc. Human Centric Computing Languages and Environments (2003). 120--122.

Digital Library

[5]

Hirsch, M., Lanman, D., Holtzman, H. and Raskar, R. BiDi screen: a thin, depth-sensing LCD for 3D interaction using light fields. In SIGGRAPH Asia 2009.

Digital Library

[6]

Huynh-Thu, Q. and Ghanbari, M. Scope of validity of PSNR in image/video quality assessment. Electronics Letters 44 (2008), 800--801.

[7]

Kitamura, Y., Konishi, T., Yamamoto, S. and Kishino, F. Interactive stereoscopic display for three or more users. In SIGGRAPH 2001, ACM (2001), 231--240.

Digital Library

[8]

Kooima, R., Prudhomme, A., Schulze, J., Sandin, D. and DeFanti, T. A multi-viewer tiled autostereoscopic virtual reality display. In Proc. VRST 2010, (2010).

Digital Library

[9]

Mantiuk, R., Kim, K. J., Rempel, A. G. and Heidrich, W. HDR-VDP-2: a calibrated visual metric for visibility and quality predictions in all luminance conditions. In SIGGRAPH 2011, ACM (2011), 1--14.

Digital Library

[10]

Matsushita, M., Iida, M., Ohguro, T., Shirai, Y., Kakehi, Y. and Naemura, T. Lumisight table: a face-to-face collaboration support system that optimizes direction of projected information to each stakeholder. In CSCW '04.

Digital Library

[11]

Matusik, W. and Pfister, H. 3D TV: a scalable system for real-time acquisition, transmission, and autostereoscopic display of dynamic scenes. In SIGGRAPH 2004, (2004).

Digital Library

[12]

Morishima, H., Nose, H., Taniguchi, N., Inoguchi, K. and Matsumura, S. Rear-cross-lenticular 3D display without eyeglasses. In Stereoscopic Displays and Virtual Reality Systems V, (1998).

[13]

Nashel, A. and Fuchs, H. Random Hole Display: A nonuniform barrier autostereoscopic display. In 3DTV Conference: The True Vision - Capture, Transmission and Display of 3D Video, (2009), 1--4.

[14]

Olwal, A., Lindfors, C., Gustafsson, J., Kjellberg, T. and Mattsson, L. ASTOR: An Autostereoscopic Optical Seethrough Augmented Reality System. In ISMAR '05.

Digital Library

[15]

Perlin, K., Paxia, S. and Kollin, J. S. An autostereoscopic display. In SIGGRAPH '00, (2000).

Digital Library

[16]

Perry, M., Beckett, S., O'Hara, K. and Subramanian, S. WaveWindow: public, performative gestural interaction. In ITS '10, ACM (2010), 109--112.

Digital Library

[17]

Peterka, T., Kooima, R. L., Sandin, D. J., Johnson, A., Leigh, J. and DeFanti, T. A. Advances in the Dynallax Solid-State Dynamic Parallax Barrier Autostereoscopic Visualization Display System. IEEE Transactions on Visualization and Computer Graphics 14, (2008).

Digital Library

[18]

Sakurai, S., Kitamura, Y., Subramanian, S. and Kishino, F. A visibility control system for collaborative digital table. Personal Ubiquitous Comput. 13, (2009).

Digital Library

[19]

Sandin, D. J., Margolis, T., Ge, J., Girado, J., Peterka, T. and DeFanti, T. A. The Varrier autostereoscopic virtual reality display. ACM Trans. Graph. 24, (2005), 894--903.

Digital Library

[20]

Wilson, A. D. TouchLight: an imaging touch screen and display for gesture-based interaction. In ICMI, (2004).

Digital Library

[21]

Ye, G., State, A. and Fuchs, H. A practical multi-viewer tabletop autostereoscopic display. In ISMAR '10 (2010).

Cited By

Gerakianaki AZidianakis ENeroutsou VNtagianta AManoli KNtoa SAdami IAntona MStephanidis C(2024)STAR: A See-Through Augmented Reality Exhibit Showcase for Transparent DisplaysHCI International 2024 – Late Breaking Papers10.1007/978-3-031-76815-6_19(263-279)Online publication date: 11-Dec-2024
https://doi.org/10.1007/978-3-031-76815-6_19
Guefrech FBerthaut FPlenacoste PPeter YGrisoni L(2021)Revealable Volume Displays: 3D Exploration of Mixed-Reality Public Exhibitions2021 IEEE Virtual Reality and 3D User Interfaces (VR)10.1109/VR50410.2021.00023(31-39)Online publication date: Mar-2021
https://doi.org/10.1109/VR50410.2021.00023
Liu NGao ZWang JZhai G(2021)Psycho-visual modulation based information display: introduction and surveyFrontiers of Computer Science: Selected Publications from Chinese Universities10.1007/s11704-019-8265-315:3Online publication date: 1-Jun-2021
https://dl.acm.org/doi/10.1007/s11704-019-8265-3
Show More Cited By

Index Terms

MUSTARD: a multi user see through AR display
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Virtual reality and augmented reality in social learning spaces: a literature review
Abstract
In this survey, we explore Virtual Reality and Augmented Reality within social learning spaces, such as classrooms and museums, while also extending into relevant social interaction concepts found within more reality-based and social immersive ...
Survey on Collaborative AR for Multi-user in Urban Studies and Planning
Edutainment '09: Proceedings of the 4th International Conference on E-Learning and Games: Learning by Playing. Game-based Education System Design and Development

This paper describes an augmented reality (AR) environment that allows multiple participants or multi-user to interact with 2D and 3D data. AR simply can provide a collaborative interactive AR environment for urban planning, where users can interact ...
Unencumbered 3D interaction with see-through displays
NordiCHI '08: Proceedings of the 5th Nordic conference on Human-computer interaction: building bridges

Augmented Reality (AR) systems that employ user-worn display and sensor technology can be problematic for certain applications as the technology might, for instance, be encumbering to the user or limit the deployment options of the system. Spatial AR ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

May 2012

3276 pages

ISBN:9781450310154

DOI:10.1145/2207676

General Chair:
Joseph A. Konstan
University of Minnesota
,
Program Chairs:
Ed H. Chi
Google
,
Kristina Höök
Mobile Life at KTH

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 May 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '12

Sponsor:

SIGCHI

CHI '12: CHI Conference on Human Factors in Computing Systems

May 5 - 10, 2012

Texas, Austin, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
806
Total Downloads

Downloads (Last 12 months)17
Downloads (Last 6 weeks)1

Reflects downloads up to 03 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Gerakianaki AZidianakis ENeroutsou VNtagianta AManoli KNtoa SAdami IAntona MStephanidis C(2024)STAR: A See-Through Augmented Reality Exhibit Showcase for Transparent DisplaysHCI International 2024 – Late Breaking Papers10.1007/978-3-031-76815-6_19(263-279)Online publication date: 11-Dec-2024
https://doi.org/10.1007/978-3-031-76815-6_19
Guefrech FBerthaut FPlenacoste PPeter YGrisoni L(2021)Revealable Volume Displays: 3D Exploration of Mixed-Reality Public Exhibitions2021 IEEE Virtual Reality and 3D User Interfaces (VR)10.1109/VR50410.2021.00023(31-39)Online publication date: Mar-2021
https://doi.org/10.1109/VR50410.2021.00023
Liu NGao ZWang JZhai G(2021)Psycho-visual modulation based information display: introduction and surveyFrontiers of Computer Science: Selected Publications from Chinese Universities10.1007/s11704-019-8265-315:3Online publication date: 1-Jun-2021
https://dl.acm.org/doi/10.1007/s11704-019-8265-3
Capra OBerthaut FGrisoni L(2020)Levels of Detail in Visual Augmentation for Novice and Expert AudiencesComputer Music Journal10.1162/comj_a_0056844:2-3(92-107)Online publication date: 27-Jul-2020
https://doi.org/10.1162/comj_a_00568
Merino LSchwarzl MKraus MSedlmair MSchmalstieg DWeiskopf D(2020)Evaluating Mixed and Augmented Reality: A Systematic Literature Review (2009-2019)2020 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR50242.2020.00069(438-451)Online publication date: Nov-2020
https://doi.org/10.1109/ISMAR50242.2020.00069
Crespel TReuter PTravis AGentet YGranier X(2019)Autostereoscopic transparent display using a wedge light guide and a holographic optical element: implementation and resultsApplied Optics10.1364/AO.58.00G29358:34(G293)Online publication date: 8-Nov-2019
https://doi.org/10.1364/AO.58.00G293
Darbar RRoo JLainé THachet MPaternò FJacucci GRohs MSantoro C(2019)DroneSARProceedings of the 18th International Conference on Mobile and Ubiquitous Multimedia10.1145/3365610.3365631(1-7)Online publication date: 26-Nov-2019
https://dl.acm.org/doi/10.1145/3365610.3365631
Guan DYang CSun WWei YGai WBian YLiu JSun QZhao SMeng XMandryk RHancock MPerry MCox A(2018)Two Kinds of Novel Multi-user Immersive Display SystemsProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3174173(1-9)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3174173
Rädle RJetter HFischer JGabriel IKlokmose CReiterer HHolz CMandryk RHancock MPerry MCox A(2018)PolarTrackProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3174071(1-9)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3174071
Aitamurto TBoin JChen KCherif AShridhar S(2018)The Impact of Augmented Reality on Art Engagement: Liking, Impression of Learning, and DistractionVirtual, Augmented and Mixed Reality: Applications in Health, Cultural Heritage, and Industry10.1007/978-3-319-91584-5_13(153-171)Online publication date: 2-Jun-2018
https://doi.org/10.1007/978-3-319-91584-5_13
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten