Article

Boom chameleon: simultaneous capture of 3D viewpoint, voice and gesture annotations on a spatially-aware display

Authors:

George W. Fitzmaurice,

Gordon Kurtenbach,

Bill BuxtonAuthors Info & Claims

UIST '02: Proceedings of the 15th annual ACM symposium on User interface software and technology

Pages 111 - 120

https://doi.org/10.1145/571985.572001

Published: 27 October 2002 Publication History

Abstract

We introduce the Boom Chameleon, a novel input/output device consisting of a flat-panel display mounted on a tracked mechanical boom. The display acts as a physical window into 3D virtual environments, through which a one-to-one mapping between real and virtual space is preserved. The Boom Chameleon is further augmented with a touch-screen and a microphone/speaker combination. We present a 3D annotation application that exploits this unique configuration in order to simultaneously capture viewpoint, voice and gesture information. Design issues are discussed and results of an informal user study on the device and annotation software are presented. The results show that the Boom Chameleon annotation facilities have the potential to be an effective, easy to learn and operate 3D design review system.

Supplementary Material

WMV File (boomchameleon_dsl.wmv)

Download
8.78 MB

Low Resolution (boomchameleon-56k.mov)

Download
2.31 MB

High Resolution (boomchameleon_dsl.mov)

Download
39.49 MB

References

[1]

Art+Com. http://www.artcom.de.

[2]

Balakrishnan, R., Fitzmaurice, G.W. and Kurtenbach, G. (2001). User Interfaces for Volumetric Displays. IEEE Computer, 34(2), 37-45.

Digital Library

[3]

Billinghurst, M., and Kato, H. (2002). How the Virtual inspires the real: Collaborative Augmented Reality. Communications of the ACM 45, 7 (July 2002), 64-70.

Digital Library

[4]

Bolt, R.A. (1980). Put-That-There: voice and gesture at the graphics interface. SIGGRAPH Computer Graphics, 14(3), 262-270.

Digital Library

[5]

Bourguignon, D., Cani, M-P. and Drettakis, G. (2001). Drawing for Illustration and Annotation in 3D, In Proc. of EUROGRAPHICS'01, 114-122.

[6]

Buxton, W (2001). Less is More (More or Less), in P. Denning (Ed.), The Invisible Future: The seamless integration of technology in everyday life. New York: McGraw Hill, 145-179. Also at http://www.BillBuxton.com/LessIsMore.html.

Digital Library

[7]

Buxton, W. & Fitzmaurice, G.W. (1998). HMD's, Caves & Chameleon: A Human-Centric Analysis of Interaction in Virtual Space. Computer Graphics, The SIGGRAPH Quarterly, 32(4), 69-74.

Digital Library

[8]

Chalfonte, B.L, Fish, R.S. and Kraut, R.E. (1991). Expressive Richness: A comparison of speech and text as media for revision, In Proc. of CHI'91, 21-26.

Digital Library

[9]

Cohen, P., McGee, D., Oviatt, S., Wu, L., Clow, J., King, R., Julier, S. and Rosenblum, L. (1999). Multimodal Interaction for 2D and 3D Environments, IEEE Computer Graphics and Applications, 19(4), 10-13.

Digital Library

[10]

Fakespace Labs. http://www.fakespacelabs.com.

[11]

Fitzmaurice, G.W. (1993). Situated Information Spaces and Spatially Aware Palmtop Computers. Communications of the ACM, 36(7), 38-49.

Digital Library

[12]

Fitzmaurice, G., Zhai, S. and Chignell, M. (1993). Virtual reality for palmtop computers, ACM Transactions on Information Systems, 11 (3), 197-218.

Digital Library

[13]

Frohlich, D. and Daly-Jones, O. (1995). Voicefax: A shared workspace for voicemail partners, In Proc. of CHI'95 Short papers, 308-309

Digital Library

[14]

Hardock, G., Kurtenbach, G., and Buxton, W.A. (1993). Mate: A marking based interface for collaborative writing. In Proc. of UIST'93, 259-266.

Digital Library

[15]

Harmon, R., Patterson, W., Ribarsky, W. and Bolter, J. (1996). The Virtual Annotation System, In Proc. of Virtual Reality Annual International Symposium (VRAIS'96), 239-245.

Digital Library

[16]

Iris Annotator. http://www.sgi.com/software/annotator.

[17]

Jung T., Gross M. D. and Do E. Y. (2002). Annotation and Sketching on 3D Web Models, In Proc. of ACM Conference on Intelligent User Interfaces'02, 95-102.

Digital Library

[18]

LaViola, J., Holden, A., Forsberg, D. and Bhuphaibool, D. (1998). Collaborative Conceptual Modeling Using the SKETCH Framework, In Proc. of the first IASTED International Conference on Computer Graphics and Imaging, 154-158.

[19]

Levine, S. and Ehrlich, S. (1991). The Freestyle System: A Design Perspective. In Klinger, A. (Ed.) Human-Machine Interactive Systems, Plenum 3-21. Also in Baecker, R.M., Grudin, J., Buxton, W., and Greenberg, S. (Eds.) Readings in Human-Computer Interaction: Toward the Year 2000, 2nd edition, 871-880.

Digital Library

[20]

Lienhart, Rainer. (2000). A System for Effortless Content Annotation to Unfold the Semantics in Videos. In Proc. of the IEEE Workshop on Content-based Access of Image and Video Libraries (CBAIVL'00), 45-50.

Digital Library

[21]

Loughlin, M. and Hughes, J. (1994). An Annotation System for 3D Fluid Flow Visualization. In Proc. IEEE Visualization '94, 273-279.

Digital Library

[22]

Maeda, J., Greenwold, S. Installation. Aesthetics and Computation Group, MIT. http://acg.media.mit.edu/people/simong/installationNew/cover.html.

[23]

Marshall, C.C. (1997). Annotation: from paper books to the digital library. Proc. of the Second ACM International Conference on Digital Libraries, 131-140.

Digital Library

[24]

Matsuoka, H., Onozawa, A., Hosoya, E., Sato, H., and Nojima, H. (2002). Regeneration of Real Objects in the Real World. Presented at SIGGRAPH Symposium on Interactive 3D Graphics 2002 - Emerging technologies. http://kankyo.lelab.ecl.ntt.co.jp/real_in_real/eng/index.htm.

Digital Library

[25]

O'Hara, K., Sellen, A., (1997). A comparison of reading paper and on-line documents. In Proc. of CHI'97, 335-342.

Digital Library

[26]

Oviatt, S. L. (1999) Ten myths of multimodal interaction, Communications of the ACM, Vol. 42, No. 11, November, 1999, pp. 74-81.

Digital Library

[27]

Pedersen, E.R., McCall, K., Moran, T.P., Halasz, F.G., (1993). Tivoli: an electronic whiteboard for informal workgroup meetings. In Proc. of CHI'93. 391-398.

Digital Library

[28]

Poupyrev, I., Tomokazu, N., and Weghorst, S. (1998). Virtual Notepad: Handwriting in Immersive VR, In Proc. of IEEE Virtual Reality Annual International Symposium'98 (VRAIS'98), 126-132.

Digital Library

[29]

Rekimoto, J. and Nagao, K. (1995). The World through the Computer: Computer Augmented Interaction with Real World Environments, In Proc. of UIST'95, 29-36.

Digital Library

[30]

Schmalstieg, D., Encarnacao, L.M. and Szalavari, Z. (1999). Using transparent props for interaction with the virtual table," In Proc. SIGGRAPH Symposium on Interactive 3D Graphics 1999, 147-154.

Digital Library

[31]

Small, D. and Ishii H. (1997). Design of Spatially Aware Graspable Display, ACM CHI'97 Electronic Publications.

Digital Library

[32]

Stellingwerff, Martijn. (1999). SketchBoX. In Proc. of Architectural Computing from Turing to 2000. eCAADe, ISBN 0-9523687-5-7, Liverpool (UK) 15-17 September 1999, 491-497.

[33]

Stoakley, R., Conway, M. and Pausch, R. (1995). Virtual reality on a WIM: Interactive worlds in miniature. In Proc. of CHI'95, 265-272.

Digital Library

[34]

Weber, K., and Poon, A. (1994). Marquee: A Tool for Real-Time Video Logging, Proc. of CHI '94, 58-64.

Digital Library

[35]

Whittaker, S. Davis, R. Hirschber, J., and Muller, U. (2000). Jotmail: a voicemail interface that enables you to see what was said, Proc. of CHI'2000, CHI Letters 2(1), 89-96.

Digital Library

[36]

Whittaker, S., Hyland, P., and Wiley, M. (1994) Filochat: Handwritten notes provide access to recorded conversations. Proc. of CHI'94, 271-277.

Digital Library

[37]

Wilcox, L.D., Schilit, B.N., Sawhney, N. (1997) Dynomite: A Dynamically organized Ink and Audio Notebook. Proc. of CHI'97, 186-193.

Digital Library

[38]

WindowsVR. http://www.abs-tech.com/Produtos/3D_VR/VR-Hardware/hmds1/Virtual_Research/win_vr.html.

Cited By

Cuadra ABreuch JEstrada SIhim DHung IAskaryar DHassanien MFessele KLanday J(2024)Digital Forms for All: A Holistic Multimodal Large Language Model Agent for Health Data EntryProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596248:2(1-39)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659624
Grubert J(2023)Mixed Reality Interaction TechniquesSpringer Handbook of Augmented Reality10.1007/978-3-030-67822-7_5(109-129)Online publication date: 1-Jan-2023
https://doi.org/10.1007/978-3-030-67822-7_5
Nam JIsenberg TKeefe D(2022)V-Mail: 3D-Enabled Correspondence About Spatial Data on (Almost) All Your DevicesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.322901730:4(1853-1867)Online publication date: 14-Dec-2022
https://dl.acm.org/doi/10.1109/TVCG.2022.3229017
Show More Cited By

Index Terms

Boom chameleon: simultaneous capture of 3D viewpoint, voice and gesture annotations on a spatially-aware display

Recommendations

Boom chameleon: simultaneous capture of 3D viewpoint, voice and gesture annotations on a spatially-aware display

We review the Boom Chameleon, a novel input/output device consisting of a flat-panel display mounted on a tracked mechanical armature. The display acts as a physical window into 3D virtual environments, through which a one-to-one mapping between real ...
Boom chameleon: simultaneous capture of 3D viewpoint, voice and gesture annotations on a spatially-aware display
SIGGRAPH '03: ACM SIGGRAPH 2003 Papers

We review the Boom Chameleon, a novel input/output device consisting of a flat-panel display mounted on a tracked mechanical armature. The display acts as a physical window into 3D virtual environments, through which a one-to-one mapping between real ...
MouseLight: bimanual interactions on digital paper using a pen and a spatially-aware mobile projector
CHI '10: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

MouseLight is a spatially-aware standalone mobile projector with the form factor of a mouse that can be used in combination with digital pens on paper. By interacting with the projector and the pen bimanually, users can visualize and modify the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '02: Proceedings of the 15th annual ACM symposium on User interface software and technology

October 2002

247 pages

ISBN:1581134886

DOI:10.1145/571985

Conference Chair:
Michel Beaudouin-Lafon
Université Paris-Sud

Copyright © 2002 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 27 October 2002

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

UIST02

Sponsor:

SIGCHI

UIST02: Symposium on User Interface Software and Technology

October 27 - 30, 2002

Paris, France

Acceptance Rates

Overall Acceptance Rate 842 of 3,967 submissions, 21%

Upcoming Conference

UIST '24

Sponsor:
sigchi
sigchi

The 37th Annual ACM Symposium on User Interface Software and Technology

October 13 - 16, 2024

Pittsburgh , PA , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

125
Total Citations
View Citations
2,350
Total Downloads

Downloads (Last 12 months)28
Downloads (Last 6 weeks)2

Reflects downloads up to 06 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Cuadra ABreuch JEstrada SIhim DHung IAskaryar DHassanien MFessele KLanday J(2024)Digital Forms for All: A Holistic Multimodal Large Language Model Agent for Health Data EntryProceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies10.1145/36596248:2(1-39)Online publication date: 15-May-2024
https://dl.acm.org/doi/10.1145/3659624
Grubert J(2023)Mixed Reality Interaction TechniquesSpringer Handbook of Augmented Reality10.1007/978-3-030-67822-7_5(109-129)Online publication date: 1-Jan-2023
https://doi.org/10.1007/978-3-030-67822-7_5
Nam JIsenberg TKeefe D(2022)V-Mail: 3D-Enabled Correspondence About Spatial Data on (Almost) All Your DevicesIEEE Transactions on Visualization and Computer Graphics10.1109/TVCG.2022.322901730:4(1853-1867)Online publication date: 14-Dec-2022
https://dl.acm.org/doi/10.1109/TVCG.2022.3229017
Krug KBuschel WKlamka KDachselt R(2022)CleAR Sight: Exploring the Potential of Interacting with Transparent Tablets in Augmented Reality2022 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)10.1109/ISMAR55827.2022.00034(196-205)Online publication date: Oct-2022
https://doi.org/10.1109/ISMAR55827.2022.00034
Marquardt NHenry Riche NHolz CRomat HPahud MBrudy FLedo DPark CNicholas MSeyed TOfek ELee BBuxton WHinckley K(2021)AirConstellations: In-Air Device Formations for Cross-Device Interaction via Multiple Spatially-Aware ArmaturesThe 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3472749.3474820(1252-1268)Online publication date: 10-Oct-2021
https://dl.acm.org/doi/10.1145/3472749.3474820
Wang ZNguyen CAsente PDorsey JKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)DistanciAR: Authoring Site-Specific Augmented Reality Experiences for Remote EnvironmentsProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445552(1-12)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445552
Murali PHernandez JMcDuff DRowan KSuh JCzerwinski MKitamura YQuigley AIsbister KIgarashi TBjørn PDrucker S(2021)AffectiveSpotlight: Facilitating the Communication of Affective Responses from Audience Members during Online PresentationsProceedings of the 2021 CHI Conference on Human Factors in Computing Systems10.1145/3411764.3445235(1-13)Online publication date: 6-May-2021
https://dl.acm.org/doi/10.1145/3411764.3445235
Besançon LYnnerman AKeefe DYu LIsenberg T(2021)The State of the Art of Spatial Interfaces for 3D VisualizationComputer Graphics Forum10.1111/cgf.1418940:1(293-326)Online publication date: 6-Jan-2021
https://doi.org/10.1111/cgf.14189
Louis TTroccaz JRochet-Capellan ABérard FIqbal SMacLean KChevalier FMueller S(2020)GyroSuiteProceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology10.1145/3379337.3415893(1248-1260)Online publication date: 20-Oct-2020
https://dl.acm.org/doi/10.1145/3379337.3415893
Yang SLee CShin HKim JBernhaupt RMueller FVerweij DAndres JMcGrenere JCockburn AAvellino IGoguey ABjørn PZhao SSamson BKocielnik R(2020)Snapstream: Snapshot-based Interaction in Live Streaming for Visual ArtProceedings of the 2020 CHI Conference on Human Factors in Computing Systems10.1145/3313831.3376390(1-12)Online publication date: 21-Apr-2020
https://dl.acm.org/doi/10.1145/3313831.3376390
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents