research-article

CamRay: Camera Arrays Support Remote Collaboration on Wall-Sized Displays

Authors:

Ignacio Avellino,

Cédric Fleury,

Wendy E. Mackay,

Michel Beaudouin-LafonAuthors Info & Claims

CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

Pages 6718 - 6729

https://doi.org/10.1145/3025453.3025604

Published: 02 May 2017 Publication History

Abstract

Remote collaboration across wall-sized displays creates a key challenge: how to support audio-video communication among users as they move in front of the display. We present CamRay, a platform that uses camera arrays embedded in wall-sized displays to capture video of users and present it on remote displays according to the users' positions. We investigate two settings: in Follow-Remote, the position of the video window follows the position of the remote user; in Follow-Local, the video window always appears in front of the local user. We report the results of a controlled experiment showing that with Follow-Remote, participants are faster, use more deictic instructions, interpret them more accurately, and use fewer words. However, some participants preferred the virtual face-to-face created by Follow-Local when checking for their partners' understanding. We conclude with design recommendations to support remote collaboration across wall-sized displays.

Supplementary Material

suppl.mov (pn1731-file3.m4v)

Supplemental video

Download
41.73 MB

suppl.mov (pn1731p.mp4)

Supplemental video

Download
2.01 MB

References

[1]

Ignacio Avellino, Cédric Fleury, and Michel Beaudouin-Lafon. 2015. Accuracy of Deictic Gestures to Support Telepresence on Wall-sized Displays. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2393--2396.

Digital Library

[2]

Robert Ball, Chris North, and Doug A. Bowman. 2007. Move to Improve: Promoting Physical Navigation to Increase User Performance with Large Displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). ACM, New York, NY, USA, 191--200.

Digital Library

[3]

S. Beck, A. Kunert, A. Kulik, and B. Froehlich. 2013. Immersive Group-to-Group Telepresence. IEEE Transactions on Visualization and Computer Graphics 19,

Digital Library

[4]

(April 2013), 616--625. 4. Sara A. Bly, Steve R. Harrison, and Susan Irwin. 1993. Media Spaces: Bringing People Together in a Video, Audio, and Computing Environment. Commun. ACM 36, 1 (Jan. 1993), 28--46.

Digital Library

[5]

Nathan Bos, Judy Olson, Darren Gergle, Gary Olson, and Zach Wright. 2002. Effects of Four Computer-mediated Communications Channels on Trust Development. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '02). ACM, New York, NY, USA, 135--140.

Digital Library

[6]

Bill Buxton. 2009. Mediaspace -- Meaningspace -- Meetingspace. In Media Space 20 + Years of Mediated Life, Steve Harrison (Ed.). Springer, London, 217--231.

[7]

Milton Chen. 2002. Leveraging the Asymmetric Sensitivity of Eye Contact for Videoconference. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '02). ACM, New York, NY, USA, 49--56.

Digital Library

[8]

Herbert H. Clark and Susan E. Brennan. 1991. Grounding in communication. In Perspectives on socially shared cognition, L. B. Resnick, J. M. Levine, and S. D. Teasley (Eds.). American Psychological Association, Washington, DC, US, 127--149.

[9]

Herbert H Clark and Catherine R Marshall. 1981. Definite reference and mutual knowledge. Cambridge University Press.

[10]

Herbert H. Clark, Robert Schreuder, and Samuel Buttrick. 1983. Common ground at the understanding of demonstrative reference. Journal of Verbal Learning and Verbal Behavior 22, 2 (April 1983), 245--258.

[11]

M. Dou, Y. Shi, J. M. Frahm, H. Fuchs, B. Mauchly, and M. Marathe. 2012. Room-sized informal telepresence system. In 2012 IEEE Virtual Reality Workshops (VRW). 15--18.

Digital Library

[12]

Darren Gergle, Robert E. Kraut, and Susan R. Fussell. 2004. Action As Language in a Shared Visual Space. In Proceedings of the 2004 ACM Conference on Computer Supported Cooperative Work (CSCW '04). ACM, New York, NY, USA, 487--496.

Digital Library

[13]

Jörg Hauber, Holger Regenbrecht, Mark Billinghurst, and Andy Cockburn. 2006. Spatiality in Videoconferencing: Trade-offs Between Efficiency and Social Presence. In Proceedings of the 2006 20th Anniversary Conference on Computer Supported Cooperative Work (CSCW '06). ACM, New York, NY, USA, 413--422.

Digital Library

[14]

Keita Higuchi, Yinpeng Chen, Philip A. Chou, Zhengyou Zhang, and Zicheng Liu. 2015. ImmerseBoard: Immersive Telepresence Experience Using a Digital Whiteboard. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 2383--2392.

Digital Library

[15]

Ellen A. Isaacs and John C. Tang. 1993. What Video Can and Can'T Do for Collaboration: A Case Study. In Proceedings of the First ACM International Conference on Multimedia (MULTIMEDIA '93). ACM, New York, NY, USA, 199--206.

Digital Library

[16]

Hiroshi Ishii and Minoru Kobayashi. 1992. ClearBoard: A Seamless Medium for Shared Drawing and Conversation with Eye Contact. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '92). ACM, New York, NY, USA, 525--532.

Digital Library

[17]

Clemens N. Klokmose, James R. Eagan, Siemen Baader, Wendy Mackay, and Michel Beaudouin-Lafon. 2015. Webstrates: Shareable Dynamic Media. In Proceedings of the 28th Annual ACM Symposium on User Interface Software and Technology (UIST '15). ACM, New York, NY, USA, 280--290.

Digital Library

[18]

Lars Lischke, Sven Mayer, Katrin Wolf, Niels Henze, Albrecht Schmidt, Svenja Leifert, and Harald Reiterer. 2015. Using Space: Effect of Display Size on Users' Search Performance. In Proceedings of the 33rd Annual ACM Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '15). ACM, New York, NY, USA, 1845--1850.

Digital Library

[19]

Can Liu, Olivier Chapuis, Michel Beaudouin-Lafon, and Eric Lecolinet. 2016. Shared Interaction on a Wall-Sized Display in a Data Manipulation Task. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 2075--2086.

Digital Library

[20]

Can Liu, Olivier Chapuis, Michel Beaudouin-Lafon, Eric Lecolinet, and Wendy E. Mackay. 2014. Effects of Display Size and Navigation Type on a Classification Task. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '14). ACM, New York, NY, USA, 4147--4156.

Digital Library

[21]

Paul K. Luff, Naomi Yamashita, Hideaki Kuzuoka, and Christian Heath. 2015. Flexible Ecologies And Incongruent Locations. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 877--886.

Digital Library

[22]

Wendy E. Mackay. 1999. Media Spaces: Environments for multimedia interaction. In Computer-Supported Cooperative Work, Michel Beaudouin-Lafon (Ed.). Wiley and Sons, Chichester, 55--82.

[23]

Andrew F. Monk and Caroline Gale. 2002. A Look Is Worth a Thousand Words: Full Gaze Awareness in Video-Mediated Conversation. Discourse Processes 33, 3 (2002), 257--278.

[24]

David T. Nguyen and John Canny. 2007. Multiview: Improving Trust in Group Video Conferencing Through Spatial Faithfulness. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '07). ACM, New York, NY, USA, 1465--1474.

Digital Library

[25]

David T. Nguyen and John Canny. 2009. More Than Face-to-face: Empathy Effects of Video Framing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '09). ACM, New York, NY, USA, 423--432.

Digital Library

[26]

Judy Robertson and Maurits Kaptein. 2016. Modern Statistical Methods for HCI. Springer.

Digital Library

[27]

Abigail Sellen, Bill Buxton, and John Arnott. 1992. Using Spatial Cues to Improve Videoconferencing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '92). ACM, New York, NY, USA, 651--652.

Digital Library

[28]

Anthony Tang, Michel Pahud, Kori Inkpen, Hrvoje Benko, John C. Tang, and Bill Buxton. 2010. Three's Company: Understanding Communication Channels in Three-way Distributed Collaboration. In Proceedings of the 2010 ACM Conference on Computer Supported Cooperative Work (CSCW '10). ACM, New York, NY, USA, 271--280.

Digital Library

[29]

John C. Tang and Scott Minneman. 1991. VideoWhiteboard: Video Shadows to Support Remote Collaboration. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '91). ACM, New York, NY, USA, 315--322.

Digital Library

[30]

John C. Tang and Scott L. Minneman. 1990. VideoDraw: A Video Interface for Collaborative Drawing. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '90). ACM, New York, NY, USA, 313--320.

Digital Library

[31]

Elizabeth S. Veinott, Judith Olson, Gary M. Olson, and Xiaolan Fu. 1999. Video Helps Remote Work: Speakers Who Need to Negotiate Common Ground Benefit from Seeing Each Other. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '99). ACM, New York, NY, USA, 302--309.

Digital Library

[32]

Malte Willert, Stephan Ohl, Anke Lehmann, and Oliver Staadt. 2010. The Extended Window Metaphor for Large High-resolution Displays. In Proceedings of the 16th Eurographics Conference on Virtual Environments & Second Joint Virtual Reality (EGVE - JVRC'10). Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, 69--76.

Digital Library

Cited By

Coppens AHermen JSchwartz LMoll CMaquil V(2024)Supporting Mixed-Presence Awareness across Wall-Sized Displays Using a Tracking Pipeline based on Depth CamerasProceedings of the ACM on Human-Computer Interaction10.1145/36646348:EICS(1-32)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3664634
Yuan YGenatempo PJin QYarosh S(2024)Field Trial of a Tablet-based AR System for Intergenerational Connections through Remote ReadingProceedings of the ACM on Human-Computer Interaction10.1145/36536968:CSCW1(1-28)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3653696
Chapuis OJames RRafiei MBezerianos A(2024)Comparing Physical and VR-emulated Ultra-walls in a Classification TaskProceedings of the 35th Conference on l'Interaction Humain-Machine10.1145/3649792.3649797(1-14)Online publication date: 25-Mar-2024
https://dl.acm.org/doi/10.1145/3649792.3649797
Show More Cited By

Index Terms

CamRay: Camera Arrays Support Remote Collaboration on Wall-Sized Displays
1. Human-centered computing
  1. Collaborative and social computing
2. Information systems
  1. World Wide Web
    1. Web applications
      1. Internet communications tools

Recommendations

Accuracy of Deictic Gestures to Support Telepresence on Wall-sized Displays
CHI '15: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems

This paper presents a controlled experiment assessing the accuracy when interpreting remote users showing a shared object on a large wall-sized display, either by looking at it or by looking and pointing at it. We analyze both distance and angle errors ...
Collaboard: a remote collaboration groupware device featuring an embodiment-enriched shared workspace
GROUP '10: Proceedings of the 2010 ACM International Conference on Supporting Group Work

In this paper we present a mixed presence groupware device called "CollaBoard". The device improves collaboration between co-located and remote partners by providing a high level of workspace awareness. This is achieved by superimposing a life-size ...
Supporting telepresence by visual and physical cues in distributed 3D collaborative design environments
CHI EA '06: CHI '06 Extended Abstracts on Human Factors in Computing Systems

We present new interaction techniques for supporting telepresence in distributed 3D collaborative design environments. Synchronized turntables enhance physicality in manipulation of virtual 3D objects and provide physical cues for awareness of others. ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems

May 2017

7138 pages

ISBN:9781450346559

DOI:10.1145/3025453

General Chairs:
Gloria Mark
University of California Irvine
,
Susan Fussell
Cornell University
,
Program Chairs:
Cliff Lampe
University of Michigan
,
m.c. schraefel
University of Southampton
,
Juan Pablo Hourcade
University of Iowa
,
Caroline Appert
Université Paris-Sud
,
Daniel Wigdor
University of Toronto

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 02 May 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Agence Nationale de la Recherche (ANR)
European Research Council (ERC)

Conference

CHI '17

Sponsor:

SIGCHI

CHI '17: CHI Conference on Human Factors in Computing Systems

May 6 - 11, 2017

Colorado, Denver, USA

Acceptance Rates

CHI '17 Paper Acceptance Rate 600 of 2,400 submissions, 25%;

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

19
Total Citations
View Citations
458
Total Downloads

Downloads (Last 12 months)38
Downloads (Last 6 weeks)5

Reflects downloads up to 09 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Coppens AHermen JSchwartz LMoll CMaquil V(2024)Supporting Mixed-Presence Awareness across Wall-Sized Displays Using a Tracking Pipeline based on Depth CamerasProceedings of the ACM on Human-Computer Interaction10.1145/36646348:EICS(1-32)Online publication date: 17-Jun-2024
https://dl.acm.org/doi/10.1145/3664634
Yuan YGenatempo PJin QYarosh S(2024)Field Trial of a Tablet-based AR System for Intergenerational Connections through Remote ReadingProceedings of the ACM on Human-Computer Interaction10.1145/36536968:CSCW1(1-28)Online publication date: 26-Apr-2024
https://dl.acm.org/doi/10.1145/3653696
Chapuis OJames RRafiei MBezerianos A(2024)Comparing Physical and VR-emulated Ultra-walls in a Classification TaskProceedings of the 35th Conference on l'Interaction Humain-Machine10.1145/3649792.3649797(1-14)Online publication date: 25-Mar-2024
https://dl.acm.org/doi/10.1145/3649792.3649797
Belkacem ITominski CMédoc NKnudsen SDachselt RGhoniem M(2024)Interactive Visualization on Large High‐Resolution Displays: A SurveyComputer Graphics Forum10.1111/cgf.15001Online publication date: 30-Apr-2024
https://doi.org/10.1111/cgf.15001
Echtler FMaierhöfer VHansen NWimmer R(2023)SurfaceCast: Ubiquitous, Cross-Device Surface SharingProceedings of the ACM on Human-Computer Interaction10.1145/36264757:ISS(286-308)Online publication date: 1-Nov-2023
https://dl.acm.org/doi/10.1145/3626475
Sakashita MKim HWoodard BZhang RGuimbretière F(2023)VRoxy: Wide-Area Collaboration From an Office Using a VR-Driven Robotic ProxyProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606743(1-13)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606743
Sakashita MZhang RLi XKim HRusso MZhang CJung MGuimbretière F(2023)ReMotion: Supporting Remote Collaboration in Open Space with Automatic Robotic EmbodimentProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580699(1-14)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580699
Fink DZagermann JReiterer HJetter H(2022)Re-locations: Augmenting Personal and Shared Workspaces to Support Remote Collaboration in Incongruent SpacesProceedings of the ACM on Human-Computer Interaction10.1145/35677096:ISS(1-30)Online publication date: 14-Nov-2022
https://dl.acm.org/doi/10.1145/3567709
Narayanan AHu EHeo S(2022)Enabling Remote Hand Guidance in Video Calls Using Directional Force IllusionCompanion Publication of the 2022 Conference on Computer Supported Cooperative Work and Social Computing10.1145/3500868.3559470(135-139)Online publication date: 8-Nov-2022
https://dl.acm.org/doi/10.1145/3500868.3559470
Le KTran TChlasta KKrejtz KFjeld MKunz A(2021)VXSlate: Exploring Combination of Head Movements and Mobile Touch for Large Virtual Display InteractionProceedings of the 2021 ACM Designing Interactive Systems Conference10.1145/3461778.3462076(283-297)Online publication date: 28-Jun-2021
https://dl.acm.org/doi/10.1145/3461778.3462076
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents