research-article

FocalSpace: multimodal activity tracking, synthetic blur and adaptive presentation for video conferencing

Authors:

Anthony DeVincenzi,

Hiroshi IshiiAuthors Info & Claims

SUI '13: Proceedings of the 1st symposium on Spatial user interaction

Pages 73 - 76

https://doi.org/10.1145/2491367.2491377

Published: 20 July 2013 Publication History

Abstract

We introduce FocalSpace, a video conferencing system that dynamically recognizes relevant activities and objects through depth sensing and hybrid tracking of multimodal cues, such as voice, gesture, and proximity to surfaces. FocalSpace uses this information to enhance users' focus by diminishing the background through synthetic blur effects. We present scenarios that support the suppression of visual distraction, provide contextual augmentation, and enable privacy in dynamic mobile environments. Our user evaluation indicates increased memory accuracy and user preference for FocalSpace techniques compared to traditional video conferencing.

Supplementary Material

JPG File (sui0127-file3.jpg)

Download
14.06 KB

suppl.mov (sui0127-file3.m4v)

Supplemental video

Download
38.84 MB

References

[1]

Chatting, D. J., Galpin, J. S., and Donath, J. S. Presence and portrayal: video for casual home dialogues. In MULTIMEDIA '06. ACM, 395--401.

Digital Library

[2]

Colby, G., and Scholl, L. Transparency and blur as selective cues for complex visual information. In SPIE 1460. Image Handling and Reproduction Systems Integration, 114.

[3]

Criminisi, A., Cross, G., Blake, A., and Kolmogorov, V. Bilayer Segmentation of Live Video. In CVPR '06. IEEE Computer Society, 53-60.

Digital Library

[4]

DeVincenzi, A., Yao, L., Ishii, H., and Raskar, R. Kinected conference: augmenting video imaging with calibrated depth and audio. In CSCW '11. ACM, 621-624

Digital Library

[5]

Follmer, S. Raffle, H., Go, J., Ballagas, R., and Ishii, H. Video play: playful interactions in video conferencing for longdistance families with young children. In IDC '10. ACM, 49-58.

Digital Library

[6]

Harrison, C., Benko, H., and Wilson, A. D. OmniTouch: wearable multitouch interaction everywhere. In UIST '11. ACM, 441-450.

Digital Library

[7]

Hirsch, M., Lanman, D. Holtzman, H., and Raskar, R. BiDi screen: a thin, depth-sensing LCD for 3D interaction using light fields. In SIGGRAPH Asia '09. ACM, 159-165.

Digital Library

[8]

iDisplay. Retrieved May 8, 2013, from SHAPE: http://www.getidisplay.com

[9]

Jenkin, T., McGeachie, J., Fono, D., and Vertegaal, R. eyeView: focus+context views for large group video conferences. In CHI EA '05. ACM, 1497-1500.

Digital Library

[10]

Kinect for Windows SDK. Retrieved May 8, 2013, from Microsoft: http://www.microsoft.com/enus/kinectforwindows/

[11]

Kosara, R., Miksch, S., and Hauser, H. Semantic Depth of Field. In INFOVIS '01. IEEE Computer Society, 97.

Digital Library

[12]

Mann, S. "Through the Glass, lightly". IEEE Technology and Society, 31 (3). 10-14.

[13]

McCay-Peet, L., Lalmas, M., and Navalpakkam, V. On saliency, affect and focused attention. In CHI '12. ACM, 541-550.

Digital Library

[14]

Roussel, N., Gueddana, S. Beyond "Beyond Being There": Towards Multiscale Communication Systems. In MM'07. ACM, 238-246.

Digital Library

[15]

OpenGL. Retrieved May 8, 2013 http://www.opengl.org/

[16]

Okada, K., Maeda, F., Ichikawaa, Y., and Matsushita, Y. Multiparty Videoconferencing at Virtual Social Distance: MAJIC Design. In CSCW'94. ACM, 385--393.

Digital Library

[17]

Vertegaal, R., Weevers, I., and Sohn, C. GAZE-2: an attentive video conferencing system. In CHI EA '02. ACM, 736-737.

Digital Library

Cited By

Kelly SKim JChoi J(2024)How appropriateness and enjoyment of instructors' virtual backgrounds affect students' perceptions of learningFrontiers in Computer Science10.3389/fcomp.2024.14097116Online publication date: 26-Jun-2024
https://doi.org/10.3389/fcomp.2024.1409711
Park GPanda PTankelevitch LRintel S(2024)The CoExplorer Technology Probe: A Generative AI-Powered Adaptive Interface to Support Intentionality in Planning and Running Video MeetingsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661507(1638-1657)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661507
Qian XTan FZhang YCollins BKim DOlwal ARamani KDu R(2024)ChatDirector: Enhancing Video Conferencing with Space-Aware Scene Rendering and Speech-Driven Layout TransitionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642110(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642110
Show More Cited By

Index Terms

FocalSpace: multimodal activity tracking, synthetic blur and adaptive presentation for video conferencing
1. Human-centered computing
  1. Human computer interaction (HCI)

Recommendations

Collaboard: a remote collaboration groupware device featuring an embodiment-enriched shared workspace
GROUP '10: Proceedings of the 2010 ACM International Conference on Supporting Group Work

In this paper we present a mixed presence groupware device called "CollaBoard". The device improves collaboration between co-located and remote partners by providing a high level of workspace awareness. This is achieved by superimposing a life-size ...
The GAZE groupware system: mediating joint attention in multiparty communication and collaboration
CHI '99: Proceedings of the SIGCHI conference on Human Factors in Computing Systems

In this paper, we discuss why, in designing multiparty mediated systems, we should focus first on providing non-verbal cues which are less redundantly coded in speech than those normally conveyed by video. We show how conveying one such cue, gaze direction,...
What makes groups learning effectively in a videoconference setting?
ICLS '06: Proceedings of the 7th international conference on Learning sciences

In an experimental study designed to test co-operative learning in a videoconference setting, dyads were formed to work under three different conditions: "without a shared workspace", "with a shared workspace", or "with a shared workspace plus a content-...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SUI '13: Proceedings of the 1st symposium on Spatial user interaction

July 2013

108 pages

ISBN:9781450321419

DOI:10.1145/2491367

General Chair:
Evan Suma
USC Institute for Creative Technologies USA
,
Program Chairs:
Wolfgang Stuerzlinger
York University, Canada
,
Frank Steinicke
University of Würzburg, Germany

Copyright © 2013 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 20 July 2013

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SUI '13

Sponsor:

SUI '13: Symposium on Spatial User Interaction

July 20 - 21, 2013

California, Los Angeles, USA

Acceptance Rates

SUI '13 Paper Acceptance Rate 12 of 31 submissions, 39%;

Overall Acceptance Rate 86 of 279 submissions, 31%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
313
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)1

Reflects downloads up to 10 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Kelly SKim JChoi J(2024)How appropriateness and enjoyment of instructors' virtual backgrounds affect students' perceptions of learningFrontiers in Computer Science10.3389/fcomp.2024.14097116Online publication date: 26-Jun-2024
https://doi.org/10.3389/fcomp.2024.1409711
Park GPanda PTankelevitch LRintel S(2024)The CoExplorer Technology Probe: A Generative AI-Powered Adaptive Interface to Support Intentionality in Planning and Running Video MeetingsProceedings of the 2024 ACM Designing Interactive Systems Conference10.1145/3643834.3661507(1638-1657)Online publication date: 1-Jul-2024
https://dl.acm.org/doi/10.1145/3643834.3661507
Qian XTan FZhang YCollins BKim DOlwal ARamani KDu R(2024)ChatDirector: Enhancing Video Conferencing with Space-Aware Scene Rendering and Speech-Driven Layout TransitionProceedings of the 2024 CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642110(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642110
Seitz JBenke IHeinzl AMaedche A(2024)The Impact of Video Meeting Systems on Psychological User StatesInternational Journal of Human-Computer Studies10.1016/j.ijhcs.2023.103178182:COnline publication date: 1-Feb-2024
https://dl.acm.org/doi/10.1016/j.ijhcs.2023.103178
Hu EGrønbæk JYing WDu RHeo S(2023)ThingShare: Ad-Hoc Digital Copies of Physical Objects for Sharing Things in Video MeetingsProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581148(1-22)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581148
Salas ARichardson KMcLaughlin AColeman MZeagler CJordan K(2022)The Effects of Augmented Reality Remapping on Individual Differences in Task Performance, Workload, and Error Frequency within ICU NursesProceedings of the Human Factors and Ergonomics Society Annual Meeting10.1177/107118132266116466:1(1423-1427)Online publication date: 27-Oct-2022
https://doi.org/10.1177/1071181322661164
Malkin NWagner DEgelman S(2022)Can Humans Detect Malicious Always-Listening Assistants? A Framework for Crowdsourcing Test DrivesProceedings of the ACM on Human-Computer Interaction10.1145/35556136:CSCW2(1-28)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3555613
Choi RYun CCho HHong HLee ULee S(2022)You Are Not AloneProceedings of the ACM on Human-Computer Interaction10.1145/35556126:CSCW2(1-30)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3555612
Goray CSchoenebeck S(2022)Youths' Perceptions of Data Collection in Online Advertising and Social MediaProceedings of the ACM on Human-Computer Interaction10.1145/35555766:CSCW2(1-27)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3555576
Kim HKim HKim JJang J(2022)When Does it Become Harassment?Proceedings of the ACM on Human-Computer Interaction10.1145/35555756:CSCW2(1-32)Online publication date: 11-Nov-2022
https://dl.acm.org/doi/10.1145/3555575
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten