research-article

A context-aware virtual secretary in a smart office environment

Authors:

Maria Danninger,

Rainer StiefelhagenAuthors Info & Claims

MM '08: Proceedings of the 16th ACM international conference on Multimedia

Pages 529 - 538

https://doi.org/10.1145/1459359.1459430

Published: 26 October 2008 Publication History

Abstract

A lot of the communication at the workplace - via the phone as well as face-to-face - occurs in inappropriate contexts, disturbing meetings and conversations, invading personal and corporate privacy, and more broadly breaking social norms. This is because both, callers and visitors in front of closed office doors, face the same problem: they can only guess the other person's current availability for a conversation.

We present a context-aware Virtual Secretary designed to facilitate more socially appropriate communication at the workplace. This service aims towards understanding a person's activity in smart offices, and passes on important contextual information to callers and visitors in order to facilitate more informed human decisions about how and when to initiate contact.

We have deployed this Virtual Secretary in the office of a senior researcher, mediating all his actual phone calls and in-person meetings for several weeks. With the Virtual Secretary active, the number of inappropriate workplace interruptions could be significantly reduced.

References

[1]

D. Avrahami, D. Gergle, S. E. Hudson, and S. Kiesler. Improving the match between callers and receivers: A study on the effect of contextual information on cell phone interruptions. Behaviour & Information Technology (BIT), 26(3):247--259, 2007.

Digital Library

[2]

K. Bernardin and R. Stiefelhagen. Audio-visual multi-person tracking and identification for smart environments. In Proceedings of the ACM Multimedia 2007, Augsburg, Germany, 2007.

Digital Library

[3]

B. Brown and R. Randell. Building a context sensitive telephone: Some hopes and pitfalls for context sensitive computing. Comput. Supported Coop.Work, 13(3-4):329--345, 2004.

Digital Library

[4]

H. H. Clark and M. A. Krych. Speaking while monitoring addressees for understanding. Journal of Memory and Language, 50(1):62--81, 2004.

[5]

M. Csikszentmihalyi. Flow: The Psychology of Optimal Experience. Harper Perennial, New York, March 1991.

[6]

M. Danninger, L. Takayama, Q. Wang, C. Schultz, J. Beringer, P. Hofmann, F. James, and C. Nass. Can you talk or only touch-talk? a voip-based phone feature for quick, quiet, and private communication. In ICMI '07: Proceedings of the 9th international conference on Multimodal interfaces, NewYork, NY, USA, 2007. ACM Press.

Digital Library

[7]

P. Dourish and V. Bellotti. Awareness and coordination in shared workspaces. In CSCW '92: Proceedings of the 1992 ACM conference on Computer-supported cooperative work, pages 107--114, New York, NY, USA, 1992. ACM.

Digital Library

[8]

H. K. Ekenel and R. Stiefelhagen. Analysis of local appearance-based face recognition: Effects of feature selection and feature normalization. In CVPRW'06: Proceedings of the 2006 Conference on Computer Vision and Pattern Recognition Workshop, page 34, Washington, DC, USA, 2006. IEEE Computer Society.

Digital Library

[9]

T. Erickson. Some problems with the notion of context-aware computing. Commun. ACM, 45(2):102--104, 2002.

Digital Library

[10]

J. Fogarty, S. E. Hudson, C. G. Atkeson, D. Avrahami, J. Forlizzi, S. Kiesler, J. C. Lee, and J.Yang. Predicting human interruptibility with sensors. ACM Trans. Comput.-Hum. Interact., 12(1):119--146, 2005.

Digital Library

[11]

J. Fogarty, S. E. Hudson, and J. Lai. Examining the robustness of sensor-based statistical models of human interruptibility. In CHI '04: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 207--214, New York, NY, USA, 2004. ACM Press.

Digital Library

[12]

K. Hinckley and E. Horvitz. Toward more sensitive mobile phones. In UIST'01: Proceedings of the 14th annual ACM symposium on User interface software and technology, pages 191--192, New York, NY, USA, 2001.ACM.

Digital Library

[13]

J. Ho and S. S. Intille. Using context-aware computing to reduce the perceived burden of interruptions from mobile devices. In CHI '05: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 909--918, New York, NY, USA, 2005. ACM.

Digital Library

[14]

J. Hollan and S. Stornetta. Beyond being there. In CHI '92: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 119--125, NewYork, NY, USA, 1992. ACM.

Digital Library

[15]

E. Horvitz and J. Apacible. Learning and reasoning about interruption. In ICMI '03: Proceedings of the 5th international conference on Multimodal interfaces, pages 20--27, New York, NY, USA, 2003. ACM Press.

Digital Library

[16]

J. M. Hudson, J. Christensen, W. A. Kellogg, and T. Erickson. "i'd be overwhelmed, but it's just one more thing to do": availability and interruption in research management. In CHI '02: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 97--104, New York, NY, USA, 2002. ACM Press.

Digital Library

[17]

B. Johnson and S. Greenberg. Judging people's availability for interaction from video snapshots. In HICSS '99: Proceedings of the Thirty-Second Annual Hawaii International Conference on System Sciences - Volume 1, page 1026, Washington, DC, USA, 1999. IEEE Computer Society.

Digital Library

[18]

P. Korpipää, J. Häkkilä, J. Kela, S. Ronkainen, and I. Känsälä. Utilising context ontology in mobile device application personalisation. In MUM '04: Proceedings of the 3rd international conference on Mobile and ubiquitous multimedia, pages 133--140, New York, NY, USA, 2004. ACM.

Digital Library

[19]

S. Kristoffersen and F. Ljungberg. An empirical study of how people establish interaction: implications for cscw session management models. In CHI '99: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 1--8, New York, NY, USA, 1999. ACM Press.

Digital Library

[20]

S. Love and M. Perry. Dealing with mobile conversations in public places: some implications for the design of socially intrusive technologies. In CHI '04: CHI '04 extended abstracts on Human factors in computing systems, pages 1195--1198, New York, NY, USA, 2004. ACM Press.

Digital Library

[21]

A. E. Milewski and T. M. Smith. Providing presence cues to telephone users. In CSCW '00: Proceedings of the 2000 ACM conference on Computer supported cooperative work, pages 89--96, New York, NY, USA, 2000. ACM.

Digital Library

[22]

A. Monk, J. Carroll, S. Parker, and M. Blythe. Why are mobile phones annoying? Behav. Inf. Tech., 23(1):33--41, 2004.

Digital Library

[23]

K. S. Nagel, J. M. Hudson, and G. D. Abowd. Predictors of availability in home life context-mediated communication. In CSCW'04: Proceedings of the 2004 ACM conference on Computer supported cooperative work, pages 497--506, New York, NY, USA, 2004. ACM.

Digital Library

[24]

E. R. Pedersen. Calls.calm: enabling caller and callee to collaborate. In CHI '01: CHI '01 extended abstracts on Human factors in computing systems, pages 235--236, New York, NY, USA, 2001. ACM.

Digital Library

[25]

M. Raento, A. Oulasvirta, R. Petit, and H. Toivonen. Contextphone: A prototyping platform for context-aware mobile applications. IEEE Pervasive Computing, 4(2):51--59, 2005.

Digital Library

[26]

B. N. Schilit, D. M. Hilbert, and J. Trevor. Context-aware communication. IEEE Wireless Communications, 9:46--54, 2002.

Digital Library

[27]

C. Stauffer and W. Grimson. Adaptive background mixture models for real-time tracking. cvpr, 02:2246, 1999.

[28]

L. Szasz-Toth. Open-set face recognition, 2007. Studienarbeit, Universität Karlsruhe (TH), Fakultät für Informatik.

[29]

J. C. Tang, N. Yankelovich, J. Begole, M. V. Kleek, F. Li, and J. Bhalodia. Connexus to awarenex: extending awareness to mobile users. In CHI '01: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 221--228, New York, NY, USA, 2001. ACM.

Digital Library

[30]

S. Whittaker, D. Frohlich, and O. Daly-Jones. Informal workplace communication: what is it like and how might we support it? In CHI '94: Proceedings of the SIGCHI conference on Human factors in computing systems, pages 131--137, New York, NY, USA, 1994. ACM Press.

Digital Library

[31]

C. Wojek, K. Nickel, and R. Stiefelhagen. Activity recognition and room-level tracking in an office environment. In IEEE Int. Conference on Multisensor Fusion and Integration for Intelligent Systems - MFI06, Heidelberg, Germany, September 2006.

Cited By

Sun ZLiang QWang MZhang Z(2023)Neighbor-Environment Observer: An Intelligent Agent for Immersive Working CompanionshipProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606728(1-14)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606728
Georgievski IJohnson Jeyakumar IKale S(2021)Designing a System Based on Robotic Assistance for Privacy Awareness in Smart Environments2021 IEEE 12th Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON)10.1109/UEMCON53757.2021.9666672(0427-0432)Online publication date: 1-Dec-2021
https://doi.org/10.1109/UEMCON53757.2021.9666672
Richer RZhao NEskofier BParadiso J(2020)Exploring Smart Agents for the Interaction with Multimodal Mediated EnvironmentsMultimodal Technologies and Interaction10.3390/mti40200274:2(27)Online publication date: 6-Jun-2020
https://doi.org/10.3390/mti4020027
Show More Cited By

Index Terms

A context-aware virtual secretary in a smart office environment
1. Human-centered computing
  1. Interaction design
    1. Interaction design process and methods
      1. User centered design

Recommendations

Technology-mediated interruption management

Previous research into providing interpersonal technology-mediated interruption management support has predominantly been conducted from a paradigmatic standpoint that focused on modeling the context of the person being interrupted (interruptee) such as ...
Interpersonal interruptibility: a framework and research program
CHI EA '08: CHI '08 Extended Abstracts on Human Factors in Computing Systems

To date, research exploring interpersonal technology-mediated interruptions has focused on understanding how knowledge of an "interruptee's-local-context" can be utilized to reduce unwanted intrusions. However, the value of everyday interruptions are ...
Providing multilayered context for building smart home
Selected papers from the International Conference on Computer Science, Software Engineering, Information Technology, e-Business, and Applications, 2004

Ubiquitous computing supports context-aware applications under smart environment. Currently, generality, reusability, and simple query mechanism of the context are issued to realize the context-awareness. In this work, a well-structured architecture to ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

MM '08: Proceedings of the 16th ACM international conference on Multimedia

October 2008

1206 pages

ISBN:9781605583037

DOI:10.1145/1459359

General Chairs:
Abdulmotaleb EL Saddik
University of Ottawa
,
Son Vuong
University of British Colombia
,
Program Chairs:
Carsten Griwodz
University of Oslo
,
Alberto Del Bimbo
University degli Studi di Firenze
,
K. Selcuk Candan
Arizona State University
,
Alejandro Jaimes
Telefonica R&D, Madrid, Spain

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 October 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MM08

Sponsor:

MM08: ACM Multimedia Conference 2008

October 26 - 31, 2008

British Columbia, Vancouver, Canada

Acceptance Rates

Overall Acceptance Rate 995 of 4,171 submissions, 24%

Upcoming Conference

MM '24

Sponsor:
sigmm

The 32nd ACM International Conference on Multimedia

October 28 - November 1, 2024

Melbourne , VIC , Australia

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
669
Total Downloads

Downloads (Last 12 months)12
Downloads (Last 6 weeks)2

Reflects downloads up to 26 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Sun ZLiang QWang MZhang Z(2023)Neighbor-Environment Observer: An Intelligent Agent for Immersive Working CompanionshipProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606728(1-14)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606728
Georgievski IJohnson Jeyakumar IKale S(2021)Designing a System Based on Robotic Assistance for Privacy Awareness in Smart Environments2021 IEEE 12th Annual Ubiquitous Computing, Electronics & Mobile Communication Conference (UEMCON)10.1109/UEMCON53757.2021.9666672(0427-0432)Online publication date: 1-Dec-2021
https://doi.org/10.1109/UEMCON53757.2021.9666672
Richer RZhao NEskofier BParadiso J(2020)Exploring Smart Agents for the Interaction with Multimodal Mediated EnvironmentsMultimodal Technologies and Interaction10.3390/mti40200274:2(27)Online publication date: 6-Jun-2020
https://doi.org/10.3390/mti4020027
Fender AMüller JLee BLee GScott STory MKim J(2019)SpaceState: Ad-Hoc Definition and Recognition of Hierarchical Room States for Smart EnvironmentsProceedings of the 2019 ACM International Conference on Interactive Surfaces and Spaces10.1145/3343055.3359715(303-314)Online publication date: 10-Nov-2019
https://dl.acm.org/doi/10.1145/3343055.3359715
Nurgaliyev KMauro DKhan NAugusto J(2017)Improved Multi-user Interaction in a Smart Environment Through a Preference-Based Conflict Resolution Virtual Assistant2017 International Conference on Intelligent Environments (IE)10.1109/IE.2017.21(100-107)Online publication date: Aug-2017
https://doi.org/10.1109/IE.2017.21
Baraki HGeihs KVoigtmann CHoffmann AKniewel RMacek BZirfas JBertolino ACanfora GElbaum S(2015)Interdisciplinary design patterns for socially aware computingProceedings of the 37th International Conference on Software Engineering - Volume 210.5555/2819009.2819084(477-486)Online publication date: 16-May-2015
https://dl.acm.org/doi/10.5555/2819009.2819084
Baraki HGeihs KVoigtmann CHoffmann AKniewel RMacek BZirfas J(2015)Interdisciplinary Design Patterns for Socially Aware Computing2015 IEEE/ACM 37th IEEE International Conference on Software Engineering10.1109/ICSE.2015.180(477-486)Online publication date: May-2015
https://doi.org/10.1109/ICSE.2015.180
Voigtmann CDavid K(2014)Collaborative Context PredictionSocio-technical Design of Ubiquitous Computing Systems10.1007/978-3-319-05044-7_8(131-150)Online publication date: 29-Mar-2014
https://doi.org/10.1007/978-3-319-05044-7_8
Hashimoto STanaka TAoki KFujita K(2013)Estimation of interruptibility during office work based on PC activity and conversationProceedings of the 15th international conference on Human Interface and the Management of Information: information and interaction for learning, culture, collaboration and business - Volume Part III10.1007/978-3-642-39226-9_33(297-306)Online publication date: 21-Jul-2013
https://dl.acm.org/doi/10.1007/978-3-642-39226-9_33
Miao JChen GLi AYan JJiang S(2010)HIMAProceedings of the 2010 International Conference on Electrical and Control Engineering10.1109/iCECE.2010.1272(5242-5245)Online publication date: 25-Jun-2010
https://dl.acm.org/doi/10.1109/iCECE.2010.1272
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents