research-article

Virtual assistant: an artificial agent for enhancing content acquisition: how ambient media elicit information from humans

Authors:

Motoyuki Ozeki,

Shunichi Maeda,

Yuichi NakamuraAuthors Info & Claims

SAME '08: Proceedings of the 1st ACM international workshop on Semantic ambient media experiences

Pages 75 - 82

https://doi.org/10.1145/1461912.1461927

Published: 31 October 2008 Publication History

Abstract

In this paper, we propose a novel framework "Virtual Assistant" for enhancing content potentially procured by ambient media. The Virtual Assistant is an artificial agent simulating a human assistant shown in TV programs and prompts users to provide feedback by asking questions or back-channeling. This framework ensures that sufficient information is provided in the captured content while users interact in a natural and enjoyable way with the agent. We developed a prototype agent based on a chatbot-like approach and applied it to a daily cooking scene. The experimental results demonstrate a good potential of the Virtual Assistant framework, allowing a person to provide feedback easily with few interruptions, lifting the face towards the camera, and eliciting a variety of useful information.

References

[1]

G. D. Abowd, C. Atkeson, A. Bobick, I. Essa, B. MacIntyre, E. Mynatt, and T. Starner, Living laboratories: The future computing environments group at the georgia institute of technology, Extended Abstracts of the ACM Conference on Human Factors in Computing Systems, pages 215--216, 2000.

Digital Library

[2]

P. Chi, J. Chen, H. Chu, and B. Chen, Enabling nutrition-aware cooking in a smart kitchen, Extended Abstract of Human factors in computing systems, pages 2333--2338, 2007.

Digital Library

[3]

M. Davis, Active capture: Automatic direction for automatic movies, Proc. of 11th Annual ACM International Conference on Multimedia, pages 602--603, 2003.

Digital Library

[4]

R. Hamada, K. Miura, I. Ide, S. Satoh, S. Sakai, and H. Tanaka, Multimedia integration for cooking video indexing, Proc. of Pacific-Rim Conference on Multimedia, II:657--664, 2004.

Digital Library

[5]

A. Hashimoto, N. Mori, T. Funatomi, Y. Yamakata, K. Kakusho, and M. Minoh, Smart kitchen: A user centric cooking support system, In Proc. of Information Processing and Management of Uncertainty in Knowledge-Based System, pages 848--854, 2008.

[6]

H. Ishii, C. Wisneski, S. Brave, A. Dahley, M. Gorbet, B. Ullmer, and P. Yarin, ambientroom: Integrating ambient media with architectural space, Proc. of Conference on Human Factors in Computing Systems, pages 173--174, 1998.

Digital Library

[7]

W. Ju, R. Hurwitz, T. Judd, and B. Lee, Counteractive: An interactive cookbook for the kitchen counter, Extended Abstracts of CHI 2001, pages 269--270, 2001.

Digital Library

[8]

A. Lugmayr, Ambient, ambient, ambient - what are ambient media?, TICSP Adjunct Proc. of EuroITV 2007, pages 89--93, 2007.

[9]

Y. Nakauchi, T. Fukuda, K. Noguchi, and T. Matsubara, Intelligent kitchen: Cooking support by lcd and mobile robot with ic-labeled objects, Proc. of Int'l Conf. on Intelligent Robots and Systems, 2005.

[10]

M. Ozeki, Y. Nakamura, and Y. Ohta, Automated camerawork for capturing desktop presentations, IEE Proc. on Vision, Image & Signal Processing, 152(4):437--447, 2005.

[11]

C. Pinhanez and A. Bobick, Intelligent studios: Modeling space and action to control tv cameras, Proc. of Applications of Artificial Intelligence, 11(4):285--306, 1997.

[12]

M. Rougvie and P. Olivier, Dynamic editing methods for interactively adapting cinematographic style, TICSP Adjunct Proc. of EuroITV 2007, pages 304--308, 2007.

[13]

I. Siio, N. Mima, I. Frank, T. Ono, and H. Weintraub, Making recipes in the kitchen of the future, Extended abstracts of Human factors in computing systems, pages 1554--1554, 2004.

Digital Library

[14]

E. M. Tapia, S. S. Intille, and K. Larson, Activity recognition in the home setting using simple and ubiquitous sensors, Proc. of Pervasive 2004, LNCS 3001:158--175, 2004.

[15]

Q. T. Tran, G. Calcaterra, and E. D. Mynatt, Cook's collage: Deja vu display for a home kitchen, Proc. of Home-Oriented Informatics and Telematics 2005, pages 15--32, 2005.

[16]

T. Yamazaki, Ubiquitous home: Real-life testbed for home context-aware service. Proc. of Tridentcom 2005, pages 54--59, 2005.

Digital Library

Cited By

Jain PFarzan RLee A(2022)Laila is in a Meeting: Design and Evaluation of a Contextual Auto-Response Messaging AgentProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3533493(1457-1471)Online publication date: 13-Jun-2022
https://dl.acm.org/doi/10.1145/3532106.3533493
Yu ZNakamura Y(2010)Smart meeting systemsACM Computing Surveys10.1145/1667062.166706542:2(1-20)Online publication date: 5-Mar-2010
https://dl.acm.org/doi/10.1145/1667062.1667065
Lugmayr ARisse TStockleben BLaurila KKaario J(2009)Semantic ambient media--an introductionMultimedia Tools and Applications10.1007/s11042-009-0282-z44:3(337-359)Online publication date: 1-Sep-2009
https://dl.acm.org/doi/10.1007/s11042-009-0282-z

Index Terms

Virtual assistant: an artificial agent for enhancing content acquisition: how ambient media elicit information from humans
1. Human-centered computing
  1. Interaction design
    1. Interaction design process and methods
      1. User centered design
2. Information systems
  1. World Wide Web
    1. Web applications
      1. Internet communications tools

Recommendations

Virtual assistant: enhancing content acquisition by eliciting information from humans

In this paper, we propose the "Virtual Assistant," a novel framework for supporting knowledge capturing in videos. The Virtual Assistant is an artificial agent that simulates a human assistant shown in TV programs and prompts users to provide feedback ...
RFC 8006: Content Delivery Network Interconnection (CDNI) Metadata
Embedding Values in Artificial Intelligence (AI) Systems
Abstract
Organizations such as the EU High-Level Expert Group on AI and the IEEE have recently formulated ethical principles and (moral) values that should be adhered to in the design and deployment of artificial intelligence (AI). These include respect ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SAME '08: Proceedings of the 1st ACM international workshop on Semantic ambient media experiences

October 2008

90 pages

ISBN:9781605583143

DOI:10.1145/1461912

General Chairs:
Artur Lugmayr
Tampere Univ. of Techn. & lugYmedia Inc., Finland
,
Thomas Risse
L3S Research Center, Germany
,
Bjorn Stockleben
Rundfunk Berlin Brandenburg (RBB), Germany
,
Juha Kaario
Nokia, Finland
,
Kari Laurila
Nokia, Finland

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 31 October 2008

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

MM08

Sponsor:

MM08: ACM Multimedia Conference 2008

October 31, 2008

British Columbia, Vancouver, Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
324
Total Downloads

Downloads (Last 12 months)5
Downloads (Last 6 weeks)0

Reflects downloads up to 20 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Jain PFarzan RLee A(2022)Laila is in a Meeting: Design and Evaluation of a Contextual Auto-Response Messaging AgentProceedings of the 2022 ACM Designing Interactive Systems Conference10.1145/3532106.3533493(1457-1471)Online publication date: 13-Jun-2022
https://dl.acm.org/doi/10.1145/3532106.3533493
Yu ZNakamura Y(2010)Smart meeting systemsACM Computing Surveys10.1145/1667062.166706542:2(1-20)Online publication date: 5-Mar-2010
https://dl.acm.org/doi/10.1145/1667062.1667065
Lugmayr ARisse TStockleben BLaurila KKaario J(2009)Semantic ambient media--an introductionMultimedia Tools and Applications10.1007/s11042-009-0282-z44:3(337-359)Online publication date: 1-Sep-2009
https://dl.acm.org/doi/10.1007/s11042-009-0282-z

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten