Abstract
The Neem Platform is a research test bed for Project Neem, concerned with the development of socially and culturally aware group systems.
The Neem Platform is a generic framework for the development of augmented collaborative applications, mainly targeting synchronous distributed collaboration over the internet. It supports rapid prototyping, as well as Wizard of Oz experiments to ease development and evolution of such applications.
A novelty of the work is its focus on the dynamic aspects that distinguish group interaction under a Perceptual interface paradigm. Participants’ multimodal interactions such as voice exchanges, textual messages, widget operations and eventually gestures, eye gaze and facial expressions are made available to applications, that apply situated reasoning, using this rich contextual information to dynamically adapt their behavior. The system presents itself multimodally as well, through a set of virtual participants - automated entities that are perceived by human participants as having personalities and emotions, making use of animation and voice generation.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
P. Barthelmess and C.A. Ellis. Aspect-oriented composition in extensible collaborative applications. In Proceedings of the 2002 International Conference on Parallel and Distributed Processing Techniques and Applications (PDPTA’ 02), Las Vegas, June 2002. Accepted for publication.
P. Barthelmess and C.A. Ellis. The neem platform: an evolvable framework for perceptual collaborative applications. Technical report, University of Colorado at Boulder, Computer Science Department, 2002.
R. A. Bolt. “put-that-there”: Voice and gesture at the graphics interface. In SIGGRAPH’ 80 Proceedings, volume 14, 1980.
N. Carriero and D. Gelernter. Linda in context. Communications of the ACM, 32(4), 1989.
P. R. Cohen, M. Johnston, D. McGee, I. Smith, S. Oviatt, J. Pittman, L. Chen, and J. Clow. Quickset: Multimodal interaction for simulation set-up and control. In Proceedings of the Fifth Applied Natural Language Processing meeting, 1997.
Paul Dourish. Consistency guarantees: Exploiting application semantics for consistency management in a collaboration toolkit. In Proceedings of the ACM Conference on Computer Supported Cooperative Work, Concurrency, 1996.
Paul Dourish. Using metalevel techniques in a flexible toolkit for CSCW applications. ACM Transactions on Computer-Human Interaction, 5(2), 1998.
W. Keith Edwards. Coordination Infrastructure in Collaborative Systems. PhD thesis, Georgia Institute of Technology, College of Computing, 1995.
C.A. Ellis. Neem project: An agent based meeting augmentation system. Technical report, University Of Colorado at Boulder, Department of Computer Science, 2002.
C.A. Ellis, P. Barthelmess, B. Quan, and J. Wainer. Neem: An agent-based meeting augmentation system. Technical report, University of Colorado at Boulder,Department of Computer Science, 2001.
Katherine Isbister, Cliff Nass, Hideyuki Nakanishi, and Toru Ishida. Helper agent: An assistant for human-human interaction in a virtual meeting space. In Proceedings of the CHI 2000 Conference, 2000.
Tony Jebara, Yuri Ivanov, Ali Rahimi, and Alex Pentland. Tracking conversational context for machine mediation of human discourse. In AAAI Fall 2000 Symposium-Socially Intelligent Agents-The Human in the Loop, 2000.
Michael Johnston, Philip R. Cohen, David McGee, Sharon L. Oviatt, James A. Pittman, and Ira Smith. Unification-based multimodal integration. In Proceedings of the Thirty-Fifth Annual Meeting of the Association for Computational Linguistics and Eighth Conference of the European Chapter of the Association for Computational Linguistics, 1997.
Gregor Kiczales. Beyond the black box: open implementation — soapbox. IEEE Software, 13(1), 1996.
D. McGee and P. Cohen. Creating tangible interfaces by augmenting physical objects with multimodal language. In Proceedings of the International Conference on Intelligent User Interfaces (IUI 2001), 2001.
Mitre Corporation. Galaxy Communicator Documentation, 2002. Available on the web at http://communicator.sourceforge.net/sites/MITRE/distributions/GalaxyCommunicator/docs/manual/index.html.
Laurence Nigay and Joëlle Coutaz. A design space for multimodal systems: Concurrent processing and data fusion. In Proceedings of INTERCHI’ 93, 1993.
Kazushi Nishimoto, Yasuyuki Sumi, and Kenji Mase. Enhancement of creative aspects of a daily conversation with a topic development agent. In Coordination Technology for Collaborative Applications-Organizations, Processes, and Agents, volume 1364 of Lecture Notes on Computer Science, 1998.
George A. Papadopoulos and Farhad Arbab. Coordination models and languages. In The Engineering of Large Systems, volume 46 of Advances in Computers. Academic Press, 1998.
Rameshsharma Ramloll. Micis: A multimodal interface for a common information space. In ECSCW’97 Conference Supplement, 1997.
Byron Reeves and Clifford Nass. The Media Equation. How People Treat Computers, Television, and New Media Like Real People and Places. CSLI Publications, 1996.
Byron Reeves and Clifford Nass. Perceptual user interfaces: perceptual bandwidth. Communications of the ACM, 43(3), 2000.
Mark Roseman and Saul Greenberg. Building real-time groupware with groupkit, a groupware toolkit. ACM Transactions on Computer-Human Interaction, 3(1), 1996.
Vassil Roussev, Prasun Dewan, and Vibhor Jain. Composable collaboration infrastructures based on programming patterns. In Proceedings of the ACM Conference on Computer Supported Cooperative Work, Component Based Infrastructures, 2000.
M. Turk and G. Robertson, editors. Communications of the ACM, volume 43, March 2000. Special Issue on Perceptual User Interfaces.
Alex Waibel. Interactive translation of conversational speech. IEEE Computer, 29(7), 1996.
W. Ward and B. Pellom. The cu communicator system. In IEEE Workshop on Automatic Speech Recognition and Understanding, 1999.
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2002 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Barthelmess, P., Ellis, C.A. (2002). The Neem Platform: An Extensible Framework for the Development of Perceptual Collaborative Applications. In: Han, Y., Tai, S., Wikarski, D. (eds) Engineering and Deployment of Cooperative Information Systems. EDCIS 2002. Lecture Notes in Computer Science, vol 2480. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45785-2_44
Download citation
DOI: https://doi.org/10.1007/3-540-45785-2_44
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-44222-6
Online ISBN: 978-3-540-45785-5
eBook Packages: Springer Book Archive