Article

Enabling context-sensitive information seeking

Authors:

Michelle X. Zhou,

Vikram Aggarwal,

Zhen WenAuthors Info & Claims

IUI '06: Proceedings of the 11th international conference on Intelligent user interfaces

Pages 116 - 123

https://doi.org/10.1145/1111449.1111479

Published: 29 January 2006 Publication History

Abstract

Information seeking is an important but often difficult task, especially when it involves large and complex data sets. We hypothesize that a context-sensitive interaction paradigm would greatly assist users in their information seeking. Such a paradigm would allow users to both express their requests and receive requested information in context. Driven by this hypothesis, we have taken rigorous steps to design, develop, and evaluate a full-fledged, context-sensitive information system. We started with a Wizard-of-OZ (WOZ) study to verify the effectiveness of our envi-sioned system. We then built a fully automated system based on the findings from our WOZ study. We targeted the development and integration of two sets of technologies: context-sensitive mul-timodal input interpretation and multimedia output generation. Finally, we formally evaluated the usability of our system in real world conditions. The results show that our system greatly improves the users' ability to perform practical information-seek-ing tasks. These results not only confirm our initial hypothesis, but they also indicate the practicality of our approaches.

References

[1]

C. Ahlberg and B. Shneiderman. Visual information seeking: Tight coupling of dynamic query filters with starfield displays. In ACM Proc. SIGCHI '94, pages 313--317, 1994.

Digital Library

[2]

J. Allen, G. Ferguson, and A. Stent. An architecture for more realistic conversational systems. In IUI '01, pages 14--17.

Digital Library

[3]

E. Andre and T. Rist. Generating coherent presentations employing textual and visual material. AI Review, 9:147--165, 1995.

Digital Library

[4]

B. Bell and S. Feiner. Dynamic space management for user interfaces. In Proc. UIST '00, pages 239--248.

Digital Library

[5]

J. Chai, P. Hong, and M. Zhou. A probabilistic approach to reference resolution in multimodal user interfaces. In IUI'04, pages 70--77.

Digital Library

[6]

J. Chai, S. Pan, M. Zhou, and K. Houck. Context-based multi-modal input understanding in conversation systems. In ICMI '02, pages 87--92.

Digital Library

[7]

S. Feiner and K. McKeown. Automating the generation of coordinated multimedia. IEEE Computer, 24(10):33--41, Octo-ber 1994.

Digital Library

[8]

B. Grosz and C. Sidner. Attention, intention, and the structure of discourse. Journal of ACL, 2(3):175--204, 1986.

Digital Library

[9]

H. Hosobe. A modular geometric constraint solver for user interface applications. In Proc. UIST '01, pages 91--100.

Digital Library

[10]

K. Houck. Contextual revision in information-seeking conversation systems. In Proc. ICSLP '04, pages 201--204.

[11]

M. Johnson, S. Bangalore, G. Vasireddy, A. Stent, P. Ehlen, M. Walker, S. Whittaker, and P. Maloor. MATCH: An architecture for multimodal dialogue systems. In ACL '02, pages 376--383.

Digital Library

[12]

M. Johnson, P. Cohen, D. McGee, S. Oviatt, J. Pittman, and I. Smith. Unification-based multimodal integration. In ACL'97, pages 281--288.

Digital Library

[13]

S. Kerpedjiev, G. Carenini, S. Roth, and J. Moore. Integrating planning and task-based design for multimedia presentation. In IUI' 97, pages 145--152.

Digital Library

[14]

G. Marchionini. Information Seeking in Electronic Environments. Cambridge University Press, 1995.

Digital Library

[15]

M. Maybury. Planning multimedia explanations using com-municative acts. In M. Maybury, editor, Intelligent Multimedia Interfaces, chapter 2, pages 60--74. AAAI Press/The MIT Press, 1993.

Digital Library

[16]

M. Maybury and W. Wahlster, editors. Readings in Intelligent User Interfaces. Morgan Kaufmann, 1998.

Digital Library

[17]

M. McCord. Slot Grammar: A system for simpler construction of practical natural language grammars. In R. Studer, editor, Natural Language and Logic: Intl. Scientific Symposium, Lecture Notes in Computer Science, pages 118--145. Springer Verlag, 1990.

Digital Library

[18]

R. Morris. Toward a user-centered information service. J. of American Society for Information Science, 45(1):20--30, 1994.

Digital Library

[19]

J. Neal, C. Thielman, Z. Dobes, S. Haller, and S. Shapiro. Natural language with integrated deictic and graphic gestures. In M. Maybury and W. Wahlster, editors, Readings in Intelligent User Interfaces, pages 38--51. 1998.

Digital Library

[20]

S. Oviatt. Multimodal interactive maps: Designing for human performance. Human-Computer Interaction, 12:93--129, 1997.

Digital Library

[21]

S. Pan. A multi-layer conversation management approach for information-seeking applications. In Proc. ICSLP '04, pages 245--248.

[22]

S. Pan and J. Shaw. SEGUE: A hybrid case-based natural language generator. In Proc. INLG '04, pages 130--140, 2004.

[23]

S. Pan, S. Shen, M. Zhou, and K. Houck. Two-way adaptation for robust input interpretation in practical multimodal conversation systems. In IUI '05, pages 25--32.

Digital Library

[24]

A. Popescu, O. Etzioni, and H. Kautz. Towards a theory of natural language interfaces to databases. In IUI '03, pages 149--157.

Digital Library

[25]

X. Shen, B. Tan, and C. Zhai. Context-sensitive information retrieval with implicit feedback. In SIGIR '05, pages 43--50.

Digital Library

[26]

J. Teevan, C. Alvarado, M. Ackerman, and D. Karger. The perfect search engine is not enough: A study of orienteering behavior in directed search. In CHI' 04, pages 415--422.

Digital Library

[27]

J. Teevan, S. Dumais, and E. Horvitz. Personalizing search via automated analysis of interests and activities. In SIGIR'05, pages 449--456.

Digital Library

[28]

Z. Wen, M. Zhou, and V. Aggarwal. An optimization-based approach to dynamic visual context management. In InfoVis '05. To appear.

Digital Library

[29]

M. Zancanaro, O. Stock, and C. Strapparava. Multimodal interaction for information access: Exploiting cohesion. Computational Intelligence, 13(7):439--464, 1997.

[30]

M. Zhou and V. Aggarwal. An optimization-based approach to dynamic data content selection in intelligent multimedia interfaces. In Proc. UIST '04, pages 227--236. ACM, 2004.

Digital Library

[31]

M. Zhou and M. Chen. Automated generation of graphic sketches by examples. In IJCAI '03, pages 65--71.

Digital Library

[32]

M. Zhou, Z. Wen, and V. Aggarwal. A graph matching approach to dynamic media allocation in intelligent multimedia interfaces. In IUI '05, pages 114--121.

Digital Library

Cited By

Lin GLi JFazly APavlovic VTruong K(2023)Identifying Multimodal Context Awareness Requirements for Supporting User Interaction with Procedural VideosProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581006(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581006
Zhou MFu WPan SBrdiczka OChau PCalvary G(2019)Getting virtually personalProceedings of the 24th International Conference on Intelligent User Interfaces10.1145/3301275.3308445(i-i)Online publication date: 17-Mar-2019
https://dl.acm.org/doi/10.1145/3301275.3308445
Xiao ZZhou MFu WFu WPan SBrdiczka OChau PCalvary G(2019)Who should be my teammatesProceedings of the 24th International Conference on Intelligent User Interfaces10.1145/3301275.3302264(437-447)Online publication date: 17-Mar-2019
https://dl.acm.org/doi/10.1145/3301275.3302264
Show More Cited By

Index Terms

Enabling context-sensitive information seeking
1. Human-centered computing
  1. Interaction design
    1. Interaction design process and methods
      1. User centered design
2. Information systems
  1. Information systems applications
    1. Multimedia information systems

Recommendations

Demand-driven context-sensitive alias analysis for Java
ISSTA '11: Proceedings of the 2011 International Symposium on Software Testing and Analysis

Software tools for program understanding, transformation, verification, and testing often require an efficient yet highly-precise alias analysis. Typically this is done by computing points-to information, from which alias queries can be answered. This ...
Static flow-sensitive & context-sensitive information-flow analysis for software product lines: position paper
PLAS '12: Proceedings of the 7th Workshop on Programming Languages and Analysis for Security

A software product line encodes a potentially large variety of software products as variants of some common code base, e.g., through the use of #ifdef statements or other forms of conditional compilation. Traditional information-flow analyses cannot ...
Analyzing and Characterizing User Intent in Information-seeking Conversations
SIGIR '18: The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval

Understanding and characterizing how people interact in information-seeking conversations is crucial in developing conversational search systems. In this paper, we introduce a new dataset designed for this purpose and use it to analyze information-...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

IUI '06: Proceedings of the 11th international conference on Intelligent user interfaces

January 2006

392 pages

ISBN:1595932879

DOI:10.1145/1111449

General Chairs:
Ernest Edmonds
University of Technology Sydney, Australia
,
Doug Riecken
IBM Watson Research, USA
,
Program Chairs:
Cécile L. Paris
CSIRO ICT Centre, Australia
,
Candace L. Sidner
MERL, USA

Copyright © 2006 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 January 2006

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

IUI06

Sponsor:

IUI06: 11th International Conference on Intelligent User Interfaces

January 29 - February 1, 2006

Sydney, Australia

Acceptance Rates

Overall Acceptance Rate 746 of 2,811 submissions, 27%

Upcoming Conference

IUI '25

Sponsor:
sigai
sigai

30th International Conference on Intelligent User Interfaces

March 24 - 27, 2025

Cagliari , Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
1,023
Total Downloads

Downloads (Last 12 months)7
Downloads (Last 6 weeks)1

Reflects downloads up to 17 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Lin GLi JFazly APavlovic VTruong K(2023)Identifying Multimodal Context Awareness Requirements for Supporting User Interaction with Procedural VideosProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3581006(1-17)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3581006
Zhou MFu WPan SBrdiczka OChau PCalvary G(2019)Getting virtually personalProceedings of the 24th International Conference on Intelligent User Interfaces10.1145/3301275.3308445(i-i)Online publication date: 17-Mar-2019
https://dl.acm.org/doi/10.1145/3301275.3308445
Xiao ZZhou MFu WFu WPan SBrdiczka OChau PCalvary G(2019)Who should be my teammatesProceedings of the 24th International Conference on Intelligent User Interfaces10.1145/3301275.3302264(437-447)Online publication date: 17-Mar-2019
https://dl.acm.org/doi/10.1145/3301275.3302264
Heimbürger A(2013)Context Meets CultureProceedings of the 8th International and Interdisciplinary Conference on Modeling and Using Context - Volume 817510.1007/978-3-642-40972-1_11(143-156)Online publication date: 28-Oct-2013
https://dl.acm.org/doi/10.1007/978-3-642-40972-1_11
Okoye IMahmud JLau TCerruti JPu PPazzani MAndré ERiecken D(2011)Find this for meProceedings of the 16th international conference on Intelligent user interfaces10.1145/1943403.1943407(3-12)Online publication date: 13-Feb-2011
https://dl.acm.org/doi/10.1145/1943403.1943407
Crnovrsanin TLiao IWuy YMa K(2011)Visual recommendations for network navigationProceedings of the 13th Eurographics / IEEE - VGTC conference on Visualization10.1111/j.1467-8659.2011.01957.x(1081-1090)Online publication date: 1-Jun-2011
https://dl.acm.org/doi/10.1111/j.1467-8659.2011.01957.x
Wilcox LLu JLai JFeiner SJordan DMynatt EFitzpatrick GHudson SEdwards KRodden T(2010)Physician-driven management of patient progress notes in an intensive care unitProceedings of the SIGCHI Conference on Human Factors in Computing Systems10.1145/1753326.1753609(1879-1888)Online publication date: 10-Apr-2010
https://dl.acm.org/doi/10.1145/1753326.1753609
Grønli TGhinea G(2010)Three‐dimensional context‐aware tailoring of informationOnline Information Review10.1108/1468452101109939734:6(892-906)Online publication date: 30-Nov-2010
https://doi.org/10.1108/14684521011099397
Wilcox LLu JLai JFeiner SJordan DOlsen DHinckley KMorris MHudson SGreenberg S(2009)ActiveNotesCHI '09 Extended Abstracts on Human Factors in Computing Systems10.1145/1520340.1520480(3323-3328)Online publication date: 4-Apr-2009
https://dl.acm.org/doi/10.1145/1520340.1520480
Lin S(2009)Human–Computer Interaction Research in Information RetrievalEncyclopedia of Library and Information Sciences, Third Edition10.1081/E-ELIS3-120044556(2183-2196)Online publication date: 7-Dec-2009
https://doi.org/10.1081/E-ELIS3-120044556
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents