research-article

Query-feature graphs: bridging user vocabulary and system functionality

Authors:

Richard Mann, and

Michael TerryAuthors Info & Claims

UIST '11: Proceedings of the 24th annual ACM symposium on User interface software and technology

October 2011

Pages 207 - 216

https://doi.org/10.1145/2047196.2047224

Published: 16 October 2011 Publication History

Abstract

This paper introduces query-feature graphs, or QF-graphs. QF-graphs encode associations between high-level descriptions of user goals (articulated as natural language search queries) and the specific features of an interactive system relevant to achieving those goals. For example, a QF-graph for the GIMP graphics manipulation software links the query "GIMP black and white" to the commands "desaturate" and "grayscale." We demonstrate how QF-graphs can be constructed using search query logs, search engine results, web page content, and localization data from interactive systems. An analysis of QF-graphs shows that the associations produced by our approach exhibit levels of accuracy that make them eminently usable in a range of real-world applications. Finally, we present three hypothetical user interface mechanisms that illustrate the potential of QF-graphs: search-driven interaction, dynamic tooltips, and app-to-app analogy search.

References

[1]

Ricardo Baeza-Yates and Alessandro Tiberi. Extracting semantic relations from query logs. In Proceedings of the 13th ACM SIGKDD international conference on Knowledge discovery and data mining, KDD '07, pages 76--85, New York, NY, USA, 2007. ACM.

Digital Library

[2]

Doug Beeferman and Adam Berger. Agglomerative clustering of a search engine query log. In Proceedings of the sixth ACM SIGKDD international conference on Knowledge discovery and data mining, KDD '00, pages 407--416, New York, NY, USA, 2000. ACM.

Digital Library

[3]

Michael S. Bernstein, Bongwon Suh, Lichan Hong, Jilin Chen, Sanjay Kairam, and Ed H. Chi. Eddi: interactive topic-based browsing of social status streams. In Proceedings of the 23nd annual ACM symposium on User interface software and technology, UIST '10, pages 303--312, New York, NY, USA, 2010. ACM.

Digital Library

[4]

Blacktree Software. Quicksilver: OS X at your fingertips. http://qsapp.com/, Retrieved April, 2011.

[5]

Joel Brandt, Mira Dontcheva, Marcos Weskamp, and Scott R. Klemmer. Example-centric programming: integrating web search into the development environment. In Proceedings of the 28th international conference on Human factors in computing systems, CHI '10, pages 513--522, New York, NY, USA, 2010. ACM.

Digital Library

[6]

Charles L. A. Clarke, Gordon V. Cormack, and Thomas R. Lynam. Exploiting redundancy in question answering. In Proceedings of the 24th annual international ACM SIGIR conference on Research and development in information retrieval, SIGIR '01, pages 358--365, New York, NY, USA, 2001. ACM.

Digital Library

[7]

Charles L. A. Clarke, Gordon V. Cormack, and Elizabeth A. Tudhope. Relevance ranking for one to three term queries. Information Processing and Management, 36(2):291--311, 2000.

Digital Library

[8]

Adam Fourney, Richard Mann, and Michael Terry. Characterizing the usability of interactive applications through query log analysis. In Proceedings of the 2011 annual conference on Human factors in computing systems, CHI '11, pages 1817--1826, New York, NY, USA, 2011. ACM.

Digital Library

[9]

Google Corperation. Google custom search APIs and tools. http://code.google.com/apis/customsearch/, Retrieved April, 2011.

[10]

Jeff Hendy, Kellogg S. Booth, and Joanna McGrenere. Graphically enhanced keyboard accelerators for GUIs. In Proceedings of Graphics Interface 2010, GI '10, pages 3--10, Toronto, Ont., Canada, 2010. Canadian Information Processing Society.

Digital Library

[11]

Humanized Inc. Enso. http://www.humanized.com/enso/, Retrieved April, 2011.

[12]

Melanie Kellar, Carolyn Watters, and Michael Shepherd. A field study characterizing web-based information-seeking tasks. J. Am. Soc. Inf. Sci. Technol., 58(7):999--1018, 2007.

Digital Library

[13]

Justin Matejka, Wei Li, Tovi Grossman, and George Fitzmaurice. Communitycommands: command recommendations for software applications. In Proceedings of the 22nd annual ACM symposium on User interface software and technology, UIST '09, pages 193--202, New York, NY, USA, 2009. ACM.

Digital Library

[14]

Robert C. Miller, Victoria H. Chou, Michael Bernstein, Greg Little, Max Van Kleek, David Karger, and mc schraefel. Inky: a sloppy command line for the web with rich visual feedback. In Proceedings of the 21st annual ACM symposium on User interface software and technology, UIST '08, pages 131--140, New York, NY, USA, 2008. ACM.

Digital Library

[15]

Mozilla Labs. Ubiquity: An experimental interface based on natural language input. https://mozillalabs.com/ubiquity/, Retrieved April, 2011.

[16]

Don Norman. The next UI breakthrough: command lines. interactions, 14:44--45, May 2007.

Digital Library

[17]

Donald A. Norman. Cognitive Engineering, chapter 3. User Centered System Design: New Perspectives on Human-computer Interaction. Lawrence Erlbaum Associates, 1986.

Digital Library

[18]

G. Salton, A. Wong, and C. S. Yang. A vector space model for automatic indexing. Commun. ACM, 18:613--620, November 1975.

Digital Library

[19]

Dou Shen, Rong Pan, Jian-Tao Sun, Jeffrey Junfeng Pan, Kangheng Wu, Jie Yin, and Qiang Yang. Q2C@UST: our winning solution to query classification in KDDCUP 2005. SIGKDD Explor. Newsl., 7:100--110, December 2005.

Digital Library

[20]

Stefanie Tellex, Boris Katz, Jimmy Lin, Aaron Fernandes, and Gregory Marton. Quantitative evaluation of passage retrieval algorithms for question answering. In Proceedings of the 26th annual international ACM SIGIR conference on Research and development in informaion retrieval, SIGIR '03, pages 41--47, New York, NY, USA, 2003. ACM.

Digital Library

[21]

Michael Terry, Matthew Kay, Brad Van Vugt, Brandon Slack, and Terry Park. ingimp: introducing instrumentation to an end-user open source application. In Proceeding of the twenty-sixth annual SIGCHI conference on Human factors in computing systems, CHI '08, pages 607--616, New York, NY, USA, 2008. ACM.

Digital Library

[22]

Andrew Turpin and Falk Scholer. User performance versus precision measures for simple search tasks. In Proceedings of the 29th annual international ACM SIGIR conference on Research and development in information retrieval, SIGIR '06, pages 11--18, New York, NY, USA, 2006. ACM.

Digital Library

Cited By

Masson DMalacria SCasiez GVogel D(2024)DirectGPT: A Direct Manipulation Interface to Interact with Large Language ModelsProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642462(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642462
Park JO'Brien JCai CMorris MLiang PBernstein M(2023)Generative Agents: Interactive Simulacra of Human BehaviorProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606763(1-22)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606763
Kim TChoi DChoi YKim J(2022)Stylette: Styling the Web with Natural LanguageProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501931(1-17)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501931
Show More Cited By

Index Terms

Query-feature graphs: bridging user vocabulary and system functionality
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction paradigms
      1. Graphical user interfaces

Recommendations

Re-ranking search results using query logs
CIKM '06: Proceedings of the 15th ACM international conference on Information and knowledge management

This work addresses two common problems in search, frequently occurring with underspecified user queries: the top-ranked results for such queries may not contain documents relevant to the user's search intent, and fresh and relevant pages may not get ...
Read More
Enhanced web search engines with query-concept bipartite graphs
Read More
Mining query subtopics from search log data
SIGIR '12: Proceedings of the 35th international ACM SIGIR conference on Research and development in information retrieval

Most queries in web search are ambiguous and multifaceted. Identifying the major senses and facets of queries from search log data, referred to as query subtopic mining in this paper, is a very important issue in web search. Through search log analysis, ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

UIST '11: Proceedings of the 24th annual ACM symposium on User interface software and technology

October 2011

654 pages

ISBN:9781450307161

DOI:10.1145/2047196

General Chair:
Jeff Pierce
IBM Research, USA
,
Program Chairs:
Maneesh Agrawala
University of California, Berkeley, USA
,
Scott Klemmer
Stanford University, USA

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 October 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

UIST '11

Sponsor:

UIST '11: The 24th Annual ACM Symposium on User Interface Software and Technology

October 16 - 19, 2011

California, Santa Barbara, USA

Acceptance Rates

UIST '11 Paper Acceptance Rate 67 of 262 submissions, 26%;

Overall Acceptance Rate 842 of 3,967 submissions, 21%

Upcoming Conference

UIST '24

Sponsor:
sigchi
sigchi

The 37th Annual ACM Symposium on User Interface Software and Technology

October 13 - 16, 2024

Pittsburgh , PA , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

31
Total Citations
View Citations
591
Total Downloads

Downloads (Last 12 months)13
Downloads (Last 6 weeks)1

Other Metrics

View Author Metrics

Citations

Cited By

Masson DMalacria SCasiez GVogel D(2024)DirectGPT: A Direct Manipulation Interface to Interact with Large Language ModelsProceedings of the CHI Conference on Human Factors in Computing Systems10.1145/3613904.3642462(1-16)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613904.3642462
Park JO'Brien JCai CMorris MLiang PBernstein M(2023)Generative Agents: Interactive Simulacra of Human BehaviorProceedings of the 36th Annual ACM Symposium on User Interface Software and Technology10.1145/3586183.3606763(1-22)Online publication date: 29-Oct-2023
https://dl.acm.org/doi/10.1145/3586183.3606763
Kim TChoi DChoi YKim J(2022)Stylette: Styling the Web with Natural LanguageProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501931(1-17)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501931
Arsan DZaidi ASagar AKumar R(2021)App-Based Task Shortcuts for Virtual AssistantsThe 34th Annual ACM Symposium on User Interface Software and Technology10.1145/3472749.3474808(1089-1099)Online publication date: 10-Oct-2021
https://dl.acm.org/doi/10.1145/3472749.3474808
Lee CHan DJin HOh A(2019)automaTAProceedings of the Sixth (2019) ACM Conference on Learning @ Scale10.1145/3330430.3333658(1-4)Online publication date: 24-Jun-2019
https://dl.acm.org/doi/10.1145/3330430.3333658
Chen FXia KDhabalia KHong JBrewster SFitzpatrick GCox AKostakos V(2019)MessageOnTapProceedings of the 2019 CHI Conference on Human Factors in Computing Systems10.1145/3290605.3300805(1-14)Online publication date: 2-May-2019
https://dl.acm.org/doi/10.1145/3290605.3300805
Fast EChen BMendelsohn JBassen JBernstein MMandryk RHancock MPerry MCox A(2018)IrisProceedings of the 2018 CHI Conference on Human Factors in Computing Systems10.1145/3173574.3174047(1-12)Online publication date: 21-Apr-2018
https://dl.acm.org/doi/10.1145/3173574.3174047
Zamanirad SBenatallah BChai Barukh MCasati FRodriguez CRosu GDi Penta MNguyen T(2017)Programming bots by synthesizing natural language expressions into API invocationsProceedings of the 32nd IEEE/ACM International Conference on Automated Software Engineering10.5555/3155562.3155665(832-837)Online publication date: 30-Oct-2017
https://dl.acm.org/doi/10.5555/3155562.3155665
Zamanirad SBenatallah BBarukh MCasati FRodriguez C(2017)Programming bots by synthesizing natural language expressions into API invocations2017 32nd IEEE/ACM International Conference on Automated Software Engineering (ASE)10.1109/ASE.2017.8115694(832-837)Online publication date: Oct-2017
https://doi.org/10.1109/ASE.2017.8115694
Ding YJordan JVanderheiden G(2017)Harvesting Assistive Technology Vocabularies: Methods and Results from a Pilot StudyHuman Aspects of IT for the Aged Population. Applications, Services and Contexts10.1007/978-3-319-58536-9_28(350-361)Online publication date: 14-May-2017
https://doi.org/10.1007/978-3-319-58536-9_28
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents