short-paper

Starting Conversations with Search Engines - Interfaces that Elicit Natural Language Queries

Authors:

Andrea Papenmeier,

Daniel Hienert,

Norbert FuhrAuthors Info & Claims

CHIIR '21: Proceedings of the 2021 Conference on Human Information Interaction and Retrieval

Pages 261 - 265

https://doi.org/10.1145/3406522.3446035

Published: 14 March 2021 Publication History

Abstract

Search systems on the Web rely on user input to generate relevant results. Since early information retrieval systems, users are trained to issue keyword searches and adapt to the language of the system. Recent research has shown that users often withhold detailed information about their initial information need, although they are able to express it in natural language. We therefore conduct a user study (N = 139) to investigate how four different design variants of search interfaces can encourage the user to reveal more information. Our results show that a chatbot-inspired search interface can increase the number of mentioned product attributes by 84% and promote natural language formulations by 139% in comparison to a standard search bar interface.

References

[1]

Elena Agapie, Gene Golovchinsky, and Pernilla Qvarfordt. 2013. Leading People to Longer Queries. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Paris, France) (CHI '13). Association for Computing Machinery, New York, NY, USA, 3019--3022. https://doi.org/10.1145/2470654.2481418

Digital Library

[2]

Mohammad Aliannejadi, Hamed Zamani, Fabio Crestani, and W. Bruce Croft. 2019. Asking Clarifying Questions in Open-Domain Information-Seeking Conversations. In Proceedings of the 42nd International ACM SIGIR Conference on Research and Development in Information Retrieval (Paris, France) (SIGIR'19). Association for Computing Machinery, New York, NY, USA, 475--484. https://doi.org/10.1145/3331184.3331265

Digital Library

[3]

Peter Bailey, Ryen W. White, Han Liu, and Giridhar Kumaran. 2010. Mining Historic Query Trails to Label Long and Rare Search Engine Queries. ACM Trans. Web, Vol. 4, 4, Article 15 (Sept. 2010), 27 pages. https://doi.org/10.1145/1841909.1841912

Digital Library

[4]

Evelyn Balfe and Barry Smyth. 2004. Improving Web Search through Collaborative Query Recommendation. In Proceedings of the 16th European Conference on Artificial Intelligence (Valencia, Spain) (ECAI'04). IOS Press, NLD, 268--272.

Digital Library

[5]

Catalin-Mihai Barbu, Guillermo Carbonell, and Jürgen Ziegler. 2019. The Influence of Trust Cues on the Trustworthiness of Online Reviews for Recommendations. In Proceedings of the 34th ACM/SIGAPP Symposium on Applied Computing (Limassol, Cyprus) (SAC '19). Association for Computing Machinery, New York, NY, USA, 1687--1689. https://doi.org/10.1145/3297280.3297603

Digital Library

[6]

N. J. Belkin, C. Cool, D. Kelly, G. Kim, J. y. Kim, H. j. Lee, G. Muresan, M. c. Tang, and X. j. Yuan. 2002. Rutgers interactive track at TREC 2002. In Proceedings of the Eleventh Text Retrieval Conference (TREC 2002. Addison Wesley.

[7]

N. J. Belkin, D. Kelly, G. Kim, J.-Y. Kim, H.-J. Lee, G. Muresan, M.-C. Tang, X.-J. Yuan, and C. Cool. 2003. Query Length in Interactive Information Retrieval. In Proceedings of the 26th Annual International ACM SIGIR Conference on Research and Development in Informaion Retrieval (Toronto, Canada) (SIGIR '03). Association for Computing Machinery, New York, NY, USA, 205--212. https://doi.org/10.1145/860435.860474

Digital Library

[8]

Michael Bendersky and W. Bruce Croft. 2008. Discovering Key Concepts in Verbose Queries. In Proceedings of the 31st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (Singapore, Singapore) (SIGIR '08). Association for Computing Machinery, New York, NY, USA, 491--498. https://doi.org/10.1145/1390334.1390419

[9]

G. W. Furnas, T. K. Landauer, L. M. Gomez, and S. T. Dumais. 1987. The Vocabulary Problem in Human-System Communication. Commun. ACM, Vol. 30, 11 (Nov. 1987), 964--971. https://doi.org/10.1145/32206.32212

Digital Library

[10]

Djoerd Hiemstra, Claudia Hauff, and Leif Azzopardi. 2017. Exploring the Query Halo Effect in Site Search: Leading People to Longer Queries. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval (Shinjuku, Tokyo, Japan) (SIGIR '17). Association for Computing Machinery, New York, NY, USA, 981--984. https://doi.org/10.1145/3077136.3080696

Digital Library

[11]

Yvonne Kammerer and Maja Bohnacker. 2012. Children's Web Search with Google: The Effectiveness of Natural Language Queries. In Proceedings of the 11th International Conference on Interaction Design and Children (Bremen, Germany) (IDC '12). Association for Computing Machinery, New York, NY, USA, 184--187. https://doi.org/10.1145/2307096.2307121

Digital Library

[12]

Diane Kelly and Xin Fu. 2007. Eliciting better information need descriptions from users of information search systems. Information Processing & Management, Vol. 43, 1 (2007), 30--46. https://doi.org/10.1016/j.ipm.2006.03.006

Digital Library

[13]

L. Palopoli, D. Rosaci, and D. Ursino. 2006. Agents' roles in B2C e-commerce. AI Commun., Vol. 19 (2006), 95--126.

Digital Library

[14]

Andrea Papenmeier, Alfred Sliwa, Dagmar Kern, Daniel Hienert, Ahmet Aker, and Norbert Fuhr. 2020. 'A Modern Up-To-Date Laptop' - Vagueness in Natural Language Queries for Product Search. In Proceedings of the 2020 ACM Designing Interactive Systems Conference (Eindhoven, Netherlands) (DIS '20). Association for Computing Machinery, New York, NY, USA, 2077--2089. https://doi.org/10.1145/3357236.3395489

Digital Library

[15]

Filip Radlinski, Krisztian Balog, Bill Byrne, and Karthik Krishnamoorthi. 2019. Coached Conversational Preference Elicitation: A Case Study in Understanding Movie Preferences. In Proceedings of the 20th Annual SIGdial Meeting on Discourse and Dialogue. Association for Computational Linguistics, Stockholm, Sweden, 353--360. https://doi.org/10.18653/v1/W19-5941

Cited By

Schott KPapenmeier AHienert DKern D(2024)What Did I Say Again? Relating User Needs to Search Outcomes in Conversational CommerceProceedings of Mensch und Computer 202410.1145/3670653.3670680(129-139)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1145/3670653.3670680
Wazzan AMacNeil SSouvenir R(2024)Comparing Traditional and LLM-based Search for Image GeolocationProceedings of the 2024 Conference on Human Information Interaction and Retrieval10.1145/3627508.3638305(291-302)Online publication date: 10-Mar-2024
https://dl.acm.org/doi/10.1145/3627508.3638305
Mysore SMccallum AZamani H(2023)Large Language Model Augmented Narrative Driven RecommendationsProceedings of the 17th ACM Conference on Recommender Systems10.1145/3604915.3608829(777-783)Online publication date: 14-Sep-2023
https://dl.acm.org/doi/10.1145/3604915.3608829

Index Terms

Starting Conversations with Search Engines - Interfaces that Elicit Natural Language Queries
1. Human-centered computing
  1. Human computer interaction (HCI)
    1. HCI design and evaluation methods
      1. User studies
    2. Interaction paradigms
      1. Graphical user interfaces
  2. Visualization
    1. Empirical studies in visualization
2. Information systems
  1. Information retrieval
    1. Information retrieval query processing
      1. Query intent

Recommendations

'A Modern Up-To-Date Laptop' - Vagueness in Natural Language Queries for Product Search
DIS '20: Proceedings of the 2020 ACM Designing Interactive Systems Conference

With the rise of voice assistants and an increase in mobile search usage, natural language has become an important query language. So far, most of the current systems are not able to process these queries because of the vagueness and ambiguity in ...
The Market Structure for Internet Search Engines

The Internet search engine market has seen a proliferation of entrants over the past few years. Whereas Yahoo was the early market leader, there has been entry by both lower-quality engines and higher-quality ones (such as Google). Prior work on quality ...
Questions vs. Queries in Informational Search Tasks
WWW '15 Companion: Proceedings of the 24th International Conference on World Wide Web

Search systems traditionally require searchers to formulate information needs as keywords rather than in a more natural form, such as questions. Recent studies have found that Web search engines are observing an increase in the fraction of queries ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHIIR '21: Proceedings of the 2021 Conference on Human Information Interaction and Retrieval

March 2021

384 pages

ISBN:9781450380553

DOI:10.1145/3406522

General Chairs:
Falk Scholer
RMIT University, Australia
,
Paul Thomas
Paul Thomas (Microsoft, Australia
,
Program Chairs:
David Elsweiler
University of Regensburg, Germany
,
Hideo Joho
University of Tsukuba, Japan
,
Noriko Kando
National Institute of Informatics, Japan
,
Catherine Smith
Kent State University, USA

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 March 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Funding Sources

Deutsche Forschungsgemeinschaft

Conference

CHIIR '21

Sponsor:

CHIIR '21: ACM SIGIR Conference on Human Information Interaction and Retrieval

March 14 - 19, 2021

Canberra ACT, Australia

Acceptance Rates

Overall Acceptance Rate 55 of 163 submissions, 34%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

3
Total Citations
View Citations
182
Total Downloads

Downloads (Last 12 months)34
Downloads (Last 6 weeks)1

Reflects downloads up to 21 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Schott KPapenmeier AHienert DKern D(2024)What Did I Say Again? Relating User Needs to Search Outcomes in Conversational CommerceProceedings of Mensch und Computer 202410.1145/3670653.3670680(129-139)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1145/3670653.3670680
Wazzan AMacNeil SSouvenir R(2024)Comparing Traditional and LLM-based Search for Image GeolocationProceedings of the 2024 Conference on Human Information Interaction and Retrieval10.1145/3627508.3638305(291-302)Online publication date: 10-Mar-2024
https://dl.acm.org/doi/10.1145/3627508.3638305
Mysore SMccallum AZamani H(2023)Large Language Model Augmented Narrative Driven RecommendationsProceedings of the 17th ACM Conference on Recommender Systems10.1145/3604915.3608829(777-783)Online publication date: 14-Sep-2023
https://dl.acm.org/doi/10.1145/3604915.3608829

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents