research-article

Query Suggestions as Summarization in Exploratory Search

Authors:

Dorota GłowackaAuthors Info & Claims

CHIIR '21: Proceedings of the 2021 Conference on Human Information Interaction and Retrieval

Pages 119 - 128

https://doi.org/10.1145/3406522.3446020

Published: 14 March 2021 Publication History

Abstract

Query suggestions have been shown to benefit users performing information retrieval tasks. In exploratory search, however, users may lack the necessary domain knowledge to assess the relevance of query suggestions with respect to their information needs. In this article, we investigate the use of alternative queries in exploratory search. Alternative queries are queries that would retrieve similar search results to those currently visible on-screen. They are independent of the original search query and can, therefore, be updated dynamically as users scroll through search results. In addition to being follow-on queries, alternative queries serve as keyword summaries of the current search results page to help users assess whether results are inline with their search intents. We investigated the use of alternative queries in scientific literature search and their impact on user behavior and perception. In a user study, participants inspected half as many documents per query when alternative queries were present, but were exposed to over 40% more search results overall. Despite using them extensively as follow-on queries, user feedback focused on the summarization properties offered by alternative queries; finding it reassuring that documents were relevant to their search goals.

References

[1]

Jae-wook Ahn, Peter Brusilovsky, Jonathan Grady, Daqing He, and Radu Florian. 2010. Semantic annotation based exploratory search for information analysts. Information processing & management, Vol. 46, 4 (2010), 383--402.

[2]

Kumaripaba Athukorala, Dorota Głowacka, Giulio Jacucci, Antti Oulasvirta, and Jilles Vreeken. 2016a. Is exploratory search different? A comparison of information search behavior for exploratory and lookup tasks. Journal of the Association for Information Science and Technology, Vol. 67, 11 (2016), 2635--2651.

Digital Library

[3]

Kumaripaba Athukorala, Alan Medlar, Antti Oulasvirta, Giulio Jacucci, and Dorota Glowacka. 2016b. Beyond relevance: adapting exploration/exploitation in information retrieval. In Proceedings of the 21st International Conference on Intelligent User Interfaces. ACM, 359--369.

Digital Library

[4]

Kumaripaba Athukorala, Antti Oulasvirta, Dorota Głowacka, Jilles Vreeken, and Giulio Jacucci. 2014. Narrow or broad?: Estimating subjective specificity in exploratory search. In Proceedings of the 23rd ACM International Conference on Conference on Information and Knowledge Management. ACM, 819--828.

Digital Library

[5]

Santosh Kumar Bharti and Korra Sathya Babu. 2017. Automatic keyword extraction for text summarization: A survey. arXiv preprint arXiv:1704.03242 (2017).

[6]

Sumit Bhatia, Debapriyo Majumdar, and Prasenjit Mitra. 2011. Query suggestions in the absence of query logs. In Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval . 795--804.

Digital Library

[7]

John Brooke et almbox. 1996. SUS-A quick and dirty usability scale. Usability evaluation in industry, Vol. 189, 194 (1996), 4--7.

[8]

Huanhuan Cao, Daxin Jiang, Jian Pei, Qi He, Zhen Liao, Enhong Chen, and Hang Li. 2008. Context-aware query suggestion by mining click-through and session data. In Proceedings of the 14th ACM SIGKDD international conference on Knowledge discovery and data mining. 875--883.

Digital Library

[9]

Claudio Carpineto, Renato De Mori, Giovanni Romano, and Brigitte Bigi. 2001. An information-theoretic approach to automatic query expansion. ACM Transactions on Information Systems (TOIS), Vol. 19, 1 (2001), 1--27.

Digital Library

[10]

Duen Horng Chau, Aniket Kittur, Jason I Hong, and Christos Faloutsos. 2011. Apolo: making sense of large network data by combining rich user interaction and machine learning. In Proceedings of the SIGCHI conference on human factors in computing systems. 167--176.

Digital Library

[11]

Dongho Choi. 2017. A Study of Information Seeking Behavior: Investigating Exploratory Behavior in Physical & Online Spaces .Rutgers The State University of New Jersey-New Brunswick.

[12]

Fernando Diaz, Bhaskar Mitra, and Nick Craswell. 2016. Query Expansion with Locally-Trained Word Embeddings. In Proceedings of the 54th Annual Meeting of the Association for Computational Linguistics . 367--377.

[13]

Marian Dörk, Sheelagh Carpendale, Christopher Collins, and Carey Williamson. 2008. Visgets: Coordinated visualizations for web-based information exploration and discovery. IEEE Transactions on Visualization and Computer Graphics, Vol. 14, 6 (2008), 1205--1212.

Digital Library

[14]

Tamas E Doszkocs. 1978. AID, an associative interactive dictionary for online searching. Online Review, Vol. 2, 2 (1978), 163--173.

[15]

Dorota Glowacka, Tuukka Ruotsalo, Ksenia Konuyshkova, Samuel Kaski, Giulio Jacucci, et almbox. 2013. Directing exploratory search: Reinforcement learning from user interactions with keywords. In Proceedings of the 2013 international conference on Intelligent user interfaces. ACM, 117--128.

Digital Library

[16]

Brynjar Gretarsson, John O?donovan, Svetlin Bostandjiev, Tobias Höllerer, Arthur Asuncion, David Newman, and Padhraic Smyth. 2012. Topicnets: Visual analysis of large text corpora with topic modeling. ACM Transactions on Intelligent Systems and Technology (TIST), Vol. 3, 2 (2012), 1--26.

Digital Library

[17]

Qi He, Daxin Jiang, Zhen Liao, Steven CH Hoi, Kuiyu Chang, Ee-Peng Lim, and Hang Li. 2009. Web query recommendation via sequential query prediction. In 2009 IEEE 25th international conference on data engineering. IEEE, 1443--1454.

Digital Library

[18]

Geoffrey E Hinton and Ruslan R Salakhutdinov. 2006. Reducing the dimensionality of data with neural networks. Science, Vol. 313, 5786 (2006), 504--507.

[19]

Sepp Hochreiter and Jürgen Schmidhuber. 1997. Long short-term memory. Neural computation, Vol. 9, 8 (1997), 1735--1780.

[20]

K Sparck Jones, Steve Walker, and Stephen E. Robertson. 2000. A probabilistic model of information retrieval: development and comparative experiments. Information processing & management, Vol. 36, 6 (2000), 779--840.

[21]

Rosie Jones, Benjamin Rey, Omid Madani, and Wiley Greiner. 2006. Generating query substitutions. In Proceedings of the 15th international conference on World Wide Web. ACM, 387--396.

Digital Library

[22]

Mika K"aki. 2005. Findex: search result categories help users when document ranking fails. In Proceedings of the SIGCHI conference on Human factors in computing systems . 131--140.

[23]

Antti Kangasr"a"asiö, Yi Chen, Dorota Głowacka, and Samuel Kaski. 2016. Interactive Modeling of Concept Drift and Errors in Relevance Feedback. In Proceedings of the 2016 Conference on User Modeling Adaptation and Personalization. ACM, 185--193.

[24]

Diane Kelly, Karl Gyllstrom, and Earl W Bailey. 2009. A comparison of query and term suggestion features for interactive searching. In Proceedings of the 32nd international ACM SIGIR conference on Research and development in information retrieval. 371--378.

Digital Library

[25]

Diederik P Kingma and Jimmy Ba. 2014. Adam: A method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014).

[26]

Jürgen Koenemann and Nicholas J Belkin. 1996. A case for interaction: A study of interactive information retrieval behavior and effectiveness. In Proceedings of the SIGCHI conference on human factors in computing systems. 205--212.

Digital Library

[27]

Saar Kuzi, Anna Shtok, and Oren Kurland. 2016. Query expansion using word embeddings. In Proceedings of the 25th ACM international on conference on information and knowledge management. ACM, 1929--1932.

Digital Library

[28]

Quoc Le and Tomas Mikolov. 2014. Distributed representations of sentences and documents. In International Conference on Machine Learning. 1188--1196.

Digital Library

[29]

Matteo Lissandrini, Davide Mottin, Themis Palpanas, and Yannis Velegrakis. 2020. Graph-Query Suggestions for Knowledge Graph Exploration. In Proceedings of The Web Conference 2020. 2549--2555.

Digital Library

[30]

Shixia Liu, Michelle X Zhou, Shimei Pan, Yangqiu Song, Weihong Qian, Weijia Cai, and Xiaoxiao Lian. 2012. Tiara: Interactive, topic-based visual text summarization and analysis. ACM Transactions on Intelligent Systems and Technology (TIST), Vol. 3, 2 (2012), 1--28.

Digital Library

[31]

Chao Ma and Bin Zhang. 2018. A New Query Recommendation Method Supporting Exploratory Search Based on Search Goal Shift Graphs. IEEE Transactions on Knowledge and Data Engineering, Vol. 30, 11 (2018), 2024--2036.

Digital Library

[32]

G. Marchionini. 2006. Exploratory search: from finding to understanding. Commun. ACM, Vol. 49, 4 (2006), 41--46.

Digital Library

[33]

Justin Matejka, Tovi Grossman, and George Fitzmaurice. 2012. Citeology: visualizing paper genealogy. In CHI'12 Extended Abstracts on Human Factors in Computing Systems. ACM, 181--190.

Digital Library

[34]

Alan Medlar and Dorota Glowacka. 2018. How Consistent is Relevance Feedback in Exploratory Search?. In Proceedings of the 27th ACM International Conference on Information and Knowledge Management. ACM, 1615--1618.

Digital Library

[35]

Alan Medlar, Kalle Ilves, Ping Wang, Wray Buntine, and Dorota Glowacka. 2016. PULP: A system for exploratory search of scientific literature. In Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval. ACM, 1133--1136.

Digital Library

[36]

Alan Medlar, Joel Pyykkö, and Dorota Glowacka. 2017. Towards Fine-Grained Adaptation of Exploration/Exploitation in Information Retrieval. In Proceedings of the 22nd International Conference on Intelligent User Interfaces (Limassol, Cyprus) (IUI '17). Association for Computing Machinery, New York, NY, USA, 623--627. https://doi.org/10.1145/3025171.3025205

Digital Library

[37]

Tomas Mikolov, Ilya Sutskever, Kai Chen, Greg S Corrado, and Jeff Dean. 2013. Distributed representations of words and phrases and their compositionality. In Advances in neural information processing systems. 3111--3119.

[38]

Mandar Mitra, Amit Singhal, and Chris Buckley. 1998. Improving automatic query expansion. In Proceedings of the 21st annual international ACM SIGIR conference on Research and development in information retrieval. ACM, 206--214.

Digital Library

[39]

Saeed Mohajeri, Hamman W Samuel, Osmar R Zalane, and Davood Rafiei. 2016. BubbleNet: An innovative exploratory search and summarization interface with applicability in health social media. In 2016 International Conference on Digital Economy (ICDEc). IEEE, 37--44.

[40]

Atsushi Otsuka, Yohei Seki, Noriko Kando, and Tetsuji Satoh. 2012. QAque: faceted query expansion techniques for exploratory search using community QA resources. In Proceedings of the 21st International Conference on World Wide Web. 799--806.

Digital Library

[41]

Pearl Pu, Li Chen, and Rong Hu. 2011. A user-centric evaluation framework for recommender systems. In Proceedings of the fifth ACM conference on Recommender systems. ACM, 157--164.

Digital Library

[42]

Joseph John Rocchio. 1971. Relevance feedback in information retrieval. The SMART retrieval system: experiments in automatic document processing (1971), 313--323.

[43]

Tuukka Ruotsalo, Giulio Jacucci, and Samuel Kaski. 2020. Interactive faceted query suggestion for exploratory search: Whole-session effectiveness and interaction engagement. Journal of the Association for Information Science and Technology (2020).

[44]

Mark Sanderson and Bruce Croft. 1999. Deriving concept hierarchies from text. In Proceedings of the 22nd annual international ACM SIGIR conference on Research and development in information retrieval . 206--213.

Digital Library

[45]

Hinrich Schütze, Christopher D Manning, and Prabhakar Raghavan. 2008. Introduction to information retrieval . Vol. 39. Cambridge University Press Cambridge.

[46]

Milad Shokouhi. 2013. Learning to personalize query auto-completion. In Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval . 103--112.

Digital Library

[47]

Alessandro Sordoni, Yoshua Bengio, Hossein Vahabi, Christina Lioma, Jakob Grue Simonsen, and Jian-Yun Nie. 2015. A hierarchical recurrent encoder-decoder for generative context-aware query suggestion. In Proceedings of the 24th ACM International on Conference on Information and Knowledge Management . 553--562.

Digital Library

[48]

Ryen W White, Mikhail Bilenko, and Silviu Cucerzan. 2007. Studying the use of popular destinations to enhance web search interaction. In Proceedings of the 30th annual international ACM SIGIR conference on Research and development in information retrieval. 159--166.

Digital Library

[49]

Ryen W White and Resa A Roth. 2009. Exploratory search: Beyond the query-response paradigm. Synthesis lectures on information concepts, retrieval, and services, Vol. 1, 1 (2009), 1--98.

Digital Library

[50]

Hamed Zamani and W Bruce Croft. 2017. Relevance-based word embedding. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval. ACM, 505--514.

Digital Library

[51]

Jian Zhao, Christopher Collins, Fanny Chevalier, and Ravin Balakrishnan. 2013. Interactive exploration of implicit and explicit relations in faceted datasets. IEEE Transactions on Visualization and Computer Graphics, Vol. 19, 12 (2013), 2080--2089.

Digital Library

[52]

Jianling Zhong, Weiwei Guo, Huiji Gao, and Bo Long. 2020. Personalized Query Suggestions. In Proceedings of the 43rd International ACM SIGIR Conference on Research and Development in Information Retrieval . 1645--1648.

Digital Library

Cited By

Medlar AKotkov DGłowacka D(2024)Unexplored Frontiers: A Review of Empirical Studies of Exploratory SearchACM SIGIR Forum10.1145/3687273.368727858:1(1-19)Online publication date: 7-Aug-2024
https://dl.acm.org/doi/10.1145/3687273.3687278
Liu YMedlar AGłowacka D(2024)Sample, Nudge and Rank: Exploiting Interpretable GAN Controls for Exploratory SearchProceedings of the 29th International Conference on Intelligent User Interfaces10.1145/3640543.3645156(582-596)Online publication date: 18-Mar-2024
https://dl.acm.org/doi/10.1145/3640543.3645156
Sebastian RBoratto LGena CMarras MGermanakos PPopescus E(2024)Adaptive Search Support for Teachers in Lesson PlanningAdjunct Proceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization10.1145/3631700.3664921(20-24)Online publication date: 27-Jun-2024
https://dl.acm.org/doi/10.1145/3631700.3664921
Show More Cited By

Index Terms

Query Suggestions as Summarization in Exploratory Search
1. Information systems
  1. Information retrieval

Recommendations

Graph Learning for Exploratory Query Suggestions in an Instant Search System
CIKM '23: Proceedings of the 32nd ACM International Conference on Information and Knowledge Management

Search systems in online content platforms are typically biased toward a minority of highly consumed items, reflecting the most common user behavior of navigating toward content that is already familiar and popular. Query suggestions are a powerful tool ...
Type-ahead exploratory search through typo and word order tolerant autocompletion

There is an increasing interest on recommending to the user instantly (during typing characters) queries and query results. This is evidenced by the emergence of several systems that offer such functionalities, e.g. Google Instant Search for Web ...
Organizing query completions for web search
CIKM '10: Proceedings of the 19th ACM international conference on Information and knowledge management

All state-of-the-art web search engines implement an auto-completion mechanism - an assistive technology enabling users to effectively formulate their search queries by predicting the next characters or words that they are likely to type. Query ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHIIR '21: Proceedings of the 2021 Conference on Human Information Interaction and Retrieval

March 2021

384 pages

ISBN:9781450380553

DOI:10.1145/3406522

General Chairs:
Falk Scholer
RMIT University, Australia
,
Paul Thomas
Paul Thomas (Microsoft, Australia
,
Program Chairs:
David Elsweiler
University of Regensburg, Germany
,
Hideo Joho
University of Tsukuba, Japan
,
Noriko Kando
National Institute of Informatics, Japan
,
Catherine Smith
Kent State University, USA

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 March 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

Business Finland

Conference

CHIIR '21

Sponsor:

CHIIR '21: ACM SIGIR Conference on Human Information Interaction and Retrieval

March 14 - 19, 2021

Canberra ACT, Australia

Acceptance Rates

Overall Acceptance Rate 55 of 163 submissions, 34%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

13
Total Citations
View Citations
490
Total Downloads

Downloads (Last 12 months)65
Downloads (Last 6 weeks)4

Reflects downloads up to 09 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Medlar AKotkov DGłowacka D(2024)Unexplored Frontiers: A Review of Empirical Studies of Exploratory SearchACM SIGIR Forum10.1145/3687273.368727858:1(1-19)Online publication date: 7-Aug-2024
https://dl.acm.org/doi/10.1145/3687273.3687278
Liu YMedlar AGłowacka D(2024)Sample, Nudge and Rank: Exploiting Interpretable GAN Controls for Exploratory SearchProceedings of the 29th International Conference on Intelligent User Interfaces10.1145/3640543.3645156(582-596)Online publication date: 18-Mar-2024
https://dl.acm.org/doi/10.1145/3640543.3645156
Sebastian RBoratto LGena CMarras MGermanakos PPopescus E(2024)Adaptive Search Support for Teachers in Lesson PlanningAdjunct Proceedings of the 32nd ACM Conference on User Modeling, Adaptation and Personalization10.1145/3631700.3664921(20-24)Online publication date: 27-Jun-2024
https://dl.acm.org/doi/10.1145/3631700.3664921
Hoeber OBezanjani AGomes SErfani BNoorally ZShah Y(2024)Visual Keyword/Result Linking: Using Interaction to Dynamically Reveal RelationshipsProceedings of the 2024 Conference on Human Information Interaction and Retrieval10.1145/3627508.3638307(66-76)Online publication date: 10-Mar-2024
https://dl.acm.org/doi/10.1145/3627508.3638307
Huchard MMartin PMuller EPoncelet PRaveneau VSallaberry A(2024)RCAvizInternational Journal of Approximate Reasoning10.1016/j.ijar.2024.109123166:COnline publication date: 1-Mar-2024
https://dl.acm.org/doi/10.1016/j.ijar.2024.109123
Huang ZYuan L(2024)Enhancing learning and exploratory search with concept semantics in online healthcare knowledge management systems: An interactive knowledge visualization approachExpert Systems with Applications10.1016/j.eswa.2023.121558237(121558)Online publication date: Mar-2024
https://doi.org/10.1016/j.eswa.2023.121558
Mysore SJasim MSong HAkbar SRandall AMahyar N(2023)How Data Scientists Review the Scholarly LiteratureProceedings of the 2023 Conference on Human Information Interaction and Retrieval10.1145/3576840.3578309(137-152)Online publication date: 19-Mar-2023
https://dl.acm.org/doi/10.1145/3576840.3578309
Payandeh MBoon MStorie DRamshaw VHoeber O(2023)Drag-and-Drop Query Refinement and Query History Visualization for Mobile Exploratory SearchProceedings of the 2023 Conference on Human Information Interaction and Retrieval10.1145/3576840.3578282(432-437)Online publication date: 19-Mar-2023
https://dl.acm.org/doi/10.1145/3576840.3578282
Li PZhang YZhang B(2022)Understanding Query Combination Behavior in Exploratory SearchesApplied Sciences10.3390/app1202070612:2(706)Online publication date: 11-Jan-2022
https://doi.org/10.3390/app12020706
Sato S(2022)Organizing Search Results into a Table to Assist in Understanding and Expanding Search Target2022 IEEE/WIC/ACM International Joint Conference on Web Intelligence and Intelligent Agent Technology (WI-IAT)10.1109/WI-IAT55865.2022.00048(282-287)Online publication date: Nov-2022
https://doi.org/10.1109/WI-IAT55865.2022.00048
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents