How do Human and Contextual Factors Affect the Way People Formulate Queries?
Pages 499 - 503
Abstract
This research will examine the factors that affect how people formulate their queries. The main objective is to determine whether query variations for the same information need are influenced by the type of tasks, human characteristics, or contextual information. In initial experiments, the UQV100 dataset was used to examine whether specific properties of search tasks influenced how people phrased their queries. The properties considered include the length and the degree of readability of the backstories, as well as a Jaccard similarity between the backstories and query variations. It was found that the properties have an impact on user queries even when users are in the same context. Such properties should be taken into consideration when designing tasks. In the future, we will conduct research involving users to examine their characteristics such as demographics. Additionally, the influence of contextual information on users will be studied.
References
[1]
Lorin W Anderson and David R Krathwohl. 2001. A taxonomy for learning, teaching, and assessing: A revision of Bloom’s taxonomy of educational objectives. Longman,.
[2]
Peter Bailey, Alistair Moffat, Falk Scholer, and Paul Thomas. 2015. User Variability and IR System Evaluation. In Proceedings of the 38th International ACM SIGIR Conference on Research and Development in Information Retrieval, Santiago, Chile, August 9-13, 2015, Ricardo Baeza-Yates, Mounia Lalmas, Alistair Moffat, and Berthier A. Ribeiro-Neto (Eds.). ACM, 625–634. https://doi.org/10.1145/2766462.2767728
[3]
Peter Bailey, Alistair Moffat, Falk Scholer, and Paul Thomas. 2016. UQV100: A Test Collection with Query Variability. In Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval, SIGIR 2016, Pisa, Italy, July 17-21, 2016, Raffaele Perego, Fabrizio Sebastiani, Javed A. Aslam, Ian Ruthven, and Justin Zobel (Eds.). ACM, 725–728. https://doi.org/10.1145/2911451.2914671
[4]
Peter Bailey, Alistair Moffat, Falk Scholer, and Paul Thomas. 2017. Retrieval Consistency in the Presence of Query Variations. In Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval, Shinjuku, Tokyo, Japan, August 7-11, 2017, Noriko Kando, Tetsuya Sakai, Hideo Joho, Hang Li, Arjen P. de Vries, and Ryen W. White (Eds.). ACM, 395–404. https://doi.org/10.1145/3077136.3080839
[5]
Rodger Benham, Joel M. Mackenzie, Alistair Moffat, and J. Shane Culpepper. 2019. Boosting Search Performance Using Query Variations. ACM Trans. Inf. Syst. 37, 4 (2019), 41:1–41:25. https://doi.org/10.1145/3345001
[6]
Pia Borlund. 2003. The IIR evaluation model: a framework for evaluation of interactive information retrieval systems. Inf. Res. 8, 3 (2003). http://www.informationr.net/ir/8-3/paper152.html
[7]
Kathy Brennan, Diane Kelly, and Jaime Arguello. 2014. The effect of cognitive abilities on information search for tasks of varying levels of complexity. In Fifth Information Interaction in Context Symposium, IIiX ’14, Regensburg, Germany, August 26-29, 2014, David Elsweiler, Bernd Ludwig, Leif Azzopardi, and Max L. Wilson (Eds.). ACM, 165–174. https://doi.org/10.1145/2637002.2637022
[8]
Jia Chen, Jiaxin Mao, Yiqun Liu, Fan Zhang, Min Zhang, and Shaoping Ma. 2021. Towards a Better Understanding of Query Reformulation Behavior in Web Search. In WWW ’21: The Web Conference 2021, Virtual Event / Ljubljana, Slovenia, April 19-23, 2021, Jure Leskovec, Marko Grobelnik, Marc Najork, Jie Tang, and Leila Zia (Eds.). ACM / IW3C2, 743–755. https://doi.org/10.1145/3442381.3450127
[9]
Hengyi Fu. 2018. Mixed language queries in online searches: A study of intra-sentential code-switching from a qualitative perspective. Aslib J. Inf. Manag. 71, 1 (2018), 72–89. https://doi.org/10.1108/AJIM-04-2018-0091
[10]
Daniel Hienert and Maria Lusky. 2017. Where Do All These Search Terms Come From? - Two Experiments in Domain-Specific Search. In Advances in Information Retrieval - 39th European Conference on IR Research, ECIR 2017, Aberdeen, UK, April 8-13, 2017, Proceedings(Lecture Notes in Computer Science, Vol. 10193), Joemon M. Jose, Claudia Hauff, Ismail Sengör Altingövde, Dawei Song, Dyaa Albakour, Stuart N. K. Watt, and John Tait (Eds.). 15–26. https://doi.org/10.1007/978-3-319-56608-5_2
[11]
Kyung-Sun Kim, Sei-Ching Joanna Sin, and Tien-I Tsai. 2014. Individual differences in social media use for information seeking. The journal of academic librarianship 40, 2 (2014), 171–178.
[12]
Chenjun Ling, Ben Steichen, and Silvia Figueira. 2020. Multilingual News-An Investigation of Consumption, Querying, and Search Result Selection Behaviors. Int. J. Hum. Comput. Interact. 36, 6 (2020), 516–535. https://doi.org/10.1080/10447318.2019.1662636
[13]
Ryan Lowe and Ben Steichen. 2017. Multilingual Search User Behaviors - Exploring Multilingual Querying and Result Selection Through Crowdsourcing. In Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization, UMAP 2017, Bratislava, Slovakia, July 09 - 12, 2017, Mária Bieliková, Eelco Herder, Federica Cena, and Michel C. Desmarais (Eds.). ACM, 303–307. https://doi.org/10.1145/3079628.3079702
[14]
Joel Mackenzie and Alistair Moffat. 2021. Modality Effects When Simulating User Querying Tasks. In ICTIR ’21: The 2021 ACM SIGIR International Conference on the Theory of Information Retrieval, Virtual Event, Canada, July 11, 2021, Faegheh Hasibi, Yi Fang, and Akiko Aizawa (Eds.). ACM, 197–201. https://doi.org/10.1145/3471158.3472244
[15]
Heather O’Brien, Amelia W. Cole, Andrea Kampen, and Kathy Brennan. 2022. The Effects of Domain and Search Expertise on Learning Outcomes in Digital Library Use. In CHIIR ’22: ACM SIGIR Conference on Human Information Interaction and Retrieval, Regensburg, Germany, March 14 - 18, 2022, David Elsweiler (Ed.). ACM, 202–210. https://doi.org/10.1145/3498366.3505761
[16]
Gustavo Penha, Arthur Câmara, and Claudia Hauff. 2022. Evaluating the Robustness of Retrieval Pipelines with Query Variation Generators. In Advances in Information Retrieval - 44th European Conference on IR Research, ECIR 2022, Stavanger, Norway, April 10-14, 2022, Proceedings, Part I(Lecture Notes in Computer Science, Vol. 13185), Matthias Hagen, Suzan Verberne, Craig Macdonald, Christin Seifert, Krisztian Balog, Kjetil Nørvåg, and Vinay Setty (Eds.). Springer, 397–412. https://doi.org/10.1007/978-3-030-99736-6_27
[17]
Sei-Ching Joanna Sin and Kyung-Sun Kim. 2013. International students’ everyday life information seeking: The informational value of social networking sites. Library & Information Science Research 35, 2 (2013), 107–116.
[18]
Lynda Tamine and Cecile Chouquet. 2017. On the impact of domain expertise on query formulation, relevance assessment and retrieval performance in clinical settings. Inf. Process. Manag. 53, 2 (2017), 332–350. https://doi.org/10.1016/j.ipm.2016.11.004
[19]
Elaine G. Toms, Heather L. O’Brien, Tayze Mackenzie, Chris Jordan, Luanne Freund, Sandra Toze, Emilie Dawe, and Alexandra MacNutt. 2007. Task Effects on Interactive Search: The Query Factor. In Focused Access to XML Documents, 6th International Workshop of the Initiative for the Evaluation of XML Retrieval, INEX 2007, Dagstuhl Castle, Germany, December 17-19, 2007. Selected Papers(Lecture Notes in Computer Science, Vol. 4862), Norbert Fuhr, Jaap Kamps, Mounia Lalmas, and Andrew Trotman (Eds.). Springer, 359–372. https://doi.org/10.1007/978-3-540-85902-4_31
[20]
Zhijing Wu, Mark Sanderson, Berkant Barla Cambazoglu, W. Bruce Croft, and Falk Scholer. 2020. Providing Direct Answers in Search Results: A Study of User Behavior. In CIKM ’20: The 29th ACM International Conference on Information and Knowledge Management, Virtual Event, Ireland, October 19-23, 2020, Mathieu d’Aquin, Stefan Dietze, Claudia Hauff, Edward Curry, and Philippe Cudré-Mauroux (Eds.). ACM, 1635–1644. https://doi.org/10.1145/3340531.3412017
[21]
Zhen Yue, Jiepu Jiang, Shuguang Han, and Daqing He. 2012. Where do the query terms come from?: an analysis of query reformulation in collaborative web search. In 21st ACM International Conference on Information and Knowledge Management, CIKM’12, Maui, HI, USA, October 29 - November 02, 2012, Xue-wen Chen, Guy Lebanon, Haixun Wang, and Mohammed J. Zaki (Eds.). ACM, 2595–2598. https://doi.org/10.1145/2396761.2398700
Index Terms
- How do Human and Contextual Factors Affect the Way People Formulate Queries?
Recommendations
Contextual factors in knowledge reuse
PurposeThis paper aims to answer calls for more research on how contextual factors influence the effectiveness of knowledge reuse.Design/methodology/approachThe findings are based on an in-depth case study conducted in the sales department of a large ...
Role of contextual factors in influencing user evaluation of information system: an analytic hierarchical process approach
Continuous evaluation of information systems (IS) is critical for their improvement. The context in which a system is embedded is a critical determinant for evaluation of its success. The paper explores the role of contextual factors in impacting the user ...
Contextual factors influencing strategic information systems plan implementation
SAICSIT '11: Proceedings of the South African Institute of Computer Scientists and Information Technologists Conference on Knowledge, Innovation and Leadership in a Diverse, Multidisciplinary EnvironmentResearch in the field of strategic information systems planning (SISP) has primarily focused on information systems (IS) strategy formulation. Despite the great effort put into understanding and executing SISP, organisations still grapple with ...
Comments
Information & Contributors
Information
Published In
Copyright © 2023 Owner/Author.
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.
Sponsors
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 02 August 2023
Check for updates
Author Tags
Qualifiers
- Extended-abstract
- Research
- Refereed limited
Conference
CHIIR '23: ACM SIGIR Conference on Human Information Interaction and Retrieval
March 19 - 23, 2023
TX, Austin, USA
Acceptance Rates
Overall Acceptance Rate 55 of 163 submissions, 34%
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 69Total Downloads
- Downloads (Last 12 months)33
- Downloads (Last 6 weeks)4
Reflects downloads up to 05 Mar 2025
Other Metrics
Citations
View Options
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format