Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3624918.3625326acmconferencesArticle/Chapter ViewAbstractPublication Pagessigir-apConference Proceedingsconference-collections
research-article

Examination of Information Problem Decomposition Strategies: A New Perspective for Understanding Users' Information Problems in Search as Learning

Published: 26 November 2023 Publication History

Abstract

When searching for information in search as learning (SAL), users with anomalous state of knowledge often encounter the difficulty in clearly clarifying their information needs. However, it might be easier for them to express their information problems rather than information needs. In this study, we proposed the concept of “information problem decomposition strategies (IPDS)” to help searchers explicitly express their information problems (IPs) as well as to facilitate their information problem solving (IPS) process. To unfold users’ dynamic cognitive process within information problem decomposition process during search, we conducted an experiment, and collected searchers’ sub-information problems through pre-search and post-search questionnaires, experiment recordings, and post-experiment interview. Furthermore, we also proposed a new measurement of learning performance, information problem solving degree, to evaluate how each sub-information problem has been solved during search in order to assess the search performance from the process perspective.
Through experiment, we have successfully collected searchers’ decomposed sub-information problems and found that the number of their queries was significantly positively correlated with the number of decomposed sub-information problems. Thus, it is possible to reveal the dynamic cognitive process within users’ information search by using sub-information problems. We also summarized 4 typical sub-information problems decomposed categories, namely “What type”, “How type”, “Why type” and “When type”, and identified specific decomposed pathways within each category. It is found that current search systems are not good at supporting sub-information problems on higher levels of cognitive complexity in SAL. However, some of the identified five information problem decomposition strategies (IPDSs) within the decomposed sub-information problems clusters could help increase IPS degree and shed lights on the recommendation terms or directly returned answers of search systems.

References

[1]
Esther Argelagós, Consuelo Garcia, Jesús Privado, and Iwan Wopereis.2022. Fostering Information Problem Solving Skills through Online Task-centred Instruction in Higher Education. Computers & Education 180, (2022), 104433.
[2]
Marcia J. Bates. 1989.The design of browsing and berry picking techniques for the online search interface. Online review 13, 5 (1989), 407-424.
[3]
Nicholas J. Belkin.1980. Anomalous states of knowledge as a basis for information retrieval. Canadian journal of information science 5, 1 (1989), 133-143.
[4]
Nicholas J. Belkin, Robert N. Oddy, and Helen M. Brooks. 1982.ASK For Information Retrieval: Part I. Background and Theory. Journal of Documentation 38, 2 (1982), 61-71.
[5]
Saskia Brand-Gruwel, Iwan Wopereis, and Yvonne Vermetten. 2005.Information problem solving by experts and novices: Analysis of a complex cognitive skill. Computers in Human Behavior 21, 3 (2005), 487-508.
[6]
Arthur Câmara, Nirmal Roy, David Maxwell, and Claudia Hauff. 2021. Searching to Learn with Instructional Scaffolding. In Proceedings of the 2021 Conference on Human Information Interaction and Retrieval (CHIIR '21). Association for Computing Machinery, New York, NY, USA, 209–218. https://doi.org/10.1145/3406522.3446012.
[7]
Catherine Chavula, Yujin Choi, and Soo Young Rieh. 2022. Understanding Creative Thinking Processes in Searching for New Ideas. In ACM SIGIR Conference on Human Information Interaction and Retrieval (CHIIR '22). Association for Computing Machinery, New York, NY, USA, 321–326. https://doi.org/10.1145/3498366.3505783.
[8]
Michael J. Cole, Jacek Gwizdka, Chang Liu, Nicholas J. Belkin, and Xiangmin Zhang. 2013. Inferring user knowledge level from eye movement patterns. Information Processing & Management 49, 5 (2013), 1075-1091.
[9]
Jack Conklin. 2005. Book Reviews: A Taxonomy for Learning, Teaching, and Assessing: A Revision of Bloom's Taxonomy of Educational Objectives, Complete Edition. Educational Horizons 833 (2005), 154-159.
[10]
Michael B. Eisenberg and Robert E. Berkowitz.1992. Information Problem-Solving: The Big Six Skills Approach. School Library Media Activities Monthly 8, 5 (1992): 27-29,37,42.
[11]
Souvick Ghosh, Manasa Rath, and Chirag Shah. 2018. Searching as Learning: Exploring Search Behavior and Learning Outcomes in Learning-related Tasks. In Proceedings of the 2018 Conference on Human Information Interaction & Retrieval (CHIIR '18). Association for Computing Machinery, New York, NY, USA, 22–31.
[12]
Yvonne Kammerer, Rowan Nairn, Peter Pirolli, and Ed H. Chi. 2009. Signpost from the masses: learning effects in an exploratory social tag search browser. In Proceedings of the SIGCHI conference on human factors in computing systems. Association for Computing Machinery, New York, NY, USA,625-634.
[13]
David R. Krathwohl. 2002. A revision of Bloom's taxonomy: An overview. Theory into Practice 41, 4 (2002), 212-218.
[14]
Kumar Laxman.2010. A Conceptual Framework Mapping the Application of Information Search Strategies to Well and ill-structured Problem Solving. Computers & Education 55, 2 (2010), 513-526.
[15]
Yuelin Li, and Nicholas J. Belkin. 2008. A faceted approach to conceptualizing tasks in information seeking. Information Processing & Management 44,6 (2008), 1822-1837.
[16]
Shin-jeng Lin, and Nick Belkin. 2005. Validation of a model of information seeking over multiple search sessions. Journal of the American Society for Information Science and Technology 56, 4 (2005): 393-415.
[17]
Chang Liu and Xiaoxuan Song. 2018. How do Information Source Selection Strategies Influence Users' Learning Outcomes'. In Proceedings of the 2018 Conference on Human Information Interaction & Retrieval (CHIIR '18). Association for Computing Machinery, New York, NY, USA, 257–260. https://doi.org/10.1145/3176349.3176876.
[18]
Hanrui Liu, Chang Liu, and Nicholas J. Belkin. 2019. Investigation of users' knowledge change process in learning‐related search tasks. In 82nd Annual Meeting of the Association for Information Science &Technology, Melbourne, Australia, 166-175.
[19]
Jingjing Liu, Nicholas J. Belkin, Xiangmin Zhang, and Xiangmin Zhang. 2013. Examining users’ knowledge change in the task completion process. Information Processing & Management 49, 5 (2013), 1058-1074.
[20]
Jiqun Liu and Yong Ju Jung. 2021. Interest Development, Knowledge Learning, and Interactive IR: Toward a State-based Approach to Search as Learning. In Proceedings of the 2021 Conference on Human Information Interaction and Retrieval (CHIIR '21). Association for Computing Machinery, New York, NY, USA, 239–248. https://doi.org/10.1145/3406522.3446015.
[21]
Stephen MacNeil, Zijian Ding, Kexin Quan, Ziheng Huang, Kenneth Chen, and Steven P. Dow. 2021. ProbMap: Automatically constructing design galleries through feature extraction and semantic clustering. In The Adjunct Publication of the 34th Annual ACM Symposium on User Interface Software and Technology (UIST '21). Association for Computing Machinery, New York, NY, USA, 134–136. https://doi.org/10.1145/3474349.3480203.
[22]
Gary Marchionini. 1995. Information seeking in electronic environments. Cambridge: Cambridge University Press.
[23]
Heather O'Brien, Amelia Cole, Andrea Kampen, and Kathy Brennan. 2022. The Effects of Domain and Search Expertise on Learning Outcomes in Digital Library Use. In ACM SIGIR Conference on Human Information Interaction and Retrieval (CHIIR '22). Association for Computing Machinery, New York, NY, USA, 202–210.
[24]
Heather L. O'Brien, Jaime Arguello, and Rob Capra. 2020. An empirical study of interest, task complexity, and search behaviour on user engagement. Information Processing & Management 57, 3 (2020), 102226.
[25]
Christian Otto, Ran Yu, Georg Pardi, Johannes von Hoyer, Markus Rokicki, Anett Hoppe, Peter Holtz, Yvonne Kammerer, Stefan Dietze and Ralph Ewerth. 2021. Predicting knowledge gain during web search based on multimedia resource consumption. In 22nd International Conference on Artificial Intelligence in Education (AIED 2021), June 11, 2021, Utrecht, The Netherlands, Springer, Cham, 318-330. https://doi.org/10.1007/978-3-030-78292-4_26.
[26]
Srishti Palani, Zijian Ding, Stephen MacNeil, and Steven P. Dow. 2021. The "Active Search" Hypothesis: How Search Strategies Relate to Creative Learning. In Proceedings of the 2021 Conference on Human Information Interaction and Retrieval (CHIIR '21). Association for Computing Machinery, New York, NY, USA, 325–329. https://doi.org/10.1145/3406522.3446046.
[27]
Soo Young Rieh, Kevyn Collins-Thompson, Preben Hansen, and Hye-Jung Lee. 2016. Towards searching as a learning process: A review of current perspectives and future directions. Journal of Information Science 42 (1 2016), 19-34.
[28]
David Robins. 2000.Shifts of focus on various aspects of user information problems during interactive information retrieval. Journal of the American Society for Information Science 51,10 (2000), 913-928.
[29]
Nirmal Roy, Felipe Moraes, and Claudia Hauff. 2020. Exploring Users' Learning Gains within Search Sessions. In Proceedings of the 2020 Conference on Human Information Interaction and Retrieval (CHIIR '20). Association for Computing Machinery, New York, NY, USA, 432–436. https://doi.org/10.1145/3343413.3378012.
[30]
Shawon Sarkar, Matthew Mitsui, Jiqun Liu, and Chirag Shah. 2020. Implicit information need as explicit problems, help, and behavioral signals. Information Processing & Management 57, 2 (2020), 102069 . https://doi.org/10.1016/j.ipm.2019.102069.
[31]
Robert S. Taylor. 1962.The Process of Asking Questions. Journal of the Association for Information Science & Technology 13, 4 (1962),391-396.
[32]
Johanne R. Trippas, Damiano Spina, Falk Scholer, Ahmed Hassan Awadallah, Peter Bailey, Paul N. Bennett, Ryen W. White, Jonathan Liono, Yongli Ren, Flora D. Salim, and Mark Sanderson. 2019. Learning About Work Tasks to Inform Intelligent Assistant Design. In Proceedings of the 2019 Conference on Human Information Interaction and Retrieval (CHIIR '19). Association for Computing Machinery, New York, NY, USA, 5–14. https://doi.org/10.1145/3295750.3298934.
[33]
Asad Ullah, and Haiming Liu.2016. Theory-Based User Modelling for Personalized interactive Information Retrieval. In Proceedings of the HAPPIE Workshop of the Conference on User Modelling Adaptation and Personalization (UMAP). ACM, New York, NY, USA. Halifax, NS, Canada, paper 3. http://hdl.handle.net/10547/622040.
[34]
Kelsey Urgo and Jaime Arguello. 2022. Understanding the “Pathway” Towards a Searcher's Learning Objective. ACM Transactions on Information Systems 40, (4 2022) Article: 77, 1–43.
[35]
Alexander Whitelock-Wainwright, Nathan Laan, Dunwei Wen, and Dragan Gašević.2020. Exploring student information problem solving behaviour using fine-grained concept map and search tool data. Computers & Education 145 (2020),103731.

Index Terms

  1. Examination of Information Problem Decomposition Strategies: A New Perspective for Understanding Users' Information Problems in Search as Learning

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SIGIR-AP '23: Proceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region
    November 2023
    324 pages
    ISBN:9798400704086
    DOI:10.1145/3624918
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 26 November 2023

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Dynamic search process
    2. Information problem decomposition strategy
    3. Information problem solving
    4. Search as learning

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Funding Sources

    • National Social Science Foundation of China (NSSFC)

    Conference

    SIGIR-AP '23
    Sponsor:

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • 0
      Total Citations
    • 137
      Total Downloads
    • Downloads (Last 12 months)86
    • Downloads (Last 6 weeks)1
    Reflects downloads up to 07 Mar 2025

    Other Metrics

    Citations

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format.

    HTML Format

    Figures

    Tables

    Media

    Share

    Share

    Share this Publication link

    Share on social media