research-article

The Effects of Domain and Search Expertise on Learning Outcomes in Digital Library Use

Authors:

Heather O'Brien,

Kathy BrennanAuthors Info & Claims

CHIIR '22: Proceedings of the 2022 Conference on Human Information Interaction and Retrieval

Pages 202 - 210

https://doi.org/10.1145/3498366.3505761

Published: 14 March 2022 Publication History

First page of PDF

References

[1]

Lorin W., Anderson, (Ed.), David R. Krathwohl, (Ed.), Peter W., Airasian, Kathleen A. Cruikshank, Richard E. Mayer, Paul R. Pintrich, James Raths, and Merlin C. Wittrock. 2001. A taxonomy for learning, teaching, and assessing: A revision of Bloom's Taxonomy of Educational Objectives. Longman, New York.

[2]

Association of College and Research Libraries (ACRL). 2015. Framework for Information Literacy for Higher Education. American Library Association. http://www.ala.org/acrl/standards/ilframework (Accessed October 1, 2021) Document ID: b910a6c4-6c8a-0d44-7dbc-a5dcbd509e3f

[3]

Earl Bailey. 2017. Measuring Online Search Expertise. Unpublished Dissertation. The University of North Carolina, Chapel Hill.

[4]

Suresh K. Bhavnani. 2001. Important cognitive components of domain-specific search knowledge. In Proceedings of the 10th Text Retrieval Conference (TREC’01), 571–578.

[5]

Christine L. Borgman. 1999. What are digital libraries? Competing visions. Information Processing and Management, 17.

[6]

Pia Borlund. 2016. Framing of different types of information needs within simulated work task situations: An empirical study in the school context. Journal of Information Science 42, 3 (June 2016), 313–323. https://doi.org/10.1177/0165551515625028

Digital Library

[7]

Pia Borlund and Peter Ingwersen. 1997. The development of a method for the evaluation of interactive information retrieval systems. Journal of Documentation, 53, 3, 225-250.

[8]

Saskia Brand-Gruwel, Yvonne Kammerer, Ludo van Meeuwen and Tamara van Gog. 2017. Source evaluation of domain experts and novices during Web search: Evaluation of sources. Journal of Computer Assisted Learning, 33, 3, 234–251. https://doi.org/10.1111/jcal.12162

[9]

Joel Brandt, Philip J. Guo, Joel Lewenstein, Mira Dontcheva, M and Scott R. Klemmer. 2009. Two studies of opportunistic programming: Interleaving web foraging, learning, and writing code. CHI2009. Computer-Human Interaction (CHI), Boston, MA, USA.

[10]

Jerome S. Bruner. 1976. The process of education. Harvard University Press, Cambridge.

[11]

Arthur Câmara, Nirmal Roy, David Maxwell and Claudia Hauff. 2021. Searching to learn with instructional scaffolding. In Proceedings of the 2021 Conference on Human Information Interaction and Retrieval (March, 2021), 209-218.

Digital Library

[12]

Kevyn Collins-Thompson, Soo Young Rieh, Carl C. Haynes and Rohail Syed. 2016. Assessing learning outcomes in web search: A comparison of tasks and query strategies. ACM on Conference on Human Information Interaction and Retrieval, (March 2016), 163–172. https://doi.org/10.1145/2854946.2854972

Digital Library

[13]

Jan De Houwer, Dermot Barnes-Holmes and Agnes Moors. 2013. What is learning? On the nature and merits of a functional definition of learning. Psychonomic Bulletin & Review, 20, 4, 631–642. https://doi.org/10.3758/s13423-013-0386-3

[14]

Maureen Dostert. 2011. Does domain knowledge influence search stopping behavior? In Proceedings of the American Society for Information Science and Technology, 48, 1, 1–2. https://doi.org/10.1002/meet.2011.14504801219

[15]

Geoffrey Duggan and Stephen J. Payne. 2008. Knowledge in the head and on the web: Using topic expertise to aid search. CHI '08: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (April 2008), 39-48. https://doi.org/10.1145/1357054.1357062

Digital Library

[16]

Carsten Eickhoff, Jaime Teevan, Ryen White and Susan Dumais. 2014. Lessons from the journey: A query log analysis of within-session learning. In Proceedings of the seventh ACM international conference on web search and data mining (WSDM), (February 2014), 223–232.

Digital Library

[17]

Erin Fields and Peter Musser. 2018. Digital Libraries & K-12 Uses of Primary Sources: A UBC Library Study. http://dx.doi.org/10.14288/1.0366910

[18]

Luanne Freund. 2015. Contextualizing the information‐seeking behavior of software engineers. Journal of the Association for Information Science and Technology, 66, 8, 1594-1605.

Digital Library

[19]

Luanne Freund, Rick Kopak and Heather O'Brien. 2016. The effects of textual environment on reading comprehension: Implications for searching as learning. Journal of Information Science 42, 1 (February 2016), 79–93.

Digital Library

[20]

Ujwal Gadiraju, Ran Yu, Stefan Dietze and Peter Holtz. 2018. Analyzing knowledge gain of users in informational search sessions on the web. In Proceedings of the 2018 Conference on Human Information Interaction&Retrieval - CHIIR ’18, (March 2018), 2–11. https://doi.org/10.1145/3176349.3176381

Digital Library

[21]

Souvick Ghosh, Manasa Rath, and Chirag Shah. 2018. Searching as Learning: Exploring Search Behavior and Learning Outcomes in Learning-related Tasks. In Proceedings of the 2018 Conference on Human Information Interaction & Retrieval (CHIIR '18). Association for Computing Machinery, New York, 22–31.

Digital Library

[22]

Robert M. Gagné. 1968. Learning hierarchies. In Educational Psychologist. American Psychological Association, 1-9.

[23]

Robert M. Gagné. 1973. Learning and instructional sequence. Review of Research in Education 1, (January 1973), 3–33. https://doi.org/10.2307/1167193

[24]

Ingrid Hsieh-Yee. 1993. Effects of search experience and subject knowledge on the search tactics of novice and experienced searchers. Journal of the American Society for Information Science 44, 3, 161-174.

[25]

Boryun Ju. 2007. Does domain knowledge matter: Mapping users' expertise to their information interactions. Journal of the American Society for Information Science and Technology, 58, 13, (August 2007).

[26]

Saraschandra Karanam, Guillermo Jorge-Botana, Ricardo Olmos and Herre van Oostendorp. 2017. The role of domain knowledge in cognitive modeling of information search. Information Retrieval Journal, 20, 5 (May 2017), 456–479. https://doi.org/10.1007/s10791-017-9308-8

Digital Library

[27]

Saraschandra Karimi, Falk Scholer, Adam Clark and Sadegh Kharazmi. 2011. Domain expert topic familiarity and search behavior. In Proceedings of the 34th international ACM SIGIR conference on Research and development in Information Retrieval (July 2011), 1135-1136.

Digital Library

[28]

Diane Kelly, Jamie Arguello, Ashlee Edwards and Wan-ching Wu. 2015. Development and evaluation of search tasks for IIR experiments using a cognitive complexity framework. In Proceedings of the 2015 International Conference on Theory of Information Retrieval, (September 2015). 101–110. https://doi.org/10.1145/2808194.2809465

Digital Library

[29]

Diane Kelly and Colleen Cool. 2002. The effects of topic familiarity on information search behavior. In Proceedings of the 2nd ACM/IEEE-CS Joint Conference on Digital Libraries, (July 2002), 74-75.

Digital Library

[30]

Jeonghyun Kim. 2006. Task difficulty as a predictor and indicator of web searching interaction. In CHI ’06 Extended Abstracts on Human Factors in Computing Systems - CHI EA ’06, (April 2006), 959-964. https://doi.org/10.1145/1125451.1125636

Digital Library

[31]

Walter Kintsch. 1998. Comprehension: A paradigm for cognition. Cambridge: Cambridge University Press.

[32]

Walter Kintsch. 2009. Learning and constructivism. In Constructivist Instruction: Success or failure? Sigmund Tobias and Thomas Duffy (eds.). Routledge, New York.

[33]

Marijn Koolen, Frans Adriaans, Jaap Kamps and Maarten de Rijke. 2006. A cross-language approach to historic document retrieval. In Advances in Information Retrieval: 28th European Conference on IR Research 3936 (2006), 407-419. Springer Verlag, Heidelberg.

Digital Library

[34]

Marijn Koolen, Jaap Kamps and Vincent de Keijzer. 2009. Information retrieval in cultural heritage. Interdisciplinary Science Reviews 34, 2-3, (July 2009), 268-284.

[35]

Chang Liu, Jingjing Liu, and Nicholas J. Belkin. 2014. Predicting search task difficulty at different search stages. In Proc. Of the 23rd ACM International Conference on Information and Knowledge Management (November 2014), 569-578. https://doi.org/10.1145/2661829.2661939

Digital Library

[36]

Liu, Y.H. and Wacholder, N., 2017. Evaluating the impact of MeSH (Medical Subject Headings) terms on different types of searchers. Information Processing & Management, 53(4), pp.851-870.

[37]

Jiaxin Mao, Yiqun Liu, Noriko Kando, Min Zhang and Shaoping Ma. 2018. How does domain expertise affect users’ search interaction and outcome in exploratory search? ACM Transactions on Information Systems 36, 4 (October 2018), 1-30. https://doi.org/10.1145/3223045

Digital Library

[38]

Gary Marchionini. 1995. Information Seeking in Electronic Environments. Cambridge, UK: Cambridge University Press.

Digital Library

[39]

Gary Marchionini. 2006. Exploratory search: From finding to understanding. Communications of the ACM 49, 4(April 2006), 41-46. https://doi.org/10.1145/1121949.1121979

Digital Library

[40]

Felipe Moraes, Sindunuraga Rikarno Putra and Claudia Hauff. 2017. Contrasting search as a learning activity with instructor-designed learning. In CIKM '18: Proceedings of the 27th ACM International Conference on Information and Knowledge Management (October 2018), 167-176. https://doi.org/10.1145/3269206.3271676

Digital Library

[41]

Ondrusek, Anita L., Xiaoai Ren, and Changwoo Yang. 2017. A content analysis of strategies and tactics observed among MLIS students in an online searching course. Journal of Education for Library and Information Science 58(3): 141-159. http://.doi.org/10.12783/issn.2328-2967/58/3/2.

[42]

Soo Young Rieh, Kevyn Collins-Thompson, Preben Hansen and Hye-Jung Lee. 2016. Towards searching as a learning process: A review of current perspectives and future directions. Journal of Information Science 42, 1 (Januray 2016), 19–34. https://doi.org/10.1177/0165551515615841

Digital Library

[43]

Soo Young Rieh, Jacek Gwizdka, Luanne Freund, Kevyn Collins‐Thompson. 2014. Searching as learning: Novel measures for information interaction research. In Proceedings of the American Society for Information Science and Technology 51, 1, (April 2015) 1–4. https://doi.org/10.1002/meet.2014.14505101021

[44]

Nirmal Roy, Felipe Moraes and Claudia Hauff. 2020. Exploring Users’ Learning Gains within Search Sessions. In Proceedings of the 2020 Conference on Human Information Interaction and Retrieval (March 2020), 432–436. https://doi.org/10.1145/3343413.3378012

Digital Library

[45]

Sophie Rutter, Verena Blinzler, Chaoyu Ye, Max L. Wilson and Michael D. Twidale. 2019. Search tactics used in solving everyday how-to technical tasks: Repertoire, selection and tenacity. Information Processing & Management 56, 3 (May 2019), 919-938.

[46]

Smith, Catherine L. 2017. Domain‐independent Search Expertise: Gaining Knowledge in Query Formulation through Guided Practice. Journal of the Association for Information Science and Technology 68 (6): 1462-1479.

[47]

Catherine L. Smith and Soo Young Rieh. 2019. Knowledge-context in search systems: Toward information-literate actions. In Proceedings of the 2019 Conference on Human Information Interaction and Retrieval (CHIIR '19). Association for Computing Machinery, New York, NY, USA, 55–62. https://doi.org/10.1145/3295750.3298940

Digital Library

[48]

Robert J. Sternberg. 1998. Abilities are forms of developing expertise. Educational Researcher 27, 3 (April 1998), 11-20. https://doi.org/10.3102/0013189X027003011

[49]

Sarah A., Sullivan and Sadhana Puntambekar. 2015. Learning with digital texts: Exploring the impact of prior domain knowledge and reading comprehension ability on navigation and learning outcomes. Computers in Human Behavior 50 (September 2015), 299–313. https://doi.org/10.1016/j.chb.2015.04.016

Digital Library

[50]

Pertti Vakkari. 2001. A theory of the task‐based information retrieval process: A summary and generalisation of a longitudinal study. Journal of documentation 57,1 (February 2001), 44-60.

[51]

Pertti Vakkari. 2016. Searching as learning: A systematization based on literature. Journal of Information Science 42, 1 (January 2016), 7–18. https://doi.org/10.1177/0165551515615833

Digital Library

[52]

Ryen W. White, Susan T. Dumais and Jamie Teevan. 2009. Characterizing the influence of domain expertise on web search behavior. In Proceedings of the Second ACM International Conference on Web Search and Data Mining - WSDM ’09, (February 2009), 132-141. https://doi.org/10.1145/1498759.1498819

Digital Library

[53]

Barbara M. Wildemuth. 2004. The effects of domain knowledge on search tactic formulation. Journal of the American Society for Information Science and Technology 55, 3 (February 2004), 246–258. https://doi.org/10.1002/asi.10367

Digital Library

[54]

Barbara M. Wildemuth, Diane Kelly, D., Emma Boettcher, Erin Moore and Gergana Dimitrova. 2018. Examining the impact of domain and cognitive complexity on query formulation and reformulation. Information Processing and Management 54, 3 (May 2018), 433-450.

Digital Library

[55]

Wilson, Max L and Matthew Wilson. 2013. A comparison of techniques for measuring sensemaking and learning within participant-generated summaries. Journal of the American Society for Information Science and Technology 64, 2 (January 2013), 291–306. https://doi.org/10.1002/asi.22758

Digital Library

[56]

Iris Xie and Soohyung Joo. 2012. Factors affecting the selection of search tactics: Tasks, knowledge, process, and systems. Information Processing and Management 48, 2: 254-270.

Digital Library

[57]

Ran Yu, Ujwal Gadiraju, Peter Holtz, Markus Rokicki, Philipp Kemkes and Stefan Dietze. 2018. Predicting user knowledge gain in informational search sessions. In The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval: 75-84.

Digital Library

[58]

Barry J. Zimmerman. 2008. Investigating self-regulation and motivation: historical background, methodological developments, and future prospects. American Educational Research Journal 45, 1 (March 2008), 166-183. http://journals.sagepub.com/doi/10.3102/0002831207312909.

Cited By

Zhang XLiu C(2023)Examination of Information Problem Decomposition Strategies: A New Perspective for Understanding Users' Information Problems in Search as LearningProceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region10.1145/3624918.3625326(84-94)Online publication date: 26-Nov-2023
https://dl.acm.org/doi/10.1145/3624918.3625326
Abu Onq N(2023)How do Human and Contextual Factors Affect the Way People Formulate Queries?Proceedings of the 2023 Conference on Human Information Interaction and Retrieval10.1145/3576840.3578336(499-503)Online publication date: 19-Mar-2023
https://dl.acm.org/doi/10.1145/3576840.3578336
Zhao YBai YZhang YZhang BVakkari P(2023)A Probabilistic Model Toward How People Search to Build OutcomesIEEE Access10.1109/ACCESS.2023.325236911(22450-22467)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3252369
Show More Cited By

Index Terms

The Effects of Domain and Search Expertise on Learning Outcomes in Digital Library Use
1. Applied computing
  1. Computers in other domains
    1. Digital libraries and archives
2. Information systems
  1. Information retrieval
    1. Document representation
      1. Document collection models
  2. Information systems applications
    1. Digital libraries and archives

Index terms have been assigned to the content through auto-classification.

Recommendations

Improving Learning Outcomes for Higher Education Through Smart Technology

The ever-decreasing time between the doubling of knowledge creates a problem for education concerning how to handle information overload. To address this issue, educators must learn to make learning more effective and more efficient. Currently, there is ...
A Meta-analysis of the Impact of E-learning on Learner Learning Outcomes
ICEBT '22: Proceedings of the 2022 6th International Conference on E-Education, E-Business and E-Technology

With the continuous promotion of education informatization, e-learning as a new type of learning method, more and more learners are obtaining diverse learning outcomes through this method. In order to examine the impact of e-learning on learners' ...
The Effects of Self-Regulated Learning Processes on E-Learning Outcomes in Organizational Settings

This paper focuses on employees' e-learning processes during online job training. A new categorization of self-regulated learning strategies, that is, personal versus social learning strategies, is proposed, and measurement scales are developed. The new ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHIIR '22: Proceedings of the 2022 Conference on Human Information Interaction and Retrieval

March 2022

399 pages

ISBN:9781450391863

DOI:10.1145/3498366

General Chairs:
David Elsweiler
University of Regensburg, Bavaria, Germany
,
Udo Kruschwitz
University of Regensburg, Bavaria, Germany
,
Bernd Ludwig
University of Regensburg, Bavaria, Germany

Copyright © 2022 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 14 March 2022

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

Social Science and Humanities Council of Canada

Conference

CHIIR '22

Sponsor:

CHIIR '22: ACM SIGIR Conference on Human Information Interaction and Retrieval

March 14 - 18, 2022

Regensburg, Germany

Acceptance Rates

Overall Acceptance Rate 55 of 163 submissions, 34%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

6
Total Citations
View Citations
245
Total Downloads

Downloads (Last 12 months)43
Downloads (Last 6 weeks)4

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zhang XLiu C(2023)Examination of Information Problem Decomposition Strategies: A New Perspective for Understanding Users' Information Problems in Search as LearningProceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region10.1145/3624918.3625326(84-94)Online publication date: 26-Nov-2023
https://dl.acm.org/doi/10.1145/3624918.3625326
Abu Onq N(2023)How do Human and Contextual Factors Affect the Way People Formulate Queries?Proceedings of the 2023 Conference on Human Information Interaction and Retrieval10.1145/3576840.3578336(499-503)Online publication date: 19-Mar-2023
https://dl.acm.org/doi/10.1145/3576840.3578336
Zhao YBai YZhang YZhang BVakkari P(2023)A Probabilistic Model Toward How People Search to Build OutcomesIEEE Access10.1109/ACCESS.2023.325236911(22450-22467)Online publication date: 2023
https://doi.org/10.1109/ACCESS.2023.3252369
Golub KTan XLiu YTyrkkö J(2023)Online subject searching of humanities PhD students at a Swedish universityJournal of Documentation10.1108/JD-03-2023-004479:7(308-329)Online publication date: 30-Oct-2023
https://doi.org/10.1108/JD-03-2023-0044
Nguyen HHwang WPham TTruong TChang H(2023)Development of a mobile Web library application for an institutional repository and investigation of its influences on learningThe Electronic Library10.1108/EL-03-2023-006241:5(578-616)Online publication date: 2-Aug-2023
https://doi.org/10.1108/EL-03-2023-0062
Ghosh SGwizdka JLewandowski DReynolds RRieh SHeck TImeri A(2023)Search Systems and Artificial IntelligenceProceedings of the Association for Information Science and Technology10.1002/pra2.85960:1(775-779)Online publication date: 22-Oct-2023
https://dl.acm.org/doi/10.1002/pra2.859

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Figures

Tables

Media

View Table of Conten