short-paper

Public Access

OrgBox: Supporting Cognitive and Metacognitive Activities During Exploratory Search

Authors:

Austin R. Ward,

Robert CapraAuthors Info & Claims

SIGIR '21: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval

Pages 2570 - 2574

https://doi.org/10.1145/3404835.3462790

Published: 11 July 2021 Publication History

Abstract

We describe a search-assistance tool called the OrgBox, created to support users' organizational, cognitive, and metacognitive activities while performing exploratory search tasks. The OrgBox tool allows users to create and label "boxes" to organize information found during a search. The OrgBox was integrated with a custom built search system that allowed users to save, organize, and synthesize information using drag-and-drop actions. The OrgBox tool also encourages users to engage in metacognitive activities during their search process (e.g., planning their next steps, monitoring their progress, evaluating the information found so far). In this paper, we describe the features and implementation of the OrgBox tool. We also summarize result of two user studies conducted using the OrgBox that show its cognitive and metacognitive benefits to users.

References

[1]

Saleema Amershi and Meredith Ringel Morris. 2008. CoSearch: a system for co-located collaborative web search. In Proceedings of the SIGCHI conference on human factors in computing systems. 1647--1656.

Digital Library

[2]

Roger Azevedo, Jennifer G Cromley, and Diane Seibert. 2004. Does adaptive scaffolding facilitate students' ability to regulate their learning with hypermedia? Contemporary educational psychology, Vol. 29, 3 (2004), 344--370.

[3]

Soonil Bae, DoHyoung Kim, Konstantinos Meintanis, J Michael Moore, Anna Zacchi, Frank Shipman, Haowei Hsieh, and Catherine C Marshall. 2010. Supporting document triage via annotation-based multi-application visualizations. In Proceedings of the 10th annual joint conference on Digital libraries. 177--186.

Digital Library

[4]

Soonil Bae, Catherine C Marshall, Konstantinos Meintanis, Anna Zacchi, Haowei Hsieh, J Michael Moore, and Frank M Shipman. 2006. Patterns of reading and organizing information in document triage. Proceedings of the American Society for Information Science and Technology, Vol. 43, 1 (2006), 1--27.

[5]

Paul L Bogen, Amber McKenzie, and Rob Gillen. 2013. Redeye: a digital library for forensic document triage. In Proceedings of the 13th ACM/IEEE-CS joint conference on Digital libraries. 181--190.

Digital Library

[6]

George Buchanan and Fernando Loizides. 2007. Investigating document triage on paper and electronic media. In International Conference on Theory and Practice of Digital Libraries. Springer, 416--427.

[7]

George Buchanan and Tom Owen. 2008. Improving skim reading for document triage. In Proceedings of the second international symposium on Information interaction in context. 83--88.

Digital Library

[8]

Maria Cardelle-Elawar. 1995. Effects of metacognitive instruction on low achievers in mathematics problems. Teaching and Teacher Education, Vol. 11, 1 (1995), 81--95.

[9]

Claudio Carpineto, Stanislaw Osi'nski, Giovanni Romano, and Dawid Weiss. 2009. A survey of web clustering engines. ACM Computing Surveys (CSUR), Vol. 41, 3 (2009), 1--38.

Digital Library

[10]

Bogeum Choi, Jaime Arguello, Robert Capra, and Austin R. Ward. 2021. OrgBox: A Knowledge Representation Tool to Support Complex Search Tasks. In Proceedings of the 2021 Conference on Human Information Interaction and Retrieval (CHIIR '21). Association for Computing Machinery, New York, NY, USA, 219--228. https://doi.org/10.1145/3406522.3446029

Digital Library

[11]

Kevyn Collins-Thompson, Preben Hansen, and Claudia Hauff. 2017. Search as learning (dagstuhl seminar 17092). In Dagstuhl reports, Vol. 7. Schloss Dagstuhl-Leibniz-Zentrum fuer Informatik.

[12]

Anita Crescenzi, Austin R. Ward, Yuan Li, and Robert Capra. 2021. Supporting metacognition during exploratory search with the OrgBox. In Proceedings of the 44th annual international ACM SIGIR conference on Research and development in information retrieval (SIGIR '21). Association for Computing Machinery, New York, NY, USA.

Digital Library

[13]

J. Shane Culpepper, Fernando Diaz, and Mark D. Smucker. 2018. Research Frontiers in Information Retrieval: Report from the Third Strategic Workshop on Information Retrieval in Lorne (SWIRL 2018)., Vol. 52, 1 (Aug. 2018), 34--90. https://doi.org/10.1145/3274784.3274788

Digital Library

[14]

Abdigani Diriye and Gene Golovchinsky. 2012. Querium: a session-based collaborative search system. In European Conference on Information Retrieval. Springer, 583--584.

Digital Library

[15]

Debora Donato, Francesco Bonchi, Tom Chi, and Yoelle Maarek. 2010. Do You Want to Take Notes? Identifying Research Missions in Yahoo! Search Pad. In Proceedings of the 19th International Conference on World Wide Web (WWW '10). Association for Computing Machinery, New York, NY, USA, 321--330. https://doi.org/10.1145/1772690.1772724

Digital Library

[16]

Carsten Eickhoff, Jacek Gwizdka, Claudia Hauff, and Jiyin He. 2017. Introduction to the special issue on search as learning. Information Retrieval Journal, Vol. 20, 5 (2017), 399--402.

Digital Library

[17]

John H. Flavell. 1979. Metacognition and cognitive monitoring: A new area of cognitive-developmental inquiry. American Psychologist, Vol. 34, 10 (1979), 906--911. 10.1037/0003-066X.34.10.906

[18]

Gene Golovchinsky, John Adcock, Jeremy Pickens, Pernilla Qvarfordt, and Maribeth Back. 2008. Cerchiamo: a collaborative exploratory search tool. Proceedings of Computer Supported Cooperative Work (CSCW) (2008), 8--12.

[19]

Roberto González-Ibá nez and Chirag Shah. 2011. Coagmento: A system for supporting collaborative information seeking. proceedings of the American Society for Information Science and Technology, Vol. 48, 1 (2011), 1--4.

[20]

Jacek Gwizdka, Preben Hansen, Claudia Hauff, Jiyin He, and Noriko Kando. 2016. Search as learning (SAL) workshop 2016. In Proceedings of the 39th International ACM SIGIR conference on Research and Development in Information Retrieval. 1249--1250.

Digital Library

[21]

Marti Hearst. 2009. Search user interfaces .Cambridge university press.

[22]

Marti A Hearst. 2006. Clustering versus faceted categories for information exploration. Commun. ACM, Vol. 49, 4 (2006), 59--61.

Digital Library

[23]

Marti A Hearst and Duane Degler. 2013. Sewing the seams of sensemaking: A practical interface for tagging and organizing saved search results. In Proceedings of the symposium on human-computer interaction and information retrieval. 1--10.

Digital Library

[24]

Charles D Holley and Donald F Dansereau. 1984. The development of spatial learning strategies. Spatial learning strategies. Elsevier, 3--19.

[25]

Diane Kelly, Jaime Arguello, and Robert Capra. 2013. NSF Workshop on Task-Based Information Search Systems. SIGIR Forum, Vol. 47, 2 (Jan. 2013), 116--127. https://doi.org/10.1145/2568388.2568407

Digital Library

[26]

Gary Marchionini. 2006. Exploratory search: from finding to understanding. Commun. ACM, Vol. 49, 4 (2006), 41--46.

Digital Library

[27]

Zemira R Mevarech. 1999. Effects of metacognitive training embedded in cooperative settings on mathematical problem solving. The Journal of Educational Research, Vol. 92, 4 (1999), 195--205.

[28]

Dan Morris, Meredith Ringel Morris, and Gina Venolia. 2008. SearchBar: A search-centric web history for task resumption and information re-finding. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '08). Association for Computing Machinery, New York, NY, USA, 1207--1216. https://doi.org/10.1145/1357054.1357242

Digital Library

[29]

Joseph D Novak, D Bob Gowin, and Gowin D Bob. 1984. Learning how to learn .cambridge University press.

[30]

Jeremy Pickens, Gene Golovchinsky, Chirag Shah, Pernilla Qvarfordt, and Maribeth Back. 2008. Algorithmic mediation for collaborative exploratory search. In Proceedings of the 31st annual international ACM SIGIR conference on Research and development in information retrieval. 315--322.

Digital Library

[31]

Daniel M Russell, Mark J Stefik, Peter Pirolli, and Stuart K Card. 1993. The cost structure of sensemaking. In Proceedings of the INTERACT'93 and CHI'93 conference on Human factors in computing systems. 269--276.

Digital Library

[32]

Dale H Schunk and Barry J Zimmerman. 1994. Self-regulation of learning and performance: Issues and educational applications. Lawrence Erlbaum Associates, Inc.

[33]

Chirag Shah. 2010. Coagmento-a collaborative information seeking, synthesis and sense-making framework. Integrated demo at CSCW, Vol. 2010 (2010).

[34]

Frank M Shipman III, Haowei Hsieh, Preetam Maloor, and J Michael Moore. 2001. The visual knowledge builder: a second generation spatial hypertext. In Proceedings of the 12th ACM conference on Hypertext and Hypermedia. 113--122.

[35]

Marc Stadtler and Rainer Bromme. 2008. Effects of the metacognitive computer-tool met. a. ware on the web search of laypersons. Computers in Human Behavior, Vol. 24, 3 (2008), 716--737.

Digital Library

[36]

Simon Tretter, Gene Golovchinsky, and Pernilla Qvarfordt. 2013. SearchPanel: A Browser Extension for Managing Search Activity. EuroHCIR, Vol. 54 (2013).

[37]

Daniel Tunkelang. 2009. Faceted search. Synthesis lectures on information concepts, retrieval, and services, Vol. 1, 1 (2009), 1--80.

Digital Library

[38]

Pertti Vakkari. 2016. Searching as learning: A systematization based on literature. Journal of Information Science, Vol. 42, 1 (2016), 7--18.

Digital Library

[39]

Ryen W White and Resa A Roth. 2009. Exploratory search: Beyond the query-response paradigm. Synthesis lectures on information concepts, retrieval, and services, Vol. 1, 1 (2009), 1--98.

Digital Library

[40]

Max L Wilson. 2011. Search user interface design. Synthesis lectures on information concepts, retrieval, and services, Vol. 3, 3 (2011), 1--143.

[41]

Meilan Zhang and Chris Quintana. 2012. Scaffolding strategies for supporting middle school students' online inquiry processes. Computers & Education, Vol. 58, 1 (2012), 181--196.

Digital Library

[42]

Michal Zion, Tova Michalsky, and Zemira R Mevarech. 2005. The effects of metacognitive instruction embedded within an asynchronous learning network on scientific inquiry skills. International Journal of Science Education, Vol. 27, 8 (2005), 957--983.

Cited By

Ros KTakwane KPatil AJayaprakash RZhai CHui Yang GWang HHan SHauff CZuccon GZhang Y(2024)TextData: Save What You Know and Find What You Don'tProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657681(2806-2810)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.1145/3626772.3657681
Payandeh MBoon MStorie DRamshaw VHoeber O(2023)Drag-and-Drop Query Refinement and Query History Visualization for Mobile Exploratory SearchProceedings of the 2023 Conference on Human Information Interaction and Retrieval10.1145/3576840.3578282(432-437)Online publication date: 19-Mar-2023
https://dl.acm.org/doi/10.1145/3576840.3578282
Wang XLiu C(2023)Finding the Aha! Moment of Search: A Preliminary Examination of Insight Learning During SearchProceedings of the Association for Information Science and Technology10.1002/pra2.80060:1(421-432)Online publication date: 22-Oct-2023
https://doi.org/10.1002/pra2.800
Show More Cited By

Index Terms

OrgBox: Supporting Cognitive and Metacognitive Activities During Exploratory Search
1. Human-centered computing
  1. Human computer interaction (HCI)
2. Information systems
  1. Information retrieval
    1. Users and interactive retrieval

Recommendations

Supporting Metacognition during Exploratory Search with the OrgBox
SIGIR '21: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval

Current search systems provide effective support to users engaged in fact-finding and look-up oriented tasks. However, they provide relatively little support for users engaged in exploratory search tasks that involve cognitive and metacognitive ...
Assigning search tasks designed to elicit exploratory search behaviors
HCIR '12: Proceedings of the Symposium on Human-Computer Interaction and Information Retrieval

The goal of this paper is to provide guidance to researchers investigating exploratory search behaviors and exploratory search systems. It focuses on the design of search tasks assigned in such studies. Based on a review of past studies, a set of task ...
Supporting exploratory people search: a study of factor transparency and user control
CIKM '13: Proceedings of the 22nd ACM international conference on Information & Knowledge Management

People search is an active research topic in recent years. Related works includes expert finding, collaborator recommendation, link prediction and social matching. However, the diverse objectives and exploratory nature of those tasks make it difficult ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGIR '21: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval

July 2021

2998 pages

ISBN:9781450380379

DOI:10.1145/3404835

General Chairs:
Fernando Diaz
(Google)
,
Chirag Shah
University of Washington
,
Torsten Suel
New York University
,
Program Chairs:
Pablo Castells
Universidad Autónoma de Madrid, Amazon
,
Rosie Jones
Spotify
,
Tetsuya Sakai
Waseda University

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGIR: ACM Special Interest Group on Information Retrieval

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 July 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Funding Sources

NSF (National Science Foundation)

Conference

SIGIR '21

Sponsor:

SIGIR

SIGIR '21: The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval

July 11 - 15, 2021

Virtual Event, Canada

Acceptance Rates

Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

10
Total Citations
View Citations
302
Total Downloads

Downloads (Last 12 months)71
Downloads (Last 6 weeks)5

Reflects downloads up to 27 Jul 2024

Other Metrics

View Author Metrics

Citations

Cited By

Ros KTakwane KPatil AJayaprakash RZhai CHui Yang GWang HHan SHauff CZuccon GZhang Y(2024)TextData: Save What You Know and Find What You Don'tProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657681(2806-2810)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.1145/3626772.3657681
Payandeh MBoon MStorie DRamshaw VHoeber O(2023)Drag-and-Drop Query Refinement and Query History Visualization for Mobile Exploratory SearchProceedings of the 2023 Conference on Human Information Interaction and Retrieval10.1145/3576840.3578282(432-437)Online publication date: 19-Mar-2023
https://dl.acm.org/doi/10.1145/3576840.3578282
Wang XLiu C(2023)Finding the Aha! Moment of Search: A Preliminary Examination of Insight Learning During SearchProceedings of the Association for Information Science and Technology10.1002/pra2.80060:1(421-432)Online publication date: 22-Oct-2023
https://doi.org/10.1002/pra2.800
Li YCrescenzi AWard ACapra R(2023)Thinking inside the boxJournal of the Association for Information Science and Technology10.1002/asi.2480174:9(1049-1066)Online publication date: 2-Aug-2023
https://dl.acm.org/doi/10.1002/asi.24801
Li PZhang YZhang B(2022)Understanding Query Combination Behavior in Exploratory SearchesApplied Sciences10.3390/app1202070612:2(706)Online publication date: 11-Jan-2022
https://doi.org/10.3390/app12020706
Palani SZhou YZhu SDow S(2022)InterWeave: Presenting Search Suggestions in Context Scaffolds Information Search and SynthesisProceedings of the 35th Annual ACM Symposium on User Interface Software and Technology10.1145/3526113.3545696(1-16)Online publication date: 29-Oct-2022
https://dl.acm.org/doi/10.1145/3526113.3545696
Liu MKittur AMyers B(2022)Crystalline: Lowering the Cost for Developers to Collect and Organize Information for Decision MakingProceedings of the 2022 CHI Conference on Human Factors in Computing Systems10.1145/3491102.3501968(1-16)Online publication date: 29-Apr-2022
https://dl.acm.org/doi/10.1145/3491102.3501968
Gomes SBoon MHoeber OAmigo ECastells PGonzalo JCarterette BCulpepper JKazai G(2022)A Study of Cross-Session Cross-Device Search Within an Academic Digital LibraryProceedings of the 45th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3477495.3531929(384-394)Online publication date: 6-Jul-2022
https://dl.acm.org/doi/10.1145/3477495.3531929
Hoeber OShukla S(2022)A study of visually linked keywords to support exploratory browsing in academic searchJournal of the Association for Information Science and Technology10.1002/asi.2462373:8(1171-1191)Online publication date: 10-Feb-2022
https://doi.org/10.1002/asi.24623
Crescenzi AWard ALi YCapra RDiaz FShah CSuel TCastells PJones RSakai T(2021)Supporting Metacognition during Exploratory Search with the OrgBoxProceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3404835.3462955(1197-1207)Online publication date: 11-Jul-2021
https://dl.acm.org/doi/10.1145/3404835.3462955

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents