research-article

The search dashboard: how reflection and comparison impact search behavior

Authors:

Ryen W. WhiteAuthors Info & Claims

CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

Pages 1785 - 1794

https://doi.org/10.1145/2207676.2208311

Published: 05 May 2012 Publication History

Abstract

Most searchers do not know how to use Web search engines as effectively as possible. This is due, in part, to search engines not providing feedback about how search behavior can be improved. Because feedback is an essential part of learning, we created the Search Dashboard, which provides an interface for reflection on personal search behavior. The Dashboard aggregates and presents an individual's search history and provides comparisons with that of archetypal expert profiles. Via a five-week study of 90 Search Dash-board users, we find that users are able to change aspects of their behavior to be more in line with that of the presented expert searchers. We also find that reflection can be beneficial, even without comparison, by changing participants' views about their own search skills, what is possible with search, and what aspects of their behavior may influence search success. Our findings demonstrate a new way for search engines to help users modify their search behavior for positive outcomes.

Supplementary Material

MP4 File (paperfile236-3.mp4)

Supplemental video for “The search dashboard: how reflection and comparison impact search behavior”

Download
8.22 MB

References

[1]

Aula, A., Khan, R.M. & Guan, Z. How does search behavior change as search becomes more difficult? Proc. CHI, 2010, 35--44.

Digital Library

[2]

Aula, A. & Nordhausen, K. Modeling successful performance in web searching. JASIST 57, 12 (2006), 1678--1693.

Digital Library

[3]

Aula, A., Jhaveri, N. & Kaki, M. Information search and re-access strategies of experienced Web users. Proc. WWW, 583--592.

Digital Library

[4]

Bandura, A. Social Foundations of Thought and Action: A Social Cognitive Theory. Englewood Cliffs, NJ, US: Prentice-Hall, 1986.

[5]

Bennett, P., Svore, K. & Dumais, S. Classificationenhanced ranking. Proc. WWW, 2010, 111--120.

Digital Library

[6]

Brand-Gruwel, S., Wopereis, I. & Vermetten, Y. Information problem solving by experts and novices: Analysis of a complex cognitive skill. Computers in Human Behavior, 21, (2005), 487--508.

Digital Library

[7]

Boud, D., Keogh, R. & Walker, D. Reflection: Turning Experience into Learning. Routledge, 1985.

[8]

Collins, A., Brown, J.S. & Newman, S.E. Cognitive apprenticeship: Teaching the craft of reading, writing and mathematics. Knowing, Learning and Instruction 8, 1 (1989), 453--494.

[9]

Consolvo, S., McDonald, D. & Landay, J. Theory-driven design strategies for technologies that support behavior change in everyday life. Proc. CHI, 2009, 405--414.

Digital Library

[10]

Dou, Z., Song, R. & Wen, J. A large-scale evaluation and analysis of personalized search strategies. Proc. WWW, 2007, 581--590.

Digital Library

[11]

Evans, B. M. & Chi, E.H. An elaborated model of social search. IP&M, 46, 6 (2010), 656--678.

Digital Library

[12]

Fogg, B.J. Motivating, influencing, and persuading users. In The human-computer interaction handbook, Julie A. Jacko and Andrew Sears (Eds.). L., (2002), 358--370.

Digital Library

[13]

Froehlich, J., Findlater, L. & Landay, J. The design of eco-feedback technology. Proc. CHI, 2010, 1999--2008.

Digital Library

[14]

Hölscher, C. & Strube, G. Web search behavior of Internet experts and newbies. Computer Networks 33, (2000), 337--346.

Digital Library

[15]

Khan, K. & Locatis, C. Searching through the cyberspace: the effects of link display and link density on information retrieval from hypertext on the World Wide Web. JASIST, 49, 2 (1998), 176--182.

Digital Library

[16]

Kodagoda, N. & Wong, B.L.W. Effects of low and high literacy on user performance in information search and retrieval. Proc. BCS-HCI, 2008, 173--181.

Digital Library

[17]

Lazonder, A.W., Biemans, H.J.A. & Worpeis, I.G.J.H. Differences between novice and experienced users in searching information on the World Wide Web. JASIST 51, 6 (2000), 576--581.

Digital Library

[18]

Li, I., Forlizzi, J. & Dey, A. Know thyself: monitoring and reflecting on facets of one's life. Proc. CHI EA, 2010, 4489--4492.

Digital Library

[19]

Moraveji, N., Morris, M.R., Morris, D., Czerwinski, M. & Riche, N. ClassSearch: Facilitating the development of web search skills through social learning. Proc. CHI, 2011, 1797--1806.

Digital Library

[20]

Moraveji, N., Russell, D., Bien, J. & Mease, D. Measuring improvement in user search performance resulting from optimal search tips. Proc. SIGIR, 2011, 355--363.

Digital Library

[21]

Morris, D., Morris, M.R. & Venolia, G. SearchBar: a search-centric web history for task resumption and information re-finding. Proc. CHI, 2008, 1207--1216.

Digital Library

[22]

Nielsen, J. Incompetent research skills curb users' problem solving. Alertbox. April 11, 2011. (available at: http://www.useit.com/alertbox/search-skills.html)

[23]

Saito, H. & Miwa, K. A cognitive study of information seeking processes in the WWW: Effects of searcher's knowledge and experience. Proc. WISE, 2001, 321--333.

Digital Library

[24]

Sparck-Jones, K. A statistical interpretation of term specificity and its application in retrieval. Journal of Documentation 28, 1 (1972), 11--21.

[25]

Thaler, R.H. & Sunstein, C.R. Nudge: improving decisions about health, wealth, and happiness. Yale, 2008.

[26]

Van Kleek, M., Moore, B., Xu, C., & Karger, D.R. Eyebrowse: Real-time web activity sharing and visualization. Proc. CHI EA, 2010, 3643--3648.

Digital Library

[27]

White, R.W. and Morris, D. Investigating the querying and browsing behavior of advanced search engine users. Proc. SIGIR, 2007, 255--262.

Digital Library

[28]

White, R.W., Bilenko, M., and Cucerzan, S. Studying the use of popular destinations to enhance web search Interaction. Proc. of SIGIR, 2007, 159--166.

Digital Library

[29]

White, R.W., Dumais, S., and Teevan, J. Characterizing the influence of domain expertise on web search behavior. Proc. WSDM, 2009, 132--141.

Digital Library

Cited By

Bink MElsweiler D(2024)Balancing Act: Boosting Strategies for Informed Search on Controversial TopicsProceedings of the 2024 Conference on Human Information Interaction and Retrieval10.1145/3627508.3638329(254-265)Online publication date: 10-Mar-2024
https://dl.acm.org/doi/10.1145/3627508.3638329
Aubin Le Quéré MTran LBerger ANguyen CVenkatesan RXu YSorokina ANaaman M(2024)An Article a Day: Towards Personal Informatics for Healthy News ConsumptionExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650854(1-9)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650854
Karolus JFeger SSchmidt AWoźniak P(2023)Your Text Is Hard to Read: Facilitating Readability Awareness to Support Writing Proficiency in Text ProductionProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596052(147-160)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596052
Show More Cited By

Index Terms

The search dashboard: how reflection and comparison impact search behavior
1. Information systems
  1. Information retrieval

Recommendations

Developing a Measure of Search Expertise
CHIIR '16: Proceedings of the 2016 ACM on Conference on Human Information Interaction and Retrieval

While search expertise has long been considered an important variable in the study of online information search, the creation of a robust measure to characterize it has eluded researchers. Instead, those wishing to measure search expertise often include ...
How do users handle inconsistent information?: the effect of search expertise
SAC '16: Proceedings of the 31st Annual ACM Symposium on Applied Computing

While search engines sometimes return different documents containing contradictory answers, little is known about how users handle inconsistent information. This paper investigates the effect of search expertise (defined as specialized knowledge on the ...
Multilingual search strategies
CHI EA '09: CHI '09 Extended Abstracts on Human Factors in Computing Systems

We explored the search strategies of multilingual searchers, i.e., users who use multiple languages when searching for information. We wanted to understand factors that determine the language multilingual searchers choose to search in, if they switch ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

CHI '12: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems

May 2012

3276 pages

ISBN:9781450310154

DOI:10.1145/2207676

General Chair:
Joseph A. Konstan
University of Minnesota
,
Program Chairs:
Ed H. Chi
Google
,
Kristina Höök
Mobile Life at KTH

Copyright © 2012 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 May 2012

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHI '12

Sponsor:

SIGCHI

CHI '12: CHI Conference on Human Factors in Computing Systems

May 5 - 10, 2012

Texas, Austin, USA

Acceptance Rates

Overall Acceptance Rate 6,199 of 26,314 submissions, 24%

Upcoming Conference

CHI 2025

Sponsor:
sigchi

ACM CHI Conference on Human Factors in Computing Systems

April 26 - May 1, 2025

Yokohama , Japan

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

52
Total Citations
View Citations
1,049
Total Downloads

Downloads (Last 12 months)32
Downloads (Last 6 weeks)2

Reflects downloads up to 30 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Bink MElsweiler D(2024)Balancing Act: Boosting Strategies for Informed Search on Controversial TopicsProceedings of the 2024 Conference on Human Information Interaction and Retrieval10.1145/3627508.3638329(254-265)Online publication date: 10-Mar-2024
https://dl.acm.org/doi/10.1145/3627508.3638329
Aubin Le Quéré MTran LBerger ANguyen CVenkatesan RXu YSorokina ANaaman M(2024)An Article a Day: Towards Personal Informatics for Healthy News ConsumptionExtended Abstracts of the CHI Conference on Human Factors in Computing Systems10.1145/3613905.3650854(1-9)Online publication date: 11-May-2024
https://dl.acm.org/doi/10.1145/3613905.3650854
Karolus JFeger SSchmidt AWoźniak P(2023)Your Text Is Hard to Read: Facilitating Readability Awareness to Support Writing Proficiency in Text ProductionProceedings of the 2023 ACM Designing Interactive Systems Conference10.1145/3563657.3596052(147-160)Online publication date: 10-Jul-2023
https://dl.acm.org/doi/10.1145/3563657.3596052
Kotake JKitayama DAtzenbeck CRubart J(2022)Search UI with fill-in-the-blank for clarifying purpose of information exploration and its evaluationProceedings of the 5th Workshop on Human Factors in Hypertext10.1145/3538882.3542794(1-8)Online publication date: 28-Jun-2022
https://dl.acm.org/doi/10.1145/3538882.3542794
Suzuki MYamamoto Y(2022)Don’t Judge by Looks: Search User Interface to Make Searchers Reflect on Their Relevance Criteria and Promote Content-Quality-Oriented Web SearchesProceedings of the 2022 ACM Conference on Information Technology for Social Good10.1145/3524458.3547222(1-8)Online publication date: 7-Sep-2022
https://dl.acm.org/doi/10.1145/3524458.3547222
Smith CUrgo KArguello JCapra RElsweiler DKruschwitz ULudwig B(2022)Learner, Assignment, and Domain: Contextualizing Search for ComprehensionProceedings of the 2022 Conference on Human Information Interaction and Retrieval10.1145/3498366.3505819(191-201)Online publication date: 14-Mar-2022
https://dl.acm.org/doi/10.1145/3498366.3505819
Pickering JMoore SWray D(2022)Changing human behaviour to improve animal welfare outcomesAnimal Production Science10.1071/AN2155862:11(967-974)Online publication date: 26-May-2022
https://doi.org/10.1071/AN21558
Ihoriya HSuzuki MYamamoto Y(2022)Mitigating Position Bias in Review Search Results with Aspect Indicator for Loss AversionHuman Interface and the Management of Information: Applications in Complex Technological Environments10.1007/978-3-031-06509-5_2(17-32)Online publication date: 16-Jun-2022
https://doi.org/10.1007/978-3-031-06509-5_2
Saito FYamamoto Y(2021)Weasel Finder: Highlighting Ambiguous Sentences for Promoting Critical Web BrowsingWeasel Finder:文章表現の曖昧さ指摘による批判的なウェブ情報探索の促進Transactions of the Japanese Society for Artificial Intelligence10.1527/tjsai.36-1_WI2-H36:1(WI2-H_1-13)Online publication date: 1-Jan-2021
https://doi.org/10.1527/tjsai.36-1_WI2-H
Suzuki MYamamoto Y(2020)Analysis of Relationship between Confirmation Bias and Web Search BehaviorProceedings of the 22nd International Conference on Information Integration and Web-based Applications & Services10.1145/3428757.3429086(184-191)Online publication date: 30-Nov-2020
https://dl.acm.org/doi/10.1145/3428757.3429086
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents