research-article

Web Access Literacy Scale to Evaluate How Critically Users Can Browse and Search for Web Information

Authors:

Yusuke Yamamoto,

Takehiro Yamamoto,

Hiroaki Ohshima,

Hiroshi KawakamiAuthors Info & Claims

WebSci '18: Proceedings of the 10th ACM Conference on Web Science

Pages 97 - 106

https://doi.org/10.1145/3201064.3201072

Published: 15 May 2018 Publication History

Abstract

We propose a web access literacy scale to assess user ability to scrutinize web information and gather accurate information using information access systems, such as web search engines.

We conducted an online study with participants recruited through a crowdsourcing service. Analysis of the questionnaire responses confirmed that the proposed web access literacy scale is reliable and valid. We also noted the following pointers: (1) Web users may not pay significant attention to web page authors and their expertise when judging information credibility. (2) Users may have weaknesses relative to the use of web search engines and tolerance for cognitive bias that appears in credibility assessment of web information.

The results of this study are expected to contribute to the design of information access systems or educational classes to encourage users to reflect on and improve their web access literacy relative to critical information seeking.

References

[1]

American Library Association and Association for College and Research Libraries . 2000. Information Literacy Competency Standards for Higher Education. Technical Report.

[2]

Scott Bateman, Jaime Teevan, and Ryen W White . 2012. The Search Dashboard: How Reflection and Comparison Impact Search Behavior Proceedings of the 30th ACM International Conference on Human Factors in Computing Systems (CHI 2012). ACM, 1785--1794.

Digital Library

[3]

Charles L A Clarke, Eugene Agichtein, Susan Dumais, and Ryen W White . 2007. The Influence of Caption Features on Clickthrough Patterns in Web Search Proceedings of the 30th ACM SIGIR International Conference (SIGIR 2007). ACM, 135--142.

Digital Library

[4]

Xin Luna Dong, Evgeniy Gabrilovich, Kevin Murphy, Van Dang, Wilko Horn, Camillo Lugaresi, Shaohua Sun, and Wei Zhang . 2015. Knowledge-based trust: estimating the trustworthiness of web sources Proceedings of the VLDB Endowment (VLDB 2015). 938--949.

Digital Library

[5]

Rob Ennals, Beth Trushkowsky, and John Mark Agosta . 2010. Highlighting disputed claims on the web. In Proceedings of the 19th International World Wide Web Conference (WWW 2010). ACM, 341--350.

Digital Library

[6]

Robert H. Ennis . 1987. A taxonomy of critical thinking dispositions and abilities. In Series of books in psychology. Teaching thinking skills: Theory and practice, bibfieldeditorJ. B. Baron and R. J. Sternberg (Eds.). W H Freeman/Times Books/ Henry Holt & Co, New York, 9--26.

[7]

Peter A Facione, Carol A Sanchez, Noreen C Facione, and Joanne Gainen . 1995. The disposition toward critical thinking. The Journal of General Education (1995), 1--25.

[8]

Morgan Harvey, Claudia Hauff, and David Elsweiler . 2015. Learning by Example: Training Users with High-quality Query Suggestions Proceedings of the 38th ACM International ACM SIGIR Conference (SIGIR 2015). ACM, 133--142.

Digital Library

[9]

Takashi Kusumi, Rumi Hirayama, and Yoshihisa Kashima . 2017. Risk Perception and Risk Talk: The Case of the Fukushima Daiichi Nuclear Radiation Risk. Risk Analysis Vol. 37, 12 (2017), 2305--2320.

[10]

Chee Wee Leong and Silviu Cucerzan . 2012. Supporting Factual Statements with Evidence from the Web Proceedings of the 21st ACM International Conference on Information and Knowledge Management (CIKM 2012). ACM, 1153--1162.

Digital Library

[11]

UC Berkeley Library . 2014. Evaluating resources. (2014). deftempurl%http://guides.lib.berkeley.edu/evaluating-resources tempurl

[12]

Gitte Lindgaard, Cathy Dudek, Devjani Sen, Livia Sumegi, and Patrick Noonan . 2011. An Exploration of Relations between Visual Appeal, Trustworthiness and Perceived Usability of Homepages. ACM Transactions on Computer-Human Interaction (TOCHI) Vol. 18, 1 (2011), 1--30.

Digital Library

[13]

Sylvain Malacria, Joey Scarr, Andy Cockburn, Carl Gutwin, and Tovi Grossman . 2013. Skillometers: Reflective Widgets that Motivate and Help Users to Improve Performance Proceedings of the 26th annual ACM symposium symposium on User interface software and technology (UIST 2013). ACM, 321--330.

Digital Library

[14]

Marc Meola . 2004. Chucking the Checklist: A Contextual Approach to Teaching Undergraduates Web-Site Evaluation. portal: Libraries and the Academy Vol. 4, 3 (2004), 331--344.

[15]

Miriam J Metzger, Andrew J Flanagin, Alex Markov, Rebekah Grossman, and Monica Bulger . 2015. Believing the Unbelievable: Understanding Young People's Information Literacy Beliefs and Practices in the United States. Journal of Children and Media Vol. 9, 3 (2015), 325--348.

[16]

Miriam J Metzger, Andrew J Flanagin, and Lara Zwarun . 2003. College student Web use, perceptions of information credibility, and verification behavior. Computers & Education Vol. 41, 3 (2003), 271--290.

Digital Library

[17]

Meredith Ringel Morris, Jaime Teevan, and Katrina Panovich . 2010. What Do People Ask Their Social Networks, and Why?: A Survey Study of Status Message Q&A Behavior. In Proceedings of the 28th ACM International Conference on Human Factors in Computing Systems (CHI 2010). ACM, 1739--1748.

Digital Library

[18]

Satoshi Nakamura, Shinji Konishi, Adam Jatowt, Hiroaki Ohshima, Hiroyuki Kondo, Taro Tezuka, Satoshi Oyama, and Katsumi Tanaka . 2007. Trustworthiness Analysis of Web Search Results. In Proceedings of the 11th European conference on Research and Advanced Technology for Digital Libraries (ECDL 2007). 38--49.

Digital Library

[19]

Cameron D Norman and Harvey A Skinner . 2006. eHEALS: The eHealth Literacy Scale. Journal of Medical Internet Research Vol. 8, 4 (2006), e27--10.

[20]

Ernest T. Pascarella . 1989. The development of critical thinking: Does college make a difference? Journal of College Student Development Vol. 30, 1 (1989), 19--26.

[21]

Jeff Pasternack and Dan Roth . 2013. Latent credibility analysis. In Proceedings of the 22nd International World Wide Web Conference (WWW 2013). ACM, 1009--1020.

Digital Library

[22]

Elizabeth Sillence, Pam Briggs, Lesley Fishwick, and Peter Harris . 2004. Trust and Mistrust of Online Health Sites. In Proceedings of the 22nd ACM International Conference on on Human Factors in Computing Systems (CHI 2004). ACM, 663--670.

Digital Library

[23]

Ryen W White, Susan T Dumais, and Jaime Teevan . 2009. Characterizing the Influence of Domain Expertise on Web Search Behavior Proceedings of the 2nd ACM International Conference on Web Searcn and Data Mining (WSDM 2009). ACM, 132--141.

Digital Library

[24]

Ryen W White and Eric Horvitz . 2015. Belief Dynamics and Biases in Web Search. ACM Transactions on Information Systems Vol. 33, 4 (2015), 1--46.

Digital Library

[25]

Yusuke Yamamoto and Satoshi Shimada . 2016. Can Disputed Topic Suggestion Enhance User Consideration of Information Credibility in Web Search?. In Proceedings of the 27th ACM Conference on Hypertext and Social Media (HT 2016). ACM, 169--177.

Digital Library

[26]

Yusuke Yamamoto and Katsumi Tanaka . 2011. Enhancing Credibility Judgment of Web Search Results Proceedings of the 29th ACM Conference on Human Factors in Computing Systems (CHI 2011). ACM, 1235--1244.

Digital Library

[27]

Yusuke Yamamoto and Takehiro Yamamoto . 2018. Query Priming for Promoting Critical Thinking in Web Search Proceedings of the 3rd ACM SIGIR Conference on Human Information Interaction and Retrieval (CHIIR 2018) (to appear). ACM, 1--10.

Digital Library

[28]

Yisong Yue, Rajan Patel, and Hein Roehrig . 2010. Beyond Position Bias: Examining Result Attractiveness as a Source of Presentation Bias in Clickthrough Data. In Proceedings of the 19th International World Wide Web Conference (WWW 2010). 1011--1018.

Digital Library

Cited By

Okuse YYamamoto Y(2023)Chatbot to Facilitate Opinion Formation in Web SearchHuman Interface and the Management of Information10.1007/978-3-031-35132-7_43(568-582)Online publication date: 9-Jul-2023
https://doi.org/10.1007/978-3-031-35132-7_43
Zhou MPeng L(2022)English Article Style Recognition and Matching by Using Web SemanticsInternational Journal of Mobile Computing and Multimedia Communications10.4018/IJMCMC.29375113:2(1-13)Online publication date: 14-Jul-2022
https://dl.acm.org/doi/10.4018/IJMCMC.293751
Suzuki MYamamoto Y(2022)Don’t Judge by Looks: Search User Interface to Make Searchers Reflect on Their Relevance Criteria and Promote Content-Quality-Oriented Web SearchesProceedings of the 2022 ACM Conference on Information Technology for Social Good10.1145/3524458.3547222(1-8)Online publication date: 7-Sep-2022
https://dl.acm.org/doi/10.1145/3524458.3547222
Show More Cited By

Index Terms

Web Access Literacy Scale to Evaluate How Critically Users Can Browse and Search for Web Information

Recommendations

Browse with a social web directory
SIGIR '13: Proceedings of the 36th international ACM SIGIR conference on Research and development in information retrieval

Browse with either web directories or social bookmarks is an important complementation to search by keywords in web information retrieval. To improve users' browse experiences and facilitate the web directory construction, in this paper, we propose a ...
Generalization of web log datas using WUM technique
ICNVS'10: Proceedings of the 12th international conference on Networking, VLSI and signal processing

This paper attempts to understand the behavioral patterns of the websites visitors with the aim to create better and effective websites. The behavioral pattern is understood by analyzing the web log files maintained by the respective websites. The ...
Using Appearance Information for Web Information Credibility Analysis
ISUC '08: Proceedings of the 2008 Second International Symposium on Universal Communication

We have been developing a Web informationanalysis system named WISDOM, which supportshuman judgment of information credibility byanalyzing Web pages based on various criteria such asthe sender, content, and appearance. This paperdescribes use of ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

WebSci '18: Proceedings of the 10th ACM Conference on Web Science

May 2018

399 pages

ISBN:9781450355636

DOI:10.1145/3201064

General Chairs:
Hans Akkermans
Vrije Universiteit Amsterdam, The Netherlands
,
Kathy Fontaine
Rensselaer Polytechnic Institute, USA
,
Ivar Vermeulen
Vrije Universiteit Amsterdam, The Netherlands
,
Program Chairs:
Geert-Jan Houben
TU Delft, The Netherlands
,
Matthew S. Weber
Rutgers University, New Jersey, USA

Copyright © 2018 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGWEB: ACM Special Interest Group on Hypertext, Hypermedia, and Web

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 15 May 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

WebSci '18

Sponsor:

SIGWEB

WebSci '18: 10th ACM Conference on Web Science

May 27 - 30, 2018

Amsterdam, Netherlands

Acceptance Rates

WebSci '18 Paper Acceptance Rate 30 of 113 submissions, 27%;

Overall Acceptance Rate 245 of 933 submissions, 26%

Upcoming Conference

Websci '25

Sponsor:
sigweb

17th ACM Web Science Conference

May 20 - 24, 2025

New Brunswick , NJ , USA

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
246
Total Downloads

Downloads (Last 12 months)28
Downloads (Last 6 weeks)4

Reflects downloads up to 25 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Okuse YYamamoto Y(2023)Chatbot to Facilitate Opinion Formation in Web SearchHuman Interface and the Management of Information10.1007/978-3-031-35132-7_43(568-582)Online publication date: 9-Jul-2023
https://doi.org/10.1007/978-3-031-35132-7_43
Zhou MPeng L(2022)English Article Style Recognition and Matching by Using Web SemanticsInternational Journal of Mobile Computing and Multimedia Communications10.4018/IJMCMC.29375113:2(1-13)Online publication date: 14-Jul-2022
https://dl.acm.org/doi/10.4018/IJMCMC.293751
Suzuki MYamamoto Y(2022)Don’t Judge by Looks: Search User Interface to Make Searchers Reflect on Their Relevance Criteria and Promote Content-Quality-Oriented Web SearchesProceedings of the 2022 ACM Conference on Information Technology for Social Good10.1145/3524458.3547222(1-8)Online publication date: 7-Sep-2022
https://dl.acm.org/doi/10.1145/3524458.3547222
Suzuki MYamamoto Y(2021)Characterizing the Influence of Confirmation Bias on Web Search BehaviorFrontiers in Psychology10.3389/fpsyg.2021.77194812Online publication date: 6-Dec-2021
https://doi.org/10.3389/fpsyg.2021.771948
Saito FYamamoto Y(2021)Weasel Finder: Highlighting Ambiguous Sentences for Promoting Critical Web BrowsingWeasel Finder:文章表現の曖昧さ指摘による批判的なウェブ情報探索の促進Transactions of the Japanese Society for Artificial Intelligence10.1527/tjsai.36-1_WI2-H36:1(WI2-H_1-13)Online publication date: 1-Jan-2021
https://doi.org/10.1527/tjsai.36-1_WI2-H
Hamajima SYamamoto TOhshima H(2021)Investigating Users' Query Formulations in Consumer Health Search2021 10th International Congress on Advanced Applied Informatics (IIAI-AAI)10.1109/IIAI-AAI53430.2021.00066(376-381)Online publication date: Jul-2021
https://doi.org/10.1109/IIAI-AAI53430.2021.00066
Suzuki MYamamoto Y(2020)Analysis of Relationship between Confirmation Bias and Web Search BehaviorProceedings of the 22nd International Conference on Information Integration and Web-based Applications & Services10.1145/3428757.3429086(184-191)Online publication date: 30-Nov-2020
https://dl.acm.org/doi/10.1145/3428757.3429086
Yamamoto YYamamoto THuang RWu DMarchionini GHe DCunningham SHansen P(2020)Personalization Finder: A Search Interface for Identifying and Self-controlling Web Search PersonalizationProceedings of the ACM/IEEE Joint Conference on Digital Libraries in 202010.1145/3383583.3398519(37-46)Online publication date: 1-Aug-2020
https://dl.acm.org/doi/10.1145/3383583.3398519
Pothirattanachaikul SYamamoto TYamamoto YYoshikawa MSalter ABarber JGadiraju U(2020)Analyzing the Effects of "People also ask" on Search Behaviors and BeliefsProceedings of the 31st ACM Conference on Hypertext and Social Media10.1145/3372923.3404786(101-110)Online publication date: 13-Jul-2020
https://dl.acm.org/doi/10.1145/3372923.3404786
Pothirattanachaikul SYamamoto TYamamoto YYoshikawa MZhu WTao DCheng XCui PRundensteiner ECarmel DHe QXu Yu J(2019)Analyzing the Effects of Document's Opinion and Credibility on Search Behaviors and Belief DynamicsProceedings of the 28th ACM International Conference on Information and Knowledge Management10.1145/3357384.3357886(1653-1662)Online publication date: 3-Nov-2019
https://dl.acm.org/doi/10.1145/3357384.3357886
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten