article

Searching the web: operator assistance required

Authors:

Wendy LucasAuthors Info & Claims

Information Processing and Management: an International Journal, Volume 41, Issue 2

Pages 383 - 403

https://doi.org/10.1016/S0306-4573(02)00092-4

Published: 01 March 2005 Publication History

Abstract

This study examines the effects of the search interface and Boolean logic training on user search performance and satisfaction. We compared the use of an assisted search tool to that of a simple search interface like those typically found at commercial search engine sites. We found that the assisted search tool had a significant, positive effect on performance, satisfaction, and confidence. Promoting the use of advanced search features is therefore in the best interest of both Web search providers and users. In the absence of an assisted interface, a simple interface coupled with Boolean logic training was also an effective means for improving user performance. Given that most searchers choose to use the simple search box, it is important to provide them with applicable training to promote the effective use of the search tool. Interestingly, coupling the assisted interface with Boolean training was no more effective than either treatment alone.

References

[1]

Allen, B. L. (2001). Boolean browsing in an information system: An experimental test. Information Technology and Libraries, 20(1), 12-20.

[2]

Belkin, N. J. (1984). Cognitive models and information transfer. Social Science Information Studies, 4, 111-129.

[3]

Borgman, C. L. (1986). Why are online catalogs hard to use? Lessons learned from information retrieval studies. Journal of the American Society of Information Science, 37(6), 387-400.

[4]

Catledge, L. D., & Pitkow, J. E. (1995). Characterizing browsing strategies in the WorldWide Web. Paper presented at the Third International World Wide Web Conference, Darmstadt, Germany.

[5]

Chan, H. C., Tan, B. C. Y., & Wei, K. K. (1999). Three important determinants of user performance for database retrieval. International Journal of Human-Computer Studies, 51(5), 895-918.

Digital Library

[6]

Chan, H. C., Wei, K. K., & Siau, K. (1998). The effect of data model, system and task characteristics on user query performance--An empirical study. Database for Advances in Information Systems, 29(1), 31-49.

Digital Library

[7]

Cooper, G. (1990). Cognitive load theory as an aid for instructional design. Australian Journal of Educational Technology, 6(2), 108-113.

[8]

Cooper, W. (1988). Getting beyond Boole. Information Processing and Management, 24, 243-248.

Digital Library

[9]

Finkelstein, L., Gabrilovich, E., Matias, Y., Rivlin, E., Solan, Z., Wolfman, G., & Ruppin, E. (2002). Placing search in context: The concept revisited. ACM Transactions on Information Systems, 20(1), 116-131.

Digital Library

[10]

Goldberg, M. W. (1997). CALOS: First results from an experiment in computer-aided learning. Paper presented at the ACM's 28th SIGCSE Technical Symposium on Computer Science Education.

[11]

Golovchinsky, G. (1997). Queries? Links? Is there a difference? Paper presented at the CHI'97, Atlanta, GA, USA.

[12]

Gordon, M., & Pathak, P. (1999). Finding information on the World Wide Web: The retrieval effectiveness of search engines. Information Processing and Management, 35(2), 141-180.

Digital Library

[13]

Harman, D. (1994). Overview of the Second Text REtrieval Conference (TREC-2), NIST SP 500-215, National Institute of Standards and Technology, Gaithersburg, MD.

[14]

Hersh, W., Turpin, A., Price, S., & Kraemer, D. (2001). Challenging conventional assumptions of automated information retrieval with real users: Boolean searching and batch retrieval evaluations. Information Processing and Management, 37(3), 383-402.

Digital Library

[15]

Hertzum, M., & Frokjaer, E. (1996). Browsing and querying in online documentation: A study of user interfaces and the interaction process. ACM Transactions on Computer-Human Interaction, 3(2), 136-161.

Digital Library

[16]

Hölscher, C. (1998). How Internet experts search for information on the Web. Paper presented at the WebNet98--World Conference of the WWW, Internet Intranet, Charlottesville, VA.

[17]

Hölscher, C., & Strube, G. (2000). Web search behavior of Internet experts and newbies. The International Journal of Computer and Telecommunications Networking, 33(1-6), 337-346.

[18]

Hsieh-Yee, I. (1993). Effects of search experience and subject knowledge on the search tactics of novice and experienced searchers. Journal of the American Society for Information Science, 45(3), 161-174.

[19]

Jansen, B. J. (2000). The effect of query complexity on Web searching results. Information Research: An International Electronic Journal, 6(1).

[20]

Jansen, B. J., & Pooch, U. W. (2001). A review of Web searching studies and a framework for future research. Journal of the American Society of Information Science, 52(3), 235-246.

Digital Library

[21]

Jansen, B. J., & Spink, A. (2000). The excite research project: A study of searching by Web users. Bulletin of the American Society for Information Science, 27(1), 15-17.

[22]

Johnson, B. L., & Szabo, M., (1998). Instruction, gender, search success, and search satisfaction on the World Wide Web: A research study. Paper presented at the World Conference on Multimedia and Hypermedia Edmedial Edtelecom, Freiburg, Germany, June 20-25.

[23]

Kobayashi, M., & Takeda, K. (2000). Information retrieval on the Web. ACM Computing Surveys, 32(2), 144-173.

Digital Library

[24]

Kuhlthau, C. C. (1993). Seeking meaning: A process approach to library and information services. Norwood, NJ: Ablex Publishing.

[25]

Kuhlthau, C. C. (1999). Accommodating the user's information search process: Challenges for information retrieval system designers. Bulletin of the American Society for Information Science, 25(3), 12-16.

[26]

Kwok, C., Etzioni, O., & Weld, D. S. (2001). Scaling question answering to the Web. ACM Transactions on Information Systems, 19(3).

Digital Library

[27]

Leighton, H. V., & Srivastava, J. (1999). First 20 precision among World Wide Web search services (search engines). Journal of the American Society for Information Science, 50(10), 870-881.

Digital Library

[28]

Lucas, W. T., Schiano, W. T., & Crosett, K. (2001). The present and future of Internet search. Communications of the Association for Information Systems, 5(8).

[29]

Lucas, W., & Topi, H. (2002). Form and function: The impact of query term and operator usage on Web search results. Journal of the American Society for Information Science and Technology, 53(2), 95-108.

Digital Library

[30]

Marakas, G. M., Yi, M. Y., & Johnson, R. D. (1998). The multilevel and multifaceted character of computer selfefficacy: Toward clarification of the construct and an integrative framework for research. Information Systems Research, 9(2), 126-163.

Digital Library

[31]

McCollum, K. (1997). A professor divides his class in two to test value of on-line instruction. The Chronicle of Higher Education, 43(24), 23.

[32]

Mischo, W. H., & Lee, J. (1987). End-user searching of bibliographic databases. Annual Review of Information Science and Technology, 22, 227-263.

[33]

Plaisant, C., Shneiderman, B., Doan, K., & Bruns, T. (1999). Interface and data architecture for query preview in networked information systems. ACM Transaction on Information Systems, 17(3), 320-341.

Digital Library

[34]

Pollock, A., & Hockley, A. (1997). What's Wrong with Internet Searching. D-lib magazine, March.

[35]

Rao, R., Pedersen, J., Hearst, M., Mackinlay, J., Card, S., Masinter, L., Halvorsen, P.-K., & Robertson, G. (1995). Rich interaction in the digital library. Communications of the ACM, 38(4), 29-39.

Digital Library

[36]

Saracevic, T. (1996). Modeling interaction in information retrieval (IR): A review and proposal. Paper presented at the American Society for Information Science.

[37]

Shneiderman, B. (1998). Designing the user interface: Strategies for effective human-computer interaction (3rd ed.). Reading, MA.

[38]

Shneiderman, B., Byrd, D., & Croft, W. B. (1998). Sorting out searching: A user-interface framework for text searches. Communications of the ACM, 41(4), 95-98.

Digital Library

[39]

Siegfried, S., Bates, M. J., & Wilde, D. N. (1993). A profile of end-user searching behavior by humanities scholars: The Getty online searching project report no. 2. Journal of the American Society for Information Science, 44(5), 273-291.

[40]

Silverstein, C., Henzinger, M., Marais, J., & Moricz, M. (1999). Analysis of a very large Web search engine query log. SIGIR Forum, 33(1), 6-12.

Digital Library

[41]

Sparck Jones, K., & Willett, P. (Eds.). (1997). Readings in information retrieval. San Francisco, CA: Morgan Kaufmann Publishers, Inc.

[42]

Spink, A., Jansen, B. J., Wolfram, D., & Saracevic, T. (2002). From E-sex to E-commerce: Web search changes. IEEE Computer, 35(3), 107-109.

Digital Library

[43]

Spink, A., Wolfram, D., Jansen, B. J., & Saracevic, T. (2001). Searching the Web: The public and their queries. Journal of the American Society of Information Science, 53(2), 226-234.

[44]

Te'eni, D., & Feldman, R. (2001). Performance and satisfaction in adaptive websites: A laboratory experiment on search tasks within a task-adapted website. Journal of AIS, 2(3).

[45]

Topi, H. (1995). The effects of time availability and task complexity on human performance in database query tasks. Doctoral dissertation, Indiana University, Bloomington, IN, unpublished.

[46]

Turtle, H. (1994). Natural language vs. Boolean query evaluation: A comparison of retrieval performance. Paper presented at the SIGIR'94.

[47]

Venkatesh, V. (2000). Determinants of perceived ease of use: Integrating control, intrinsic motivation, and emotion into the technology acceptance model. Information Systems Research, 11(4), 342-365.

Digital Library

[48]

Wildemuth, B. M., Friedman, C. P., & Downs, S. M. (1998). Hypertext versus Boolean access to biomedical information: A comparison of effectiveness, efficiency, and user preferences. ACM Transactions on Computer-Human Interaction, 5(2), 156-183.

Digital Library

Cited By

Foulonneau MCole THabing TShreeves SMarlino MSumner TShipman F(2005)Using collection descriptions to enhance an aggregation of harvested item-level metadataProceedings of the 5th ACM/IEEE-CS joint conference on Digital libraries10.1145/1065385.1065393(32-41)Online publication date: 7-Jun-2005
https://dl.acm.org/doi/10.1145/1065385.1065393

Recommendations

Mix and match: combining terms and operators for successful web searches

This paper presents a detailed analysis of the structure and components of queries written by experimental participants in a study that manipulated two factors found to affect end-user information retrieval performance: training in Boolean logic and the ...
Hidden Web Resource Discovery through Semantic Understanding of Search Interfaces
ACCT '14: Proceedings of the 2014 Fourth International Conference on Advanced Computing & Communication Technologies

More and more information is being made available on the WWW now-a-days, a wealth of which is contained in web databases hidden behind search form interfaces and is commonly called the Hidden Web or the Deep Web. To acquire this authentic and ...
Don’t Judge by Looks: Search User Interface to Make Searchers Reflect on Their Relevance Criteria and Promote Content-Quality-Oriented Web Searches
GoodIT '22: Proceedings of the 2022 ACM Conference on Information Technology for Social Good

Searchers often judge the webpage quality by the visual appearance, even for tasks where the content quality is more important such as health information. We propose a search user interface (UI) that makes searchers reflect on their webpage selection ...

Comments

Information & Contributors

Information

Published In

cover image Information Processing and Management: an International Journal

Information Processing and Management: an International Journal Volume 41, Issue 2

March 2005

248 pages

ISSN:0306-4573

Issue’s Table of Contents

Publisher

Pergamon Press, Inc.

United States

Publication History

Published: 01 March 2005

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 17 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Foulonneau MCole THabing TShreeves SMarlino MSumner TShipman F(2005)Using collection descriptions to enhance an aggregation of harvested item-level metadataProceedings of the 5th ACM/IEEE-CS joint conference on Digital libraries10.1145/1065385.1065393(32-41)Online publication date: 7-Jun-2005
https://dl.acm.org/doi/10.1145/1065385.1065393

View Options

View options

Media

Figures

Other

Tables

View Issue’s Table of Contents