Article

Free access

Relevance feedback revisited

Author:

Donna HarmanAuthors Info & Claims

SIGIR '92: Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval

June 1992

Pages 1 - 10

https://doi.org/10.1145/133160.133167

Published: 01 June 1992 Publication History

Abstract

Researchers have found relevance feedback to be effective in interactive information retrieval, although few formal user experiments have been made. In order to run a user experiment on a large document collection, experiments were performed at NIST to complete some of the missing links found in using the probabilistic retrieval model. These experiments, using the Cranfield 1400 collection, showed the importance of query expansion in addition to query reweighting, and showed that adding as few as 20 well-selected terms could result in performance improvements of over 100%. Additionally it was shown that performing multiple iterations of feedback is highly effective.

References

[1]

Bookstein A. (1983). Information Retrieval: A Sequential Learning Process. Journal of the American Society for Information Science, 34(5), 331-342.

[2]

Campbell I., Sanderson M. & van Rijsbergen K. (1990). News Retrieval Tool Technical Notes, Glasgow University: Computing Science Department.

[3]

Croft W.B. (1983). Experiments with Representation in a Document Retrieval System. information Technology: Research and Development, 2(1), 1-21.

[4]

Croft W.B. and Harper D.J. (1979). Using Probabilistic Models of Document Retrieval Without Relevance Information. Journal of Documentation, 35(4), 285-295.

[5]

Croft W.B. (1992). Personal communication.

[6]

Doszkocs T.E. (1978). A/D, an Associative Interactive Dictionary for Online Searching. Online Review, 2(2), 163-172.

[7]

Harman D. (1988). Towards Interactive Query Expansion, Paper presented at ACM Conference on Research and Development in Information Retrieval. Grenoble, France.

Digital Library

[8]

Harman D. and Candela G. (1990). Retrieving Records from a Gigabyte of Text on a Minicomputer using Statistical Ranking. Journal of the American Society for Information Science, 41(8), 581-589.

[9]

Harper D.J. (1980). Relevance Feedback in Document Retrieval Systems: An Evaluation of ProbabUistic Strategies. Doctoral Dissertiort, Jesus College, Cambridge, England.

[10]

Harper D.J. and Van Rijsbergen C.J.(1978). An Evaluation of Feedback in Document Retrieval Using Co-Occurrence Data. Journal of Documentation, 34(3), 189-216.

[11]

Ide E. (1971). New Experiments in Relevance Feedback. In Salton G. (Ed.), The SMART Retrieval System (pp. 337-354). Englewood Cliffs, N.J.: Prentice-Hall, inc.

[12]

Lancaster F.W. (1969). MEDLARS: Report on the Evaluation of Its Operating Efficiency. American Documentation, 20(2) 119-148.

[13]

Porter M. & Galpin V. (1988). Relevance Feedback in a Public Access Catalogue for a Research Library: Muscat at the Scott Polar Research Institute. Program, 22(1), 1-20.

Digital Library

[14]

Rocchio J.J. (1971). Relevance Feedback in Information Retrieval. In Salton G. (Ed.), The SMART Retrieval System (pp. 313-323). Englewood Cliffs, N.J.: Prentice-Hall, Inc.

[15]

Robertson S.E. and Sparck Jones K. (1976). Relevance Weighting of Search Terms. Journal of the American Society for Information Science, 27(3), 129-146.

[16]

Robertson S.E. (1990). On Term Selection for Query Expansion. Journal of Documentation, 46(4), 359-364.

Digital Library

[17]

Salton G. (1970). Evaluation Problems in Interactive Information Retrieval. Information Storage and Retrieval, 6(1), 29-44.

[18]

Salton G. (1971). The SMART Retrieval System. Englewood Cliffs, N.J.: Prentice-Hail, Inc.

[19]

Salton G. and Buckley C. (1990). Improving Retrieval Performance by Relevance Feedback. Journal of the American Society for Information Science, 41 (4), 288-297.

[20]

Smeaton A.F. and van Rijsbergen C.J. (1983). The Retrieval Effects of Query Expansion on a Feedback Document Retrieval System. The Computer Journal, 26(3), 239-246. 1988.

[21]

Sparck Jones K. (1979). Search Term Relevance Weighting Given Little Relevance Information. Journal of Documentation, 35(1), 30-48.

[22]

van Rijsbergen C.J. (1986). A New Theoretical Framework For Information Retrieval, Paper presented at ACM Conference on Research and Development in Information Retrieval. Pisa, Italy.

Digital Library

[23]

Wu H. and Salton G. (1981). The Estimation of Term Relevance Weights using Relevance Feedback. Journal of Documentation, 37(4), 194-214.

Cited By

Balog KZhai CChua TNgo CKa-Wei Lee RKumar RLauw H(2024)Tutorial on User Simulation for Evaluating Information Access Systems on the WebCompanion Proceedings of the ACM on Web Conference 202410.1145/3589335.3641243(1254-1257)Online publication date: 13-May-2024
https://dl.acm.org/doi/10.1145/3589335.3641243
Chandra GDwivedi S(2024)Query Expansion Using Proposed Location-Based Algorithm for Hindi–English CLIR: Analyzing Three Test CollectionsInternational Journal of Pattern Recognition and Artificial Intelligence10.1142/S021800142459001838:05Online publication date: 11-May-2024
https://doi.org/10.1142/S0218001424590018
Ye ZXie XAi QLiu YWang ZSu WZhang M(2023)Relevance Feedback with Brain SignalsACM Transactions on Information Systems10.1145/363787442:4(1-37)Online publication date: 18-Dec-2023
https://dl.acm.org/doi/10.1145/3637874
Show More Cited By

Index Terms

Relevance feedback revisited
1. Human-centered computing
  1. Human computer interaction (HCI)
2. Information systems
  1. Information retrieval
    1. Information retrieval query processing
    2. Retrieval models and ranking

Recommendations

Re-examining the effects of adding relevance information in a relevance feedback environment

This paper presents an investigation about how to automatically formulate effective queries using full or partial relevance information (i.e., the terms that are in relevant documents) in the context of relevance feedback (RF). The effects of adding ...
Read More
Relevance feedback: a power tool for interactive content-based image retrieval

Content-based image retrieval (CBIR) has become one of the most active research areas in the past few years. Many visual feature representations have been explored and many systems built. While these research efforts establish the basis of CBIR, the ...
Read More
Relevance Feedback Fusion via Query Expansion
WI-IAT '12: Proceedings of the The 2012 IEEE/WIC/ACM International Joint Conferences on Web Intelligence and Intelligent Agent Technology - Volume 03

Relevance Feedback (RF) is an important technique to improve information retrieval and has emerged as one of the hottest topics for both the industry and academic researchers. The performance of RF depends on feedback information. As the volume of ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGIR '92: Proceedings of the 15th annual international ACM SIGIR conference on Research and development in information retrieval

June 1992

352 pages

ISBN:0897915232

DOI:10.1145/133160

Chairman:
Edward Fox
VPI & State Univ., Blacksburg, VA
,
Editors:
Nicholas Belkin
Rutgers Univ., New Brunswick, NJ
,
Peter Ingwersen,
Annelise Mark Pejtersen

Copyright © 1992 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGIR: ACM Special Interest Group on Information Retrieval
Royal School of Lib.: Royal School of Lib.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 June 1992

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Article

Conference

SIGIR92

Sponsor:

SIGIR
Royal School of Lib.

SIGIR92: 15th International ACM/SIGIR Conference on Research & Development in Information Retrieval

June 21 - 24, 1992

Copenhagen, Denmark

Acceptance Rates

Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

231
Total Citations
View Citations
2,745
Total Downloads

Downloads (Last 12 months)128
Downloads (Last 6 weeks)10

Other Metrics

View Author Metrics

Citations

Cited By

Balog KZhai CChua TNgo CKa-Wei Lee RKumar RLauw H(2024)Tutorial on User Simulation for Evaluating Information Access Systems on the WebCompanion Proceedings of the ACM on Web Conference 202410.1145/3589335.3641243(1254-1257)Online publication date: 13-May-2024
https://dl.acm.org/doi/10.1145/3589335.3641243
Chandra GDwivedi S(2024)Query Expansion Using Proposed Location-Based Algorithm for Hindi–English CLIR: Analyzing Three Test CollectionsInternational Journal of Pattern Recognition and Artificial Intelligence10.1142/S021800142459001838:05Online publication date: 11-May-2024
https://doi.org/10.1142/S0218001424590018
Ye ZXie XAi QLiu YWang ZSu WZhang M(2023)Relevance Feedback with Brain SignalsACM Transactions on Information Systems10.1145/363787442:4(1-37)Online publication date: 18-Dec-2023
https://dl.acm.org/doi/10.1145/3637874
Balog KZhai C(2023)User Simulation for Evaluating Information Access SystemsProceedings of the Annual International ACM SIGIR Conference on Research and Development in Information Retrieval in the Asia Pacific Region10.1145/3624918.3629549(302-305)Online publication date: 26-Nov-2023
https://dl.acm.org/doi/10.1145/3624918.3629549
Rahman MRoy C(2023)A Systematic Review of Automated Query Reformulations in Source Code SearchACM Transactions on Software Engineering and Methodology10.1145/360717932:6(1-79)Online publication date: 4-Jul-2023
https://dl.acm.org/doi/10.1145/3607179
Balog KZhai CFrommholz IHopfgartner FLee MOakes MLalmas MZhang MSantos R(2023)Tutorial on User Simulation for Evaluating Information Access SystemsProceedings of the 32nd ACM International Conference on Information and Knowledge Management10.1145/3583780.3615296(5200-5203)Online publication date: 21-Oct-2023
https://dl.acm.org/doi/10.1145/3583780.3615296
Sheetrit ERaiber FKurland OYoshioka MKiseleva JAliannejadi M(2023)Entity-Based Relevance Feedback for Document RetrievalProceedings of the 2023 ACM SIGIR International Conference on Theory of Information Retrieval10.1145/3578337.3605128(177-187)Online publication date: 9-Aug-2023
https://dl.acm.org/doi/10.1145/3578337.3605128
Hamroun MLajmi SJallouli MSouid A(2023)Efficient text-based query based on multi-level and deep-semantic multimedia indexing and retrievalMultimedia Tools and Applications10.1007/s11042-023-17256-y83:18(55811-55850)Online publication date: 30-Nov-2023
https://doi.org/10.1007/s11042-023-17256-y
Sofikitis EMakris C(2022)Development of recommendation systems using game theoretic techniquesComputer Science and Information Systems10.2298/CSIS210925018S19:3(1133-1154)Online publication date: 2022
https://doi.org/10.2298/CSIS210925018S
Ben Ayed ABiskri IMeunier J(2021)An End-to-End Efficient Lucene-Based Framework of Document/Information RetrievalInternational Journal of Information Retrieval Research10.4018/IJIRR.28995012:1(1-14)Online publication date: 19-Oct-2021
https://doi.org/10.4018/IJIRR.289950
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents