Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/2064227.2064256acmconferencesArticle/Chapter ViewAbstractPublication PagescikmConference Proceedingsconference-collections
research-article

PatOlympics: an infrastructure for interactive evaluation of patent retrieval tools

Published: 28 October 2011 Publication History

Abstract

We present PatOlympics - the interactive evaluation campaign organized by the Information Retrieval Facility in the context of its yearly symposium. In particular, we focus in this paper on the infrastructure behind the event. This infrastructure, consisting of a relational database back-end, a Java processing core and JavaScript interface, makes it possible for real users and IR researchers to interact in an exciting, competitive environment, while maintaining, to the extent possible, the evaluation procedures of standard IR campaigns.

References

[1]
M. Lupu, J. Huang, J. Zhu, and J. Tait. TREC Chemical Information Retrieval - An Evaluation Effort for Chemical IR Systems. WPI Journal, 2011.
[2]
H. Nanba, A. Fujii, M. Iwayama, and T. Hashimoto. Overview of the Patent Retrieval Task at the NTCIR-8 Workshop. In Proc. of NTCIR-8, 2010.
[3]
F. Piroi and J. Tait. Clef-ip 2010: Retrieval experiments in the intellectual property domain. In Proc. of CLEF, 2010.
[4]
B. Rowe, D. Wood, A. Link, and D. Simoni. Economic Impact Assessment of NIST's Text REtrieval Conference (TREC) Program. Technical report, National Institute of Standards and Technology, 2010.

Cited By

View all

Index Terms

  1. PatOlympics: an infrastructure for interactive evaluation of patent retrieval tools

      Recommendations

      Comments

      Information & Contributors

      Information

      Published In

      cover image ACM Conferences
      DESIRE '11: Proceedings of the 2011 workshop on Data infrastructurEs for supporting information retrieval evaluation
      October 2011
      44 pages
      ISBN:9781450309523
      DOI:10.1145/2064227
      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Sponsors

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      Published: 28 October 2011

      Permissions

      Request permissions for this article.

      Check for updates

      Author Tags

      1. interaction
      2. patent retrieval
      3. patolympics
      4. user evaluation

      Qualifiers

      • Research-article

      Conference

      CIKM '11
      Sponsor:

      Upcoming Conference

      CIKM '25

      Contributors

      Other Metrics

      Bibliometrics & Citations

      Bibliometrics

      Article Metrics

      • Downloads (Last 12 months)1
      • Downloads (Last 6 weeks)0
      Reflects downloads up to 05 Jan 2025

      Other Metrics

      Citations

      Cited By

      View all

      View Options

      Login options

      View options

      PDF

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader

      Media

      Figures

      Other

      Tables

      Share

      Share

      Share this Publication link

      Share on social media