research-article

Workshop on Barriers to Interactive IR Resources Re-use

Authors:

Mette SkovAuthors Info & Claims

CHIIR '18: Proceedings of the 2018 Conference on Human Information Interaction & Retrieval

Pages 382 - 385

https://doi.org/10.1145/3176349.3176901

Published: 01 March 2018 Publication History

Get Access

Abstract

The goal of this workshop is to serve as a starting point for a community-driven effort to design and implement a platform for the collection, organization, maintenance, and sharing of resources for IIR experimentation. As in all scientific endeavors, progress in IIR research is contingent on the ability to build on previous ideas, approaches, and resources. However, we believe there to be a number of barriers to reproducibility and re-use of resources in IIR research: the fragmentary nature of how the community»s resources are organized, the lack of awareness of their existence, documentation and organization of the resources, the nature of the typical research publication cycle, and the effort required to make such resources available. We believe that an online platform dedicated to the collection and organization of IIR resources could be a promising way of overcoming these barriers. The workshop therefore aims to serve both as a brainstorming opportunity about the shape this iRepository should take, as well as a way of building support in the community for its implementation.

References

[1]

Nicholas Belkin, Toine Bogers, Jaap Kamps, Diane Kelly, Marijn Koolen, and Emine Yilmaz. 2017. Second Workshop on Supporting Complex Search Tasks. In Proceedings of the 2017 Conference on Conference Human Information Interaction and Retrieval (CHIIR '17). ACM, New York, NY, USA, 433--435.

Digital Library

Google Scholar

[2]

Pia Borlund. 2016. Interactive Information Retrieval: An Evaluation Perspective. In CHIIR '16: Proceedings of the 2016 ACM on Conference on Human Information Interaction and Retrieval. ACM, New York, NY, USA, 151--151.

Digital Library

Google Scholar

[3]

Luanne Freund and Barbara M. Wildemuth. 2014. Documenting and studying the use of assigned search tasks: RepAST. Proceedings of the American Society for Information Science and Technology 51, 1 (2014), 1--4.

Crossref

Google Scholar

[4]

Maria Gäde, Mark M. Hall, Hugo Huurdeman, Jaap Kamps, Marijn Koolen, Mette Skove, Elaine Toms, and David Walsh. 2015. Report on the First Workshop on Supporting Complex Search Tasks. SIGIR Forum 49, 1 (June 2015), 50--56.

Digital Library

Google Scholar

[5]

Maria Gäde, Mark Michael Hall, Hugo C. Huurdeman, Jaap Kamps, Marijn Koolen, Mette Skov, Toine Bogers, and David Walsh. 2016. Overview of the SBS 2016 Interactive Track. In Working Notes of the CLEF 2016 Conference (CEUR Workshop Proceedings), Krisztian Balog, Linda Cappellato, Nicola Ferro, and Craig Macdonald (Eds.), Vol. 1609. CEUR-WS.org, 1024--1038.

Google Scholar

[6]

Maria Gäde, Mark Michael Hall, Hugo C. Huurdeman, Jaap Kamps, Marijn Koolen, Mette Skov, Elaine Toms, and David Walsh. 2015. Overview of the SBS 2015 Interactive Track. In Working Notes of the CLEF 2015 Conference (CEUR Workshop Proceedings), Linda Cappellato, Nicola Ferro, Gareth J. F. Jones, and Eric SanJuan (Eds.), Vol. 1391. CEUR-WS.org.

Google Scholar

[7]

Mark Michael Hall, Hugo C. Huurdeman, Marijn Koolen, Mette Skov, and David Walsh. 2014. Overview of the INEX 2014 Interactive Social Book Search Track. In Working Notes of the CLEF 2014 Conference (CEUR Workshop Proceedings), Linda Cappellato, Nicola Ferro, Martin Halvey, and Wessel Kraaij (Eds.), Vol. 1180. CEUR-WS.org, 480--493.

Google Scholar

[8]

Diane Kelly. 2009. Methods for Evaluating Interactive Information Retrieval Systems with Users. Foundations and Trends in Information Retrieval 3, 1--2 (2009), 1--224.

Digital Library

Google Scholar

[9]

Diane Kelly and Cassidy R Sugimoto. 2013. A Systematic Review of Interactive Information Retrieval Evaluation Studies, 1967--2006. Journal of the American Society for Information Science and Technology 64, 4 (2013), 745--770.

Crossref

Google Scholar

[10]

Paul Over. 2001. The TREC interactive track: an annotated bibliography. Information Processing&Management 37, 3 (2001), 369--381. Interactivity at the Text Retrieval Conference (TREC).

Digital Library

Google Scholar

[11]

Paul Over. 2001. The TREC Interactive Track: An Annotated Bibliography. Information Processing&Management 37, 3 (2001), 369--381.

Digital Library

Google Scholar

[12]

Nils Pharo, Thomas Beckers, Ragnar Nordlie, and Norbert Fuhr. 2011. Overview of the INEX 2010 Interactive Track. In INEX '10: Proceedings of the Ninth International Workshop of the Initiative for the Evaluation of XML Retrieval, Shlomo Geva, Jaap Kamps, Ralf Schenkel, and Andrew Trotman (Eds.). Springer, Berlin, Heidelberg, 227--235.

Digital Library

Google Scholar

[13]

Anastasios Tombros, Birger Larsen, and Saadia Malik. 2005. The Interactive Track at INEX 2004. In INEX '04: Proceedings of the Third International Workshop of the Initiative for the Evaluation of XML Retrieval, Norbert Fuhr, Mounia Lalmas, Saadia Malik, and Zoltán Szlávik (Eds.). Springer, Berlin, Heidelberg, 410--423.

Digital Library

Google Scholar

[14]

Elaine G. Toms and Mark M. Hall. 2013. The CHiC Interactive Task (CHiCi) at CLEF 2013. In Working Notes of the CLEF 2013 Conference (CEUR Workshop Proceedings), Pamela Forner, Roberto Navigli, Dan Tufis, and Nicola Ferro (Eds.), Vol. 1179. CEUR-WS.org

Google Scholar

Cited By

View all

Bogers TDodson SFreund LGäde MHall MKoolen MPetras VPharo NSkov MAzzopardi LHalvey MRuthven IJoho HMurdock VQvarfordt P(2019)Workshop on Barriers to Interactive IR Resources Re-use (BIIRRR 2019)Proceedings of the 2019 Conference on Human Information Interaction and Retrieval10.1145/3295750.3298965(389-392)Online publication date: 8-Mar-2019
https://dl.acm.org/doi/10.1145/3295750.3298965
Bogers TGäde MMichael MFreund LKoolen MPetras VSkov M(2018)Report on the Workshop on Barriers to Interactive IR Resources Re-use (BIIRRR 2018)ACM SIGIR Forum10.1145/3274784.327479552:1(119-128)Online publication date: 31-Aug-2018
https://dl.acm.org/doi/10.1145/3274784.3274795

Index Terms

Workshop on Barriers to Interactive IR Resources Re-use
1. Information systems
  1. Information retrieval
    1. Users and interactive retrieval

Recommendations

Model-Based Reuse Repositories - Concepts and Experience
CASE '95: Proceedings of the Seventh International Workshop on Computer-Aided Software Engineering

Reuse repositories provide a wide range of assets that software engineers can use in developing systems to reduce the need for continual development of components that provide the same functionality. Most current reuse repositories are component-based; ...
A case for on-machine load balancing

This paper diverges from the traditional load balancing, and introduces a new principle called the on-machine load balance rule. The on-machine load balance rule leads to resource allocations that are better in tolerating uncertainties in the processing ...
Repositories of teaching material and communities of use: nifty assignments and the greenroom
ICER '10: Proceedings of the Sixth international workshop on Computing education research

Teaching material can be time-consuming and difficult to develop, even for those with experience. Teaching repositories permit the sharing of material and can thus potentially save time and enable re-use of good material. Many teaching repositories have ...

Comments

Information & Contributors

Information

Published In

CHIIR '18: Proceedings of the 2018 Conference on Human Information Interaction & Retrieval

March 2018

402 pages

ISBN:9781450349253

DOI:10.1145/3176349

General Chairs:
Chirag Shah
Rutgers University, USA
,
Nicholas J. Belkin
Rutgers University, USA
,
Program Chairs:
Katriina Byström
Oslo Metropolitan University, Norway
,
Jeff Huang
Brown University, USA
,
Falk Scholer
RMIT University, Australia

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

In-Cooperation

SIGCHI: ACM Special Interest Group on Computer-Human Interaction

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 March 2018

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

CHIIR '18

Sponsor:

SIGIR

CHIIR '18: Conference on Human Information Interaction and Retrieval

March 11 - 15, 2018

NJ, New Brunswick, USA

Acceptance Rates

CHIIR '18 Paper Acceptance Rate 22 of 57 submissions, 39%;

Overall Acceptance Rate 55 of 163 submissions, 34%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
93
Total Downloads

Downloads (Last 12 months)3
Downloads (Last 6 weeks)1

Reflects downloads up to 13 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Bogers TDodson SFreund LGäde MHall MKoolen MPetras VPharo NSkov MAzzopardi LHalvey MRuthven IJoho HMurdock VQvarfordt P(2019)Workshop on Barriers to Interactive IR Resources Re-use (BIIRRR 2019)Proceedings of the 2019 Conference on Human Information Interaction and Retrieval10.1145/3295750.3298965(389-392)Online publication date: 8-Mar-2019
https://dl.acm.org/doi/10.1145/3295750.3298965
Bogers TGäde MMichael MFreund LKoolen MPetras VSkov M(2018)Report on the Workshop on Barriers to Interactive IR Resources Re-use (BIIRRR 2018)ACM SIGIR Forum10.1145/3274784.327479552:1(119-128)Online publication date: 31-Aug-2018
https://dl.acm.org/doi/10.1145/3274784.3274795

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Model-Based Reuse Repositories - Concepts and Experience

A case for on-machine load balancing

Repositories of teaching material and communities of use: nifty assignments and the greenroom