research-article

Teaching the Information Retrieval Process Using a Web-Based Environment and Game Mechanics

Authors:

Thomas Wilhelm-Stein,

Maximilian EiblAuthors Info & Claims

SIGIR '17: Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval

Pages 1293 - 1296

https://doi.org/10.1145/3077136.3084143

Published: 07 August 2017 Publication History

Abstract

Predicting the performance of individual components of information retrieval systems, in particular the complex interactions between those components, is still challenging. Therefore, professionals are needed for the implementation and configuration of retrieval systems and retrieval components. Our web-based application, called Xtrieval Web Lab, enables newcomers and learners to gain practical knowledge about the information retrieval process. They can arrange a multitude of components of retrieval systems and evaluate them with real world data without utilizing a programming language. Game mechanics guide the learners in their discovery process and motivate them.

References

[1]

Pável Calado, Ana Cardoso-Cachopo, and Arlindo L. Oliveira. 2007. IR-BASE: An Integrated Framework for the Research and Teaching of Information Retrieval Technologies. In Proceedings of the First International Conference on Teaching and Learning of Information Retrieval (TLIR'07). BCS Learning & Development Ltd., Swindon, UK, 2--2. http://dl.acm.org/citation.cfm?id=2228236.2228238

[2]

W. Bruce Croft, Donald Metzler, and Trevor Strohmann. 2010. Search engines. Pearson Education.

[3]

Efthimis N. Efthimiadis, Jamie Callan, and Ray R. Larson. 2007. Approaches to teaching & learning information retrieval. Proceedings of the American Society for Information Science and Technology 44, 1 (2007), 1--3.

[4]

Efthimis N. Efthimiadis and Nathan G. Freier. 2007. IR-Toolbox: An Experiential Learning Tool for Teaching IR. In Proceedings of the 30th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '07). ACM, New York, NY, USA, 914--914.

Digital Library

[5]

Hui Fang, Hao Wu, Peilin Yang, and ChengXiang Zhai. 2014. VIRLab: A Web-based Virtual Lab for Learning and Studying Information Retrieval Models. In Proceedings of the 37th International ACM SIGIR Conference on Research & Development in Information Retrieval (SIGIR '14). ACM, New York, NY, USA, 1249--1250.

Digital Library

[6]

J. M. Fernandez-Luna, J. F. Huete, J. C. Rodríguez-Cano, and M. C. Rodríguez. 2012. Teaching and learning information retrieval based on a visual and interactive tool: Sulair. In EDULEARN12 Proceedings. IATED, 6634--6642.

[7]

Michael Grubinger, Paul Clough, Henning Müller, and Thomas Deselaers. The IAPR TC-12 Benchmark: A New Evaluation Resource for Visual Information Systems. In OntoImage 2006 Workshop on Language Resources for Content-based Image Retrieval during LREC 2006 Final Programme.

[8]

David G. Hendry. 2007. History Places: A Case Study for Relational Database and Information Retrieval System Design. J. Educ. Resour. Comput. 7, 1, Article 3 (March 2007).

Digital Library

[9]

Ian G. Hendry, Peter Willett, and Frances E. Wood. 1986. INSTRUCT: a teaching package for experimental methods in information retrieval. Part I. The users view. Program 20, 3 (1986), 245--263. arXiv: http://dx.doi.org/10.1108/eb046940

[10]

Ian G. Hendry, Peter Willett, and Frances E. Wood. 1986. INSTRUCT: a teaching package for experimental methods in information retrieval. Part II. Computational aspects. Program 20, 4 (1986), 382--393. arXiv: http://dx.doi.org/10.1108/eb046949

Digital Library

[11]

Seikyung Jung and Joseph Lawrance. 2011. Web Information Retrieval and Filtering Course to Undergraduates Using Open Source Programming. ACM Inroads 2, 3 (Aug. 2011), 47--50.

Digital Library

[12]

Diana Jurjević, Nando Stcklin, and Werner Hartmann. 2009. Informationskompetenz: ein Thema fur den Informatikunterricht. Lecture Notes in Informatics (2009).

[13]

Jens Kürsten. 2012. A Generic Approach to Component-Level Evaluation in Information Retrieval. (2012).

[14]

Jens Kürsten, Thomas Wilhelm, and Maximilian Eibl. 2008. Extensible retrieval and evaluation framework: Xtrieval. In LWA 2008: Lernen - Wissen - Adaption, Wuttrzburg, October 2008, Workshop Proceedings.

[15]

Rafael López-García and Fidel Cacheda. 2011. A Technical Approach to Information Retrieval Pedagogy. Springer Berlin Heidelberg, Berlin, Heidelberg, 89--105.

[16]

Frank McCown. 2010. Teaching Web Information Retrieval to Undergraduates. In Proceedings of the 41st ACM Technical Symposium on Computer Science Education (SIGCSE '10). ACM, New York, NY, USA, 87--91.

Digital Library

[17]

Masnizah Mohd. 2011. Development of Search Engines using Lucene: An Experience. Procedia - Social and Behavioral Sciences 18 (2011), 282--286.

[18]

Iadh Ounis, Gianni Amati, Vassilis Plachouras, Ben He, Craig Macdonald, and Christina. 2006. Terrier: A High Performance and Scalable Information Retrieval Platform. In In Proceedings of ACM SIGIR'06 Workshop on Open Source Information Retrieval (OSIR 2006).

[19]

Ian Ruthven, David Elsweiler, and Emma Nicol. 2008. Designing for users: an holistic approach to teaching information retrieval. In Second International Workshop on Teaching and Learning of Information Retrieval (TLIR 2008).

[20]

Gerard Salton. 1991. The Smart Document Retrieval Project. In Proceedings of the 14th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '91). ACM, New York, NY, USA, 356--358.

Digital Library

[21]

Eero Sormunen, Sakari Hokkanen, Petteri Kangaslampi, Petri Pyy, and Bemmu Sepponen. 2002. Query Performance Analyser: A Web-based Tool for IR Research and Instruction. In Proceedings of the 25th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '02). ACM, New York, NY, USA, 450--450.

Digital Library

[22]

Eero Sormunen, Juha Laaksonen, Heikki Keskustalo, Jaana Keklinen, Harri Laitinen, Ari Pirkola, and Kalervo Jrvelin. 1998. IR Game: a tool for rapid query analysis in cross-language IR experiments. In Singapore: Kent Ridge Digital Labs. 22--32.

Cited By

Fröbe MScells HElstner TAkiki CGienapp LReimer JMacAvaney SStein BHagen MPotthast MHui Yang GWang HHan SHauff CZuccon GZhang Y(2024)Resources for Combining Teaching and Research in Information Retrieval CourseworkProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657886(1115-1125)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.1145/3626772.3657886
Bobić AGütl CCheong C(2020)Infret: Preliminary Findings of a Tool for Explorative Learning of Information Retrieval ConceptsCross Reality and Data Science in Engineering10.1007/978-3-030-52575-0_70(849-865)Online publication date: 20-Aug-2020
https://doi.org/10.1007/978-3-030-52575-0_70

Recommendations

Anserini: Enabling the Use of Lucene for Information Retrieval Research

SIGIR '17: Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval

Software toolkits play an essential role in information retrieval research. Most open-source toolkits developed by academics are designed to facilitate the evaluation of retrieval models over standard test collections. Efforts are generally directed ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGIR '17: Proceedings of the 40th International ACM SIGIR Conference on Research and Development in Information Retrieval

August 2017

1476 pages

ISBN:9781450350228

DOI:10.1145/3077136

General Chairs:
Noriko Kando
National Institute of Informatics
,
Tetsuya Sakai
Waseda University
,
Hideo Joho
University of Tsukuba
,
Program Chairs:
Hang Li
Huawei Noah's Ark Lab
,
Arjen P. de Vries
Radboud University
,
Ryen W. White
Microsoft Cortana

Copyright © 2017 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGIR: ACM Special Interest Group on Information Retrieval

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 07 August 2017

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SIGIR '17

Sponsor:

SIGIR

SIGIR '17: The 40th International ACM SIGIR conference on research and development in Information Retrieval

August 7 - 11, 2017

Tokyo, Shinjuku, Japan

Acceptance Rates

SIGIR '17 Paper Acceptance Rate 78 of 362 submissions, 22%;

Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
159
Total Downloads

Downloads (Last 12 months)6
Downloads (Last 6 weeks)1

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Fröbe MScells HElstner TAkiki CGienapp LReimer JMacAvaney SStein BHagen MPotthast MHui Yang GWang HHan SHauff CZuccon GZhang Y(2024)Resources for Combining Teaching and Research in Information Retrieval CourseworkProceedings of the 47th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3626772.3657886(1115-1125)Online publication date: 10-Jul-2024
https://dl.acm.org/doi/10.1145/3626772.3657886
Bobić AGütl CCheong C(2020)Infret: Preliminary Findings of a Tool for Explorative Learning of Information Retrieval ConceptsCross Reality and Data Science in Engineering10.1007/978-3-030-52575-0_70(849-865)Online publication date: 20-Aug-2020
https://doi.org/10.1007/978-3-030-52575-0_70

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten