Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/3197026.3197054acmconferencesArticle/Chapter ViewAbstractPublication PagesjcdlConference Proceedingsconference-collections
research-article

Contextualised Browsing in a Digital Library's Living Lab

Published: 23 May 2018 Publication History

Abstract

Contextualisation has proven to be effective in tailoring search results towards the users' information need. While this is true for a basic query search, the usage of contextual session information during exploratory search especially on the level of browsing has so far been underexposed in research. In this paper, we present two approaches that contextualise browsing on the level of structured metadata in a Digital Library (DL), (1) one variant bases on document similarity and (2) one variant utilises implicit session information, such as queries and different document metadata encountered during the session of a users. We evaluate our approaches in a living lab environment using a DL in the social sciences and compare our contextualisation approaches against a non-contextualised approach. For a period of more than three months we analysed 47,444 unique retrieval sessions that contain search activities on the level of browsing. Our results show that a contextualisation of browsing significantly outperforms our baseline in terms of the position of the first clicked item in the result set. The mean rank of the first clicked document (measured as mean first relevant - MFR) was 4.52 using a non-contextualised ranking compared to 3.04 when re-ranking the result lists based on similarity to the previously viewed document. Furthermore, we observed that both contextual approaches show a noticeably higher click-through rate. A contextualisation based on document similarity leads to almost twice as many document views compared to the non-contextualised ranking.

References

[1]
Azhar Alhindi, Udo Kruschwitz, Chris Fox, M Albakour, et al. 2015. Profile-based summarisation for web site navigation. ACM Transactions on Information Systems (TOIS) 33, 1 (2015), 4.
[2]
Leif Azzopardi and Krisztian Balog. 2011. Towards a living lab for information retrieval research and development. In International Conference of the CrossLanguage Evaluation Forum for European Languages. Springer, 26--37.
[3]
Marcia J Bates. 1990. Where should the person stop and the information search interface start? Information Processing &Management 26, 5 (1990), 575--591.
[4]
Nicholas J. Belkin, Daniel Hienert, Philipp Mayr, and Chirag Shah. 2017. Data Requirements for Evaluation of Personalization of Information Retrieval - A Position Paper. In Working Notes of CLEF 2017 - Conference and Labs of the Evaluation Forum. CEUR-WS.org, Dublin, Ireland. http://ceur-ws.org/Vol-1866/ paper_193.pdf
[5]
Paul N Bennett, Ryen W White, Wei Chu, Susan T Dumais, Peter Bailey, Fedor Borisyuk, and Xiaoyuan Cui. 2012. Modeling the impact of short-and long-term behavior on search personalization. In 35th SIGIR conference. ACM, 185--194.
[6]
Zeljko Carevic, Maria Lusky, Wilko van Hoek, and Philipp Mayr. 2017. Investigating exploratory search activities based on the stratagem level in digital libraries. International Journal on Digital Libraries (2017), 1--21. http: //link.springer.com/10.1007/s00799-017-0226--6
[7]
Zeljko Carevic and Philipp Mayr. 2015. Extending search facilities via bibliometricenhanced stratagems. (2015), 40--46. http://ceur-ws.org/Vol-1344/paper5.pdf
[8]
Zeljko Carevic and Philipp Mayr. 2016. Survey on High-level Search Activities based on the Stratagem Level in Digital Libraries. In International Conference on Theory and Practice of Digital Libraries. Springer, 54--66. http://link.springer. com/10.1007/978--3--319--43997--6_5
[9]
David Ellis. 1989. A behavioural approach to information retrieval system design. Journal of Documentation 45, 3 (1989), 171--212.
[10]
Jody Condit Fagan. 2010. Usability studies of faceted browsing: A literature review. Information Technology and Libraries 29, 2 (2010), 58.
[11]
Enrique Frias-Martinez, Sherry Y. Chen, and Xiaohui Liu. 2009. Evaluation of a Personalized Digital Library Based on Cognitive Styles: Adaptivity vs. Adaptability. Int. J. Inf. Manag. 29, 1 (Feb. 2009), 48--56.
[12]
Norbert Fuhr. 2017. Some Common Mistakes In IR Evaluation, And How They Can Be Avoided. Technical Report. University of Duisburg-Essen, Germany.
[13]
Marti Hearst. 2009. Search user interfaces. Cambridge University Press.
[14]
Marti A Hearst. 2006. Clustering versus faceted categories for information exploration. Commun. ACM 49, 4 (2006), 59--61.
[15]
Daniel Hienert and Peter Mutschke. 2016. A usefulness-based approach for measuring the local and global effect of IIR services. In Proceedings of the 2016 ACM Conference on Human Information Interaction and Retrieval. ACM, 153--162.
[16]
Daniel Hienert, Frank Sawitzki, and Philipp Mayr. 2015. Digital library research in action: supporting information retrieval in Sowiport. D-Lib Magazine 21, 3 (2015), 8.
[17]
Thorsten Joachims et al. 2003. Evaluating Retrieval Performance Using Clickthrough Data. (2003).
[18]
Evangelos Kanoulas, Ben Carterette, Mark Hall, Paul Clough, and Mark Sanderson. 2011. Overview of the TREC 2011 Session Track. In TREC 2011. NIST.
[19]
Carl Lagoze, Dean B. Kraft, Sandy Payette, and Susan Jesuroga. 2005. What Is a Digital Library Anyway?: Beyond Search and Access in the NSDL. D-Lib Magazine 11, 11 (Nov. 2005).
[20]
Gary Marchionini. 2006. Exploratory search: from finding to understanding. Commun. ACM 49, 4 (2006), 41--46.
[21]
Nicolaas Matthijs and Filip Radlinski. 2011. Personalizing web search using long term browsing history. In Proceedings of the fourth ACM international conference on Web search and data mining. ACM, 25--34.
[22]
Philipp Mayr and Ameni Kacem. 2017. A Complete Year of User Retrieval Sessions in a Social Sciences Academic Search Engine. (2017), 560--565.
[23]
Philipp Mayr and Vivien Petras. 2008. Cross-concordances: terminology mapping and its effectiveness for information retrieval. In 74th IFLA World Library and Information Congress. IFLA, Quebec, Canada. http://www.ifla.org/IV/ifla74/ papers/129-Mayr_Petras-en.pdf
[24]
Nils Pharo, Thomas Beckers, Ragnar Nordlie, and Norbert Fuhr. 2011. Overview of the INEX 2010 Interactive Track. 227--235.
[25]
M.Elena Renda and Umberto Straccia. 2005. A personalized collaborative Digital Library environment: a model and an application. Information Processing &Management 41, 1 (Jan. 2005), 5--21.
[26]
Ian Ruthven, Mounia Lalmas, and Keith Van Rijsbergen. 2003. Incorporating user search behavior into relevance feedback. Journal of the Association for Information Science and Technology 54, 6 (2003), 529--549.
[27]
Anna Sepliarskaia, Filip Radlinski, and Maarten de Rijke. 2017. Simple Personalized Search Based on Long-Term Behavioral Signals. In European Conference on Information Retrieval. Springer, 95--107.
[28]
Xuehua Shen, Bin Tan, and ChengXiang Zhai. 2005. Context-sensitive information retrieval using implicit feedback. In 28th SIGIR conference. ACM, 43--50.
[29]
Alan F. Smeaton and Jamie Callan. 2005. Personalisation and recommender systems in digital libraries. International Journal on Digital Libraries 5, 4 (01 Aug 2005), 299--308.
[30]
Jaime Teevan, Daniel J Liebling, and Gayathri Ravichandran Geetha. 2011. Understanding and predicting personal navigation. In Proceedings of the fourth ACM international conference on Web search and data mining. ACM, 85--94.
[31]
Ryen White, Joemon Jose, C van Rijsbergen, and Ian Ruthven. 2004. A simulated study of implicit feedback models. Advances in Information Retrieval (2004), 311--326.
[32]
Ryen W White, Wei Chu, Ahmed Hassan, Xiaodong He, Yang Song, and Hongning Wang. 2013. Enhancing personalized search by mining and modeling task behavior. In 22nd international conference on World Wide Web. ACM, 1411--1420.
[33]
Ryen W White and Steven M Drucker. 2007. Investigating behavioral variability in web search. In Proceedings of the 16th international conference on World Wide Web. ACM, 21--30.
[34]
Ryen W White, Joemon M Jose, and Ian Ruthven. 2002. Comparing explicit and implicit feedback techniques for web retrieval: Trec-10 interactive track report. In Proceedings of the Tenth Text Retrieval Conference (TREC-10). 534--538.

Cited By

View all
  • (2024)Retrievability in an integrated retrieval system: an extended studyInternational Journal on Digital Libraries10.1007/s00799-023-00363-425:2(287-301)Online publication date: 1-Jun-2024
  • (2022)Studying retrievability of publications and datasets in an integrated retrieval systemProceedings of the 22nd ACM/IEEE Joint Conference on Digital Libraries10.1145/3529372.3530931(1-9)Online publication date: 20-Jun-2022
  • (2021)ConSTR: A Contextual Search Term Recommender2021 ACM/IEEE Joint Conference on Digital Libraries (JCDL)10.1109/JCDL52503.2021.00042(295-296)Online publication date: Sep-2021
  • Show More Cited By

Index Terms

  1. Contextualised Browsing in a Digital Library's Living Lab

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    JCDL '18: Proceedings of the 18th ACM/IEEE on Joint Conference on Digital Libraries
    May 2018
    453 pages
    ISBN:9781450351782
    DOI:10.1145/3197026
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 23 May 2018

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. browsing
    2. context
    3. interactive information retrieval
    4. searching
    5. stratagems

    Qualifiers

    • Research-article

    Funding Sources

    • DFG

    Conference

    JCDL '18
    Sponsor:

    Acceptance Rates

    JCDL '18 Paper Acceptance Rate 26 of 71 submissions, 37%;
    Overall Acceptance Rate 415 of 1,482 submissions, 28%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)5
    • Downloads (Last 6 weeks)2
    Reflects downloads up to 31 Dec 2024

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Retrievability in an integrated retrieval system: an extended studyInternational Journal on Digital Libraries10.1007/s00799-023-00363-425:2(287-301)Online publication date: 1-Jun-2024
    • (2022)Studying retrievability of publications and datasets in an integrated retrieval systemProceedings of the 22nd ACM/IEEE Joint Conference on Digital Libraries10.1145/3529372.3530931(1-9)Online publication date: 20-Jun-2022
    • (2021)ConSTR: A Contextual Search Term Recommender2021 ACM/IEEE Joint Conference on Digital Libraries (JCDL)10.1109/JCDL52503.2021.00042(295-296)Online publication date: Sep-2021
    • (2019)Report on the DATAACM SIGIR Forum10.1145/3308774.330879452:2(117-124)Online publication date: 17-Jan-2019
    • (2019)Online Evaluations for Everyone: Mr. DLib’s Living Lab for Scholarly RecommendationsAdvances in Information Retrieval10.1007/978-3-030-15719-7_27(213-219)Online publication date: 7-Apr-2019
    • (2018)DATAThe 41st International ACM SIGIR Conference on Research & Development in Information Retrieval10.1145/3209978.3210195(1419-1422)Online publication date: 27-Jun-2018
    • (2018)Analysis of search stratagem utilisationScientometrics10.1007/s11192-018-2821-8116:2(1383-1400)Online publication date: 1-Aug-2018

    View Options

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media