Article

Context matters: an analysis of assessments of XML documents

Authors:

Nils Pharo,

Ragnar NordlieAuthors Info & Claims

CoLIS'05: Proceedings of the 5th international conference on Context: conceptions of Library and Information Sciences

Pages 238 - 248

https://doi.org/10.1007/11495222_19

Published: 04 June 2005 Publication History

Publisher Site

Abstract

The paper analyses searchers' assessments of usefulness and specificity on different levels of granularity in XML-coded documents. Documents are assessed on 10 usefulness/specificity combinations and on the granularity levels of article, section, and subsection. Overlapping judgements show a remarkable lack of consistency between searchers. There is an inverse relationship between articles and sections both in the assessment of specificity and of usefulness, indicating that retrieval on different granularity levels are a useful feature of a retrieval system. Searchers find the full article more useful when they assess the same document both on the article and section level indicating that there is a need to provide context to the sections and subsections when presenting result list of XML-documents.

References

[1]

Borlund, P.:. Evaluation of interactive information retrieval systems. Åbo: Åbo Akademi University Press (2000)

Google Scholar

[2]

Finesilver, K, Reid, J.: User Behaviour in the Context of Structured Documents. In: Sebastiani, F. (ed.): Advances in Information Retrieval (ECIR 2003). Lecture Notes in Computer Science, Vol. 2633. Springer-Verlag, Berlin Heidelberg New York (2003) 104- 119

Digital Library

Google Scholar

[3]

Kekäläinen, J. & Järvelin, K.: Using graded relevance assessments in IR evaluation. Journal of the American Society for Information Science and Technology, 53(13) (2002) 1120- 1129.

Digital Library

Google Scholar

[4]

Kazai, G., Lalmas, M., Fuhr, N. Gövert, N.:. A report on the first year of the initiative for the evaluation of XML retrieval (INEX'02). Journal of the American Society for Information Science and Technology, 55(6) (2004) 551-556

Digital Library

Google Scholar

[5]

Kazai, G, Lalmas, M, de Vries, A. P.: The Overlap Problem in Content-Oriented XML Retrieval Evaluation. In: Järvelin, K., Allan, J., Bruza, P., Sanderson, M. (eds.) Proceedings of the 27th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval, Sheffield (2004) 72-79

Digital Library

Google Scholar

[6]

Luk, R. W. P. et al.:. A Survey in indexing and searching XML documents. Journal of the American Society for Information Science and Technology, 53(6) (2002) 415-437

Digital Library

Google Scholar

[7]

Malik, S., Tombros, A., Larsen, B.:. HyREX for INEX itrack. (2004) Available: http://inex.is.informatik.uni-duisburg.de:2004/tracks/int/internal/downloads/guide.pdf

Google Scholar

[8]

Saracevic, T., Kantor. P., Chamis, A. Y., Trivison, D.: A Study of Information Seeking and Retrieving. I. Background and Methodology. Journal of the American Society for Information Science, 39 (3) (1988) 161-176

Crossref

Google Scholar

[9]

Tombros, A., Larsen, B. & Malik, S.: The Interactive track at INEX 2004. To be published in: Fuhr, N., Lalmas, M., Malik, S., Szlavik, Z. (eds), INEX 2004 workshop preproceedings (2005)

Digital Library

Google Scholar

Cited By

View all

Pharo NNordlie RKamps JKraaij WFuhr N(2012)Examining the effect of task stage and topic knowledge on searcher interaction with a "digital bookstore"Proceedings of the 4th Information Interaction in Context Symposium10.1145/2362724.2362730(4-11)Online publication date: 21-Aug-2012
https://dl.acm.org/doi/10.1145/2362724.2362730
Nordlie RPharo N(2012)Seven years of INEX interactive retrieval experiments --- lessons and challengesProceedings of the Third international conference on Information Access Evaluation: multilinguality, multimodality, and visual analytics10.1007/978-3-642-33247-0_2(13-23)Online publication date: 17-Sep-2012
https://dl.acm.org/doi/10.1007/978-3-642-33247-0_2
Pharo NBeckers TNordlie RFuhr N(2010)Overview of the INEX 2010 interactive trackProceedings of the 9th international conference on Initiative for the evaluation of XML retrieval: comparative evaluation of focused retrieval10.5555/2040369.2040393(227-235)Online publication date: 13-Dec-2010
https://dl.acm.org/doi/10.5555/2040369.2040393
Show More Cited By

Recommendations

Exploration of query context for information retrieval
WWW '07: Proceedings of the 16th international conference on World Wide Web

A number of existing information retrieval systems propose the notion of query context to combine the knowledge of query and user into retrieval to reveal the most exact description of user's information needs. In this paper we interpret query context ...
Context-sensitive information retrieval
Doxels in context for retrieval: from structure to neighbours
SAC '08: Proceedings of the 2008 ACM symposium on Applied computing

We propose in this paper a new way of considering retrieval of structured documents, by exploiting non-structural relations between structured document elements (doxels). These relations may be defined by human beings (e.g. by the authors of the ...

Comments

Information & Contributors

Information

Published In

CoLIS'05: Proceedings of the 5th international conference on Context: conceptions of Library and Information Sciences

June 2005

251 pages

ISBN:3540261788

Editors:
Fabio Crestani
Department of Computer and Information Science, University of Strathclyde, Scotland
,
Ian Ruthven
Dept. of Computer and Information Sciences, University of Strathclyde, Glasgow, Scotland, UK

Publisher

Springer-Verlag

Berlin, Heidelberg

Publication History

Published: 04 June 2005

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

8
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 22 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Pharo NNordlie RKamps JKraaij WFuhr N(2012)Examining the effect of task stage and topic knowledge on searcher interaction with a "digital bookstore"Proceedings of the 4th Information Interaction in Context Symposium10.1145/2362724.2362730(4-11)Online publication date: 21-Aug-2012
https://dl.acm.org/doi/10.1145/2362724.2362730
Nordlie RPharo N(2012)Seven years of INEX interactive retrieval experiments --- lessons and challengesProceedings of the Third international conference on Information Access Evaluation: multilinguality, multimodality, and visual analytics10.1007/978-3-642-33247-0_2(13-23)Online publication date: 17-Sep-2012
https://dl.acm.org/doi/10.1007/978-3-642-33247-0_2
Pharo NBeckers TNordlie RFuhr N(2010)Overview of the INEX 2010 interactive trackProceedings of the 9th international conference on Initiative for the evaluation of XML retrieval: comparative evaluation of focused retrieval10.5555/2040369.2040393(227-235)Online publication date: 13-Dec-2010
https://dl.acm.org/doi/10.5555/2040369.2040393
Borlund PSchneider JBelkin NKelly D(2010)Reconsideration of the simulated work task situationProceedings of the third symposium on Information interaction in context10.1145/1840784.1840808(155-164)Online publication date: 18-Aug-2010
https://dl.acm.org/doi/10.1145/1840784.1840808
Pharo NNordlie RFuhr NBeckers TFachry K(2009)Overview of the INEX 2009 interactive trackProceedings of the Focused retrieval and evaluation, and 8th international conference on Initiative for the evaluation of XML retrieval10.5555/1881065.1881101(303-311)Online publication date: 7-Dec-2009
https://dl.acm.org/doi/10.5555/1881065.1881101
Pharo N(2008)The effect of granularity and order in XML element retrievalInformation Processing and Management: an International Journal10.1016/j.ipm.2008.05.00444:5(1732-1740)Online publication date: 1-Sep-2008
https://dl.acm.org/doi/10.1016/j.ipm.2008.05.004
Hammer-Aebi BChristensen KLund HLarsen BRuthven I(2006)Users, structured documents and overlapProceedings of the 1st international conference on Information interaction in context10.1145/1164820.1164833(46-55)Online publication date: 18-Oct-2006
https://dl.acm.org/doi/10.1145/1164820.1164833
Szlávik ZTombros ALalmas M(2006)The use of summaries in XML retrievalProceedings of the 10th European conference on Research and Advanced Technology for Digital Libraries10.1007/11863878_7(75-86)Online publication date: 17-Sep-2006
https://dl.acm.org/doi/10.1007/11863878_7

Abstract

References

Cited By

Recommendations

Exploration of query context for information retrieval

Context-sensitive information retrieval

Doxels in context for retrieval: from structure to neighbours

Comments

Information

Published In

Sponsors

Publisher

Publication History

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

Share

Share this Publication link

Share on social media

Affiliations