A comparison of interactive and ad-hoc relevance assessments

Birger Larsen*, Saadia Malik, Anastasios Tombros

*Corresponding author for this work

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

7 Citations (Scopus)

Abstract

In this paper we report an initial comparison of relevance assessments made as part of the INEX 2006 Interactive Track (itrack'06) to those made for the topic assessment phase of the INEX 2007 ad-hoc track. The results indicate that that there are important differences in what information was assessed under the two different conditions, but it also suggests a certain level of agreement in what constitutes relevant and non-relevant information. In addition, there are indications that the task type has an influence on the distribution of relevance assessments.

Original languageEnglish
Title of host publicationFocused Access to XML Documents - 6th International Workshop of the Initiative for the Evaluation of XML Retrieval, INEX 2007, Revised and Selected Papers
Number of pages11
Publication date22 Sept 2008
Pages348-358
ISBN (Print)3540859012, 9783540859017
DOIs
Publication statusPublished - 22 Sept 2008
Event6th International Workshop of the Initiative for the Evaluation of XML Retrieval, INEX 2007 - Dagstuhl Castle, Germany
Duration: 17 Dec 200719 Dec 2007

Conference

Conference6th International Workshop of the Initiative for the Evaluation of XML Retrieval, INEX 2007
Country/TerritoryGermany
CityDagstuhl Castle
Period17/12/200719/12/2007
SeriesLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume4862 LNCS
ISSN0302-9743

Fingerprint

Dive into the research topics of 'A comparison of interactive and ad-hoc relevance assessments'. Together they form a unique fingerprint.

Cite this