Overview of INEX 2014

Patrice Bellot, Toine Bogers, Shlomo Geva, Mark Hall, Hugo Huurdeman, Jaap Kamps, Gabriella Kazai, Marijn Koolen, Veronique Moriceau, Josiane Mothe, Michael Preminger, Eric SanJuan, Ralf Schenkel, Mette Skov, Xavier Tannier, David Walsh

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

17 Citations (Scopus)

Abstract

INEX investigates focused retrieval from structured documents by providing large test collections of structured documents, uniform evaluation measures, and a forum for organizations to compare their results. This paper reports on the INEX 2014 evaluation campaign, which consisted of three tracks: The Interactive Social Book Search Track investigated user information seeking behavior when interacting with various sources of information, for realistic task scenarios, and how the user interface impacts search and the search experience. The Social Book Search Track investigated the relative value of authoritative metadata and user-generated content for search and recommendation using a test collection with data from Amazon and LibraryThing, including user profiles and personal catalogues. The Tweet Contextualization Track investigated tweet contextualization, helping a user to understand a tweet by providing him with a short background summary generated from relevant Wikipedia passages aggregated into a coherent summary. INEX 2014 was an exciting year for INEX in which we for the third time ran our workshop as part of the CLEF labs. This paper gives an overview of all the INEX 2014 tracks, their aims and task, the built test-collections, the participants, and gives an initial analysis of the results.
Original languageEnglish
Title of host publicationInformation Access Evaluation. Multilinguality, Multimodality, and Interaction : 5th International Conference of the CLEF Initiative, CLEF 2014, Sheffield, UK, September 15-18, 2014. Proceedings
EditorsEvangelos Kanoulas, Mihai Lupu, Paul Clough, Mark Sanderson, Mark Hall, Allan Hanbury, Elaine Toms
Number of pages17
PublisherSpringer
Publication dateSept 2014
Pages212-228
ISBN (Print)978-3-319-11381-4
ISBN (Electronic)978-3-319-11382-1
DOIs
Publication statusPublished - Sept 2014
Externally publishedYes
EventConference and Labs of the Evaluation Forum - Sheffield, United Kingdom
Duration: 15 Sept 201418 Sept 2014

Conference

ConferenceConference and Labs of the Evaluation Forum
Country/TerritoryUnited Kingdom
CitySheffield
Period15/09/201418/09/2014
SeriesLecture Notes in Computer Science
Volume8685
ISSN0302-9743

Cite this