Lessons learned from the CHiC and SBS interactive tracks: A wishlist for interactive IR evaluation

Toine Bogers; Maria Gäde; Mark M. Hall; Vivien Petras; Mette Skov

Lessons learned from the CHiC and SBS interactive tracks: A wishlist for interactive IR evaluation

Toine Bogers, Maria Gäde, Mark M. Hall, Vivien Petras, Mette Skov

Department of Communication and Psychology

Research output: Contribution to journal › Journal article › Research › peer-review

3 Citations (Scopus)

238 Downloads (Pure)

Abstract

Over the course of the past two decades, the Interactive Tracks at TREC and INEX have contributed greatly to our knowledge of how to run an interactive IR evaluation campaign. In this position paper, we add to this body of knowledge by taking stock of our own experiences and challenges in organizing the CHIC and SBS Interactive Tracks from 2013 to 2016 in the form of a list of important properties of any future IIR evaluation campaigns.

Original language	English
Journal	CEUR Workshop Proceedings
Volume	1798
Pages (from-to)	12-15
Number of pages	4
ISSN	1613-0073
Publication status	Published - 2017

Keywords

Evaluation
Information seeking
Interactive IR

Access to Document

OpenAccessArticleFinal published version, 355 KBLicence: CC BY 4.0

http://ceur-ws.org/Vol-1798/paper2.pdfLicence: CC BY 4.0

AUB Link

Search for the material in Aalborg University Library's search engine

1 Conference organisation or participation
1 Organisation or participation in workshops, courses, seminars, exhibitions or similar

Second Workshop on Supporting Complex Search Tasks
Belkin, N. J. (Organizer), Bogers, T. (Organizer), Kelly, D. (Organizer), Koolen, M. (Organizer), Kamps, J. (Organizer) & Yilmaz, E. (Organizer)
11 Mar 2017
Activity: Attending an event › Organisation or participation in workshops, courses, seminars, exhibitions or similar
2nd ACM SIGIR Conference on Information Interaction and Retrieval, CHIIR 2017
Bogers, T. (Participant)
7 Mar 2017 → 11 Mar 2017
Activity: Attending an event › Conference organisation or participation

Cite this

@article{206f2787286e4d488362f20a713276d2,

title = "Lessons learned from the CHiC and SBS interactive tracks: A wishlist for interactive IR evaluation",

abstract = "Over the course of the past two decades, the Interactive Tracks at TREC and INEX have contributed greatly to our knowledge of how to run an interactive IR evaluation campaign. In this position paper, we add to this body of knowledge by taking stock of our own experiences and challenges in organizing the CHIC and SBS Interactive Tracks from 2013 to 2016 in the form of a list of important properties of any future IIR evaluation campaigns.",

keywords = "Evaluation, Information seeking, Interactive IR",

author = "Toine Bogers and Maria G{\"a}de and Hall, {Mark M.} and Vivien Petras and Mette Skov",

year = "2017",

language = "English",

volume = "1798",

pages = "12--15",

journal = "CEUR Workshop Proceedings",

issn = "1613-0073",

publisher = "CEUR Workshop Proceedings",

}

TY - JOUR

T1 - Lessons learned from the CHiC and SBS interactive tracks

T2 - A wishlist for interactive IR evaluation

AU - Bogers, Toine

AU - Gäde, Maria

AU - Hall, Mark M.

AU - Petras, Vivien

AU - Skov, Mette

PY - 2017

Y1 - 2017

N2 - Over the course of the past two decades, the Interactive Tracks at TREC and INEX have contributed greatly to our knowledge of how to run an interactive IR evaluation campaign. In this position paper, we add to this body of knowledge by taking stock of our own experiences and challenges in organizing the CHIC and SBS Interactive Tracks from 2013 to 2016 in the form of a list of important properties of any future IIR evaluation campaigns.

AB - Over the course of the past two decades, the Interactive Tracks at TREC and INEX have contributed greatly to our knowledge of how to run an interactive IR evaluation campaign. In this position paper, we add to this body of knowledge by taking stock of our own experiences and challenges in organizing the CHIC and SBS Interactive Tracks from 2013 to 2016 in the form of a list of important properties of any future IIR evaluation campaigns.

KW - Evaluation

KW - Information seeking

KW - Interactive IR

M3 - Journal article

AN - SCOPUS:85019589657

SN - 1613-0073

VL - 1798

SP - 12

EP - 15

JO - CEUR Workshop Proceedings

JF - CEUR Workshop Proceedings

ER -

Lessons learned from the CHiC and SBS interactive tracks: A wishlist for interactive IR evaluation

Abstract

Keywords

Access to Document

AUB Link

Fingerprint

Activities

Second Workshop on Supporting Complex Search Tasks

2nd ACM SIGIR Conference on Information Interaction and Retrieval, CHIIR 2017

Cite this