Lessons learned from the CHiC and SBS interactive tracks: A wishlist for interactive IR evaluation

Toine Bogers; Maria Gäde; Mark M. Hall; Vivien Petras; Mette Skov

Lessons learned from the CHiC and SBS interactive tracks: A wishlist for interactive IR evaluation

Toine Bogers, Maria Gäde, Mark M. Hall, Vivien Petras, Mette Skov

Institut for Kommunikation og Psykologi

Publikation: Bidrag til tidsskrift › Tidsskriftartikel › Forskning › peer review

3 Citationer (Scopus)

223 Downloads (Pure)

Abstract

Over the course of the past two decades, the Interactive Tracks at TREC and INEX have contributed greatly to our knowledge of how to run an interactive IR evaluation campaign. In this position paper, we add to this body of knowledge by taking stock of our own experiences and challenges in organizing the CHIC and SBS Interactive Tracks from 2013 to 2016 in the form of a list of important properties of any future IIR evaluation campaigns.

Originalsprog	Engelsk
Tidsskrift	CEUR Workshop Proceedings
Vol/bind	1798
Sider (fra-til)	12-15
Antal sider	4
ISSN	1613-0073
Status	Udgivet - 2017

Adgang til dokumentet

OpenAccessArticleForlagets udgivne version, 355 KBLicens: CC BY 4.0

http://ceur-ws.org/Vol-1798/paper2.pdfLicens: CC BY 4.0

AUB Link

Søg efter materialet i Aalborg Universitetsbiblioteks søgemaskine

1 Organisering af eller deltagelse i konference
1 Organisering af eller deltagelse i workshop, kursus, seminar, udstilling eller lignende

Second Workshop on Supporting Complex Search Tasks
Nicholas J. Belkin (Arrangør), Toine Bogers (Arrangør), Diane Kelly (Arrangør), Marijn Koolen (Arrangør), Jaap Kamps (Arrangør) & Emine Yilmaz (Arrangør)
11 mar. 2017
Aktivitet: Deltagelse i faglig begivenhed › Organisering af eller deltagelse i workshop, kursus, seminar, udstilling eller lignende
2nd ACM SIGIR Conference on Information Interaction and Retrieval, CHIIR 2017
Toine Bogers (Deltager)
7 mar. 2017 → 11 mar. 2017
Aktivitet: Deltagelse i faglig begivenhed › Organisering af eller deltagelse i konference

Citationsformater

@article{206f2787286e4d488362f20a713276d2,

title = "Lessons learned from the CHiC and SBS interactive tracks: A wishlist for interactive IR evaluation",

abstract = "Over the course of the past two decades, the Interactive Tracks at TREC and INEX have contributed greatly to our knowledge of how to run an interactive IR evaluation campaign. In this position paper, we add to this body of knowledge by taking stock of our own experiences and challenges in organizing the CHIC and SBS Interactive Tracks from 2013 to 2016 in the form of a list of important properties of any future IIR evaluation campaigns.",

keywords = "Evaluation, Information seeking, Interactive IR",

author = "Toine Bogers and Maria G{\"a}de and Hall, {Mark M.} and Vivien Petras and Mette Skov",

year = "2017",

language = "English",

volume = "1798",

pages = "12--15",

journal = "CEUR Workshop Proceedings",

issn = "1613-0073",

publisher = "CEUR Workshop Proceedings",

}

TY - JOUR

T1 - Lessons learned from the CHiC and SBS interactive tracks

T2 - A wishlist for interactive IR evaluation

AU - Bogers, Toine

AU - Gäde, Maria

AU - Hall, Mark M.

AU - Petras, Vivien

AU - Skov, Mette

PY - 2017

Y1 - 2017

N2 - Over the course of the past two decades, the Interactive Tracks at TREC and INEX have contributed greatly to our knowledge of how to run an interactive IR evaluation campaign. In this position paper, we add to this body of knowledge by taking stock of our own experiences and challenges in organizing the CHIC and SBS Interactive Tracks from 2013 to 2016 in the form of a list of important properties of any future IIR evaluation campaigns.

AB - Over the course of the past two decades, the Interactive Tracks at TREC and INEX have contributed greatly to our knowledge of how to run an interactive IR evaluation campaign. In this position paper, we add to this body of knowledge by taking stock of our own experiences and challenges in organizing the CHIC and SBS Interactive Tracks from 2013 to 2016 in the form of a list of important properties of any future IIR evaluation campaigns.

KW - Evaluation

KW - Information seeking

KW - Interactive IR

M3 - Journal article

AN - SCOPUS:85019589657

SN - 1613-0073

VL - 1798

SP - 12

EP - 15

JO - CEUR Workshop Proceedings

JF - CEUR Workshop Proceedings

ER -

Lessons learned from the CHiC and SBS interactive tracks: A wishlist for interactive IR evaluation

Abstract

Adgang til dokumentet

AUB Link

Fingeraftryk

Aktiviteter

Second Workshop on Supporting Complex Search Tasks

2nd ACM SIGIR Conference on Information Interaction and Retrieval, CHIIR 2017

Citationsformater