Measuring and Analyzing the Scholarly Impact of Experimental Evaluation Initiatives

Marco Angelini; Nicola Ferro; Birger Larsen; Henning Müller; Guiseppe Santucci; Gianmaria Silvello; Theodora Tsikrika

doi:10.1016/j.procs.2014.10.022

Measuring and Analyzing the Scholarly Impact of Experimental Evaluation Initiatives

Marco Angelini, Nicola Ferro, Birger Larsen, Henning Müller, Guiseppe Santucci, Gianmaria Silvello, Theodora Tsikrika

Institut for Kommunikation og Psykologi

Publikation: Bidrag til tidsskrift › Konferenceartikel i tidsskrift › Forskning › peer review

7 Citationer (Scopus)

408 Downloads (Pure)

Abstract

Evaluation initiatives have been widely credited with contributing highly to the development and advancement of information access systems, by providing a sustainable platform for conducting the very demanding activity of comparable experimental evaluation in a large scale. Measuring the impact of such benchmarking activities is crucial for assessing which of their aspects have been successful, which activities should be continued, enforced or suspended and which research paths should be further pursued in the future. This work introduces a framework for modeling the data produced by evaluation campaigns, a methodology for measuring their scholarly impact, and tools exploiting visual analytics to analyze the outcomes.

Originalsprog	Engelsk
Tidsskrift	Procedia Computer Science
Vol/bind	38
Sider (fra-til)	133-137
Antal sider	5
ISSN	1877-0509
DOI	https://doi.org/10.1016/j.procs.2014.10.022
Status	Udgivet - 2014
Begivenhed	Italian Research Conference on Digital Libraries - Padua, Italien Varighed: 30 jan. 2014 → 31 jan. 2014 Konferencens nummer: 10

Konference

Konference	Italian Research Conference on Digital Libraries
Nummer	10
Land/Område	Italien
By	Padua
Periode	30/01/2014 → 31/01/2014

Adgang til dokumentet

10.1016/j.procs.2014.10.022

Angelini+2014measuringAnalysingImpact_Procedia-IRCDL'2014Forlagets udgivne version, 706 KB

http://www.sciencedirect.com/science/article/pii/S1877050914013829/pdf?md5=68f3dd648ddee237254e0d96d9c5f461&pid=1-s2.0-S1877050914013829-main.pdf

AUB Link

Søg efter materialet i Aalborg Universitetsbiblioteks søgemaskine

Citationsformater

@inproceedings{8466da54d0fb4e2abd46b27212aa8af2,

title = "Measuring and Analyzing the Scholarly Impact of Experimental Evaluation Initiatives",

abstract = "Evaluation initiatives have been widely credited with contributing highly to the development and advancement of information access systems, by providing a sustainable platform for conducting the very demanding activity of comparable experimental evaluation in a large scale. Measuring the impact of such benchmarking activities is crucial for assessing which of their aspects have been successful, which activities should be continued, enforced or suspended and which research paths should be further pursued in the future. This work introduces a framework for modeling the data produced by evaluation campaigns, a methodology for measuring their scholarly impact, and tools exploiting visual analytics to analyze the outcomes.",

keywords = "Scholarly Impact, Experimental Evaluation, Experimental Data, Visual Analytics",

author = "Marco Angelini and Nicola Ferro and Birger Larsen and Henning M{\"u}ller and Guiseppe Santucci and Gianmaria Silvello and Theodora Tsikrika",

year = "2014",

doi = "10.1016/j.procs.2014.10.022",

language = "English",

volume = "38",

pages = "133--137",

journal = "Procedia Computer Science",

issn = "1877-0509",

publisher = "Elsevier",

note = "Italian Research Conference on Digital Libraries, IRCDL ; Conference date: 30-01-2014 Through 31-01-2014",

}

TY - GEN

T1 - Measuring and Analyzing the Scholarly Impact of Experimental Evaluation Initiatives

AU - Angelini, Marco

AU - Ferro, Nicola

AU - Larsen, Birger

AU - Müller, Henning

AU - Santucci, Guiseppe

AU - Silvello, Gianmaria

AU - Tsikrika, Theodora

N1 - Conference code: 10

PY - 2014

Y1 - 2014

N2 - Evaluation initiatives have been widely credited with contributing highly to the development and advancement of information access systems, by providing a sustainable platform for conducting the very demanding activity of comparable experimental evaluation in a large scale. Measuring the impact of such benchmarking activities is crucial for assessing which of their aspects have been successful, which activities should be continued, enforced or suspended and which research paths should be further pursued in the future. This work introduces a framework for modeling the data produced by evaluation campaigns, a methodology for measuring their scholarly impact, and tools exploiting visual analytics to analyze the outcomes.

AB - Evaluation initiatives have been widely credited with contributing highly to the development and advancement of information access systems, by providing a sustainable platform for conducting the very demanding activity of comparable experimental evaluation in a large scale. Measuring the impact of such benchmarking activities is crucial for assessing which of their aspects have been successful, which activities should be continued, enforced or suspended and which research paths should be further pursued in the future. This work introduces a framework for modeling the data produced by evaluation campaigns, a methodology for measuring their scholarly impact, and tools exploiting visual analytics to analyze the outcomes.

KW - Scholarly Impact

KW - Experimental Evaluation

KW - Experimental Data

KW - Visual Analytics

U2 - 10.1016/j.procs.2014.10.022

DO - 10.1016/j.procs.2014.10.022

M3 - Conference article in Journal

SN - 1877-0509

VL - 38

SP - 133

EP - 137

JO - Procedia Computer Science

JF - Procedia Computer Science

T2 - Italian Research Conference on Digital Libraries

Y2 - 30 January 2014 through 31 January 2014

ER -

Measuring and Analyzing the Scholarly Impact of Experimental Evaluation Initiatives

Abstract

Konference

Adgang til dokumentet

AUB Link

Fingeraftryk

Citationsformater