On the need for and provision for an 'IDEAL' scholarly information retrieval test collection

Birger Larsen, Christina Lioma

Research output: Contribution to journalConference article in JournalResearchpeer-review

3 Citations (Scopus)

Abstract

Much about the potential, strengths and challenges of applying bibliometric techniques to scholarly Information Retrieval (IR) can be learned from conducting user studies with scholars and scientists, e.g. when interacting with bibliometrically enhanced IR prototypes or operational systems. However, most of IR research is still carried out as laboratory studies using test collections. As there is a lack of appropriate scholarly test collections, we argue in this position paper that one or more well-crafted test collections with scholarly documents is needed in order to engage the IR community whole-heartedly in Bibliometric IR research, and to facilitate foundational and high-quality work in this area. Based on the experiences gained from creating the iSearch test collection (Lykke et al. 2010 - http://itlab.dbit.dk/∼isearch/) we reflect on the properties of an ideal scholarly IR test collection and then examine three possible ways of realising the creation of such a collection. The first considers the possibilities for basing the test collection on the ever more readily available open access collections of scholarly documents; the second examines the possibilities of setting up alliances with proprietary content producers or aggregators; and the third considers collaboration with major university libraries and their content.

Original languageEnglish
JournalCEUR Workshop Proceedings
Volume1567
Pages (from-to)73-81
Number of pages9
ISSN1613-0073
Publication statusPublished - 1 Jan 2016
Event3rd Workshop on Bibliometric-Enhanced Information Retrieval, BIR 2016 - Padova, Italy
Duration: 20 Mar 2016 → …

Conference

Conference3rd Workshop on Bibliometric-Enhanced Information Retrieval, BIR 2016
Country/TerritoryItaly
CityPadova
Period20/03/2016 → …

Keywords

  • Citation-Based Search
  • Scholarly IR
  • Test Collections

Fingerprint

Dive into the research topics of 'On the need for and provision for an 'IDEAL' scholarly information retrieval test collection'. Together they form a unique fingerprint.

Cite this