Overview of the SBS 2016 Mining Track

Toine Bogers, Iris Hendrickx, Marijn Koolen, Suzan Verberne

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

2 Citations (Scopus)
40 Downloads (Pure)

Abstract

In this paper we present an overview of the mining track in the Social Book Search (SBS) lab 2016. The mining track addressed two tasks: (1) classifying forum posts as book search requests, and (2) linking book title mentions in forum posts to unique book IDs in a database. Both tasks are important steps in the process of solving complex search tasks within online reader communities. We prepared two data collections for the classification task: posts from the LibraryThing (LT) forum and a smaller number of posts from Reddit. For the linking task we used annotated LT threads. We found that the classification task was relatively straightforward, achieving up to 94% classification accuracy. The book linking task on the other hand turned out to be a difficult task: here the best system achieved an accuracy of 41% and F-score of 33.5%. Both the automatic classification of book search requests as the automatic linking of book mentions could next year be part of the pipeline for processing complex book searches.
Original languageEnglish
Title of host publicationWorking Notes of CLEF 2016 - Conference and Labs of the Evaluation Forum
EditorsKrisztian Balog, Linda Capellato, Nicola Ferro, Craig McDonald
Number of pages11
PublisherCEUR Workshop Proceedings
Publication date5 Sep 2016
Pages1053-1063
Publication statusPublished - 5 Sep 2016
EventConference and Labs of the Evaluation forum - Évora, Portugal
Duration: 5 Sep 20168 Sep 2016

Conference

ConferenceConference and Labs of the Evaluation forum
CountryPortugal
CityÉvora
Period05/09/201608/09/2016
SeriesCEUR Workshop Proceedings
Volume1609
ISSN1613-0073

Keywords

  • text mining
  • forum mining
  • information retrieval
  • book search

Fingerprint Dive into the research topics of 'Overview of the SBS 2016 Mining Track'. Together they form a unique fingerprint.

  • Activities

    • 1 Conference organisation or participation

    Conference and Labs of the Evaluation forum

    Toine Bogers (Participant)

    5 Sep 20168 Sep 2016

    Activity: Attending an eventConference organisation or participation

    Cite this

    Bogers, T., Hendrickx, I., Koolen, M., & Verberne, S. (2016). Overview of the SBS 2016 Mining Track. In K. Balog, L. Capellato, N. Ferro, & C. McDonald (Eds.), Working Notes of CLEF 2016 - Conference and Labs of the Evaluation Forum (pp. 1053-1063). CEUR Workshop Proceedings. CEUR Workshop Proceedings, Vol.. 1609 http://ceur-ws.org/Vol-1609/16091053.pdf