Injecting Realism into Simulated Work Tasks:  A Case Study of the Book Domain

Pia Borlund; Toine Bogers

Injecting Realism into Simulated Work Tasks: A Case Study of the Book Domain

Institut for Kommunikation og Psykologi

Publikation: Bidrag til bog/antologi/rapport/konference proceeding › Konferenceartikel i proceeding › Forskning › peer review

2 Citationer (Scopus)

265 Downloads (Pure)

Abstract

Interactive IR studies are commonly conducted by assigning participants simulated work tasks situations (SWTS), predetermined textual descriptions of an information need and its context to motivate participants to perform realistic searches of the IR system in question. Despite their popularity, research has shown that formulating realistic and engaging SWTSs remains challenging. In this paper, we propose using the analyses of large samples of complex real-world search requests—with the specific case of book search—to inject realism into SWTSs by taking different relevance aspects and their relative frequencies into account when formulating them. This should make it easier for researchers to design realistic SWTSs in the future.

Originalsprog	Engelsk
Titel	Proceedings of the 81st Annual Meeting of the Association for Information Science and Technology (ASIST 2018)
Antal sider	3
Udgivelsessted	Vancouver, Canada
Forlag	Association for Information Science and Technology
Publikationsdato	10 nov. 2018
Sider	759-761
ISBN (Elektronisk)	978-0-578-41425-6
Status	Udgivet - 10 nov. 2018
Begivenhed	ASIST 2018: 81st Annual Meeting of the Association for Information Science and Technology - Vancouver, Canada, Vancouver, Canada Varighed: 10 nov. 2018 → 14 nov. 2018 Konferencens nummer: 81 https://www.asist.org/am18/

Konference

Konference	ASIST 2018: 81st Annual Meeting of the Association for Information Science and Technology
Nummer	81
Lokation	Vancouver, Canada
Land/Område	Canada
By	Vancouver
Periode	10/11/2018 → 14/11/2018
Internetadresse	https://www.asist.org/am18/

Navn	American Society for Information Science & Technology. Annual Meeting Proceedings
ISSN	0044-7870

Adgang til dokumentet

Camera-ready versionAccepteret manuskript, 126 KB

AUB Link

Søg efter materialet i Aalborg Universitetsbiblioteks søgemaskine

Andre filer og links

https://www.asist.org/wp-content/uploads/2018/12/Final-81st-Annual-Meeting-Proceedings.pdf

ASIST 2018: 81st Annual Meeting of the Association for Information Science and Technology
Bogers, T. (Deltager)
10 nov. 2018 → 14 nov. 2018
Aktivitet: Deltagelse i faglig begivenhed › Organisering af eller deltagelse i konference

Citationsformater

Borlund, Pia ; Bogers, Toine. / Injecting Realism into Simulated Work Tasks : A Case Study of the Book Domain. Proceedings of the 81st Annual Meeting of the Association for Information Science and Technology (ASIST 2018). Vancouver, Canada : Association for Information Science and Technology, 2018. s. 759-761 (American Society for Information Science & Technology. Annual Meeting Proceedings).

@inproceedings{39a6f87d373040c8943eb27a645a2f3a,

title = "Injecting Realism into Simulated Work Tasks: A Case Study of the Book Domain",

abstract = "Interactive IR studies are commonly conducted by assigning participants simulated work tasks situations (SWTS), predetermined textual descriptions of an information need and its context to motivate participants to perform realistic searches of the IR system in question. Despite their popularity, research has shown that formulating realistic and engaging SWTSs remains challenging. In this paper, we propose using the analyses of large samples of complex real-world search requests—with the specific case of book search—to inject realism into SWTSs by taking different relevance aspects and their relative frequencies into account when formulating them. This should make it easier for researchers to design realistic SWTSs in the future.",

keywords = "information science",

author = "Pia Borlund and Toine Bogers",

year = "2018",

month = nov,

day = "10",

language = "English",

series = "American Society for Information Science & Technology. Annual Meeting Proceedings",

publisher = "Association for Information Science and Technology",

pages = "759--761",

booktitle = "Proceedings of the 81st Annual Meeting of the Association for Information Science and Technology (ASIST 2018)",

note = "ASIST 2018: 81st Annual Meeting of the Association for Information Science and Technology, ASIST 2018 ; Conference date: 10-11-2018 Through 14-11-2018",

url = "https://www.asist.org/am18/",

}

Borlund, P & Bogers, T 2018, Injecting Realism into Simulated Work Tasks: A Case Study of the Book Domain. i Proceedings of the 81st Annual Meeting of the Association for Information Science and Technology (ASIST 2018). Association for Information Science and Technology, Vancouver, Canada, American Society for Information Science & Technology. Annual Meeting Proceedings, s. 759-761, ASIST 2018: 81st Annual Meeting of the Association for Information Science and Technology, Vancouver, Britisk Columbia, Canada, 10/11/2018.

Injecting Realism into Simulated Work Tasks: A Case Study of the Book Domain. / Borlund, Pia; Bogers, Toine.
Proceedings of the 81st Annual Meeting of the Association for Information Science and Technology (ASIST 2018). Vancouver, Canada: Association for Information Science and Technology, 2018. s. 759-761 (American Society for Information Science & Technology. Annual Meeting Proceedings).

Publikation: Bidrag til bog/antologi/rapport/konference proceeding › Konferenceartikel i proceeding › Forskning › peer review

TY - GEN

T1 - Injecting Realism into Simulated Work Tasks

T2 - ASIST 2018: 81st Annual Meeting of the Association for Information Science and Technology

AU - Borlund, Pia

AU - Bogers, Toine

N1 - Conference code: 81

PY - 2018/11/10

Y1 - 2018/11/10

N2 - Interactive IR studies are commonly conducted by assigning participants simulated work tasks situations (SWTS), predetermined textual descriptions of an information need and its context to motivate participants to perform realistic searches of the IR system in question. Despite their popularity, research has shown that formulating realistic and engaging SWTSs remains challenging. In this paper, we propose using the analyses of large samples of complex real-world search requests—with the specific case of book search—to inject realism into SWTSs by taking different relevance aspects and their relative frequencies into account when formulating them. This should make it easier for researchers to design realistic SWTSs in the future.

AB - Interactive IR studies are commonly conducted by assigning participants simulated work tasks situations (SWTS), predetermined textual descriptions of an information need and its context to motivate participants to perform realistic searches of the IR system in question. Despite their popularity, research has shown that formulating realistic and engaging SWTSs remains challenging. In this paper, we propose using the analyses of large samples of complex real-world search requests—with the specific case of book search—to inject realism into SWTSs by taking different relevance aspects and their relative frequencies into account when formulating them. This should make it easier for researchers to design realistic SWTSs in the future.

KW - information science

UR - https://www.asist.org/wp-content/uploads/2018/12/Final-81st-Annual-Meeting-Proceedings.pdf

M3 - Article in proceeding

T3 - American Society for Information Science & Technology. Annual Meeting Proceedings

SP - 759

EP - 761

BT - Proceedings of the 81st Annual Meeting of the Association for Information Science and Technology (ASIST 2018)

PB - Association for Information Science and Technology

CY - Vancouver, Canada

Y2 - 10 November 2018 through 14 November 2018

ER -

Borlund P, Bogers T. Injecting Realism into Simulated Work Tasks: A Case Study of the Book Domain. I Proceedings of the 81st Annual Meeting of the Association for Information Science and Technology (ASIST 2018). Vancouver, Canada: Association for Information Science and Technology. 2018. s. 759-761. (American Society for Information Science & Technology. Annual Meeting Proceedings).