TY - JOUR
T1 - Human Accuracy in Mobile Data Collection
AU - van Berkel, Niels
AU - Goncalves, Jorge
AU - Wac, Katarzyna
AU - Hosio, Simo
AU - Cox, Anna L.
PY - 2020
Y1 - 2020
N2 - The collection of participant data ‘in the wild’ is widely employed by Human-Computer Interaction researchers. A variety of methods, including experience sampling, mobile crowdsourcing, and citizen science, rely on repeated participant contributions for data collection. Given this strong reliance on participant data, ensuring that the data is complete, reliable, timely, and accurate is key. Although previous work has made significant progress on ensuring that a sufficient amount of data is collected, the accuracy of human contributions has remained underexposed. In this article we argue for an emerging need for an increased focus on this aspect of human-labelled data. The articles published in this special issue demonstrate how a focus on the accuracy of the collected data has implications on all aspects of a study – ranging from study design to the analysis and reporting of results. We put forward a five-point research agenda in which we outline future opportunities in assessing and improving human accuracy in mobile data collection.
AB - The collection of participant data ‘in the wild’ is widely employed by Human-Computer Interaction researchers. A variety of methods, including experience sampling, mobile crowdsourcing, and citizen science, rely on repeated participant contributions for data collection. Given this strong reliance on participant data, ensuring that the data is complete, reliable, timely, and accurate is key. Although previous work has made significant progress on ensuring that a sufficient amount of data is collected, the accuracy of human contributions has remained underexposed. In this article we argue for an emerging need for an increased focus on this aspect of human-labelled data. The articles published in this special issue demonstrate how a focus on the accuracy of the collected data has implications on all aspects of a study – ranging from study design to the analysis and reporting of results. We put forward a five-point research agenda in which we outline future opportunities in assessing and improving human accuracy in mobile data collection.
KW - EMA
KW - ESM
KW - Ecological momentary assessment
KW - Experience sampling method
KW - Mobile crowdsourcing
KW - Mobile sensing
KW - Self-report
UR - http://www.scopus.com/inward/record.url?scp=85078726075&partnerID=8YFLogxK
U2 - 10.1016/j.ijhcs.2020.102396
DO - 10.1016/j.ijhcs.2020.102396
M3 - Journal article
SN - 1071-5819
VL - 137
SP - 1
EP - 4
JO - International Journal of Human-Computer Studies
JF - International Journal of Human-Computer Studies
M1 - 102396
ER -