Introducing Asynchronous Remote Usability Testing in Practice: An Action Research Project

Jonna Helene Holm Pedersen; Malene Sørensen; Jan Stage; Rune Thaarup Høegh

doi:10.1007/978-3-030-85610-6_19

Introducing Asynchronous Remote Usability Testing in Practice: An Action Research Project

Jonna Helene Holm Pedersen, Malene Sørensen, Jan Stage^*, Rune Thaarup Høegh

^*Corresponding author for this work

Research output: Contribution to book/anthology/report/conference proceeding › Article in proceeding › Research › peer-review

1 Citation (Scopus)

Abstract

Asynchronous remote usability testing is a usability evaluation method where users and evaluators are separated both in time and space, and users are directly involved in producing the evaluation results. This paper reports from an action research project on introduction of asynchronous remote usability testing in the IT organization of a bank. The IT organization had extensive experience with traditional usability evaluation but was interested in introducing asynchronous remote usability testing into their repertoire of evaluation methods. The project was initiated with an intensive two-month collaboration followed by a six-month maturation phase. The process of introducing the method and the motivations of the IT organization for introducing the method are described in detail. The findings indicate that the conceptual understanding of usability evaluation and the engagement of the users are crucial for the outcome of the evaluation, and the tool and materials used for the evaluation was an obstacle for high-quality results.

Original language	English
Title of host publication	Human-Computer Interaction – INTERACT 2021 : 18th IFIP TC 13 International Conference, Bari, Italy, August 30 – September 3, 2021, Proceedings, Part IV
Editors	Carmelo Ardito, Rosa Lanzilotti, Alessio Malizia, Alessio Malizia, Helen Petrie, Antonio Piccinno, Giuseppe Desolda, Kori Inkpen
Number of pages	19
Volume	IV
Publisher	Springer
Publication date	2021
Pages	320-338
ISBN (Print)	978-3-030-85609-0
ISBN (Electronic)	978-3-030-85610-6
DOIs	https://doi.org/10.1007/978-3-030-85610-6_19
Publication status	Published - 2021
Event	18th IFIP TC 13 International Conference on Human-Computer Interaction, INTERACT 2021 - Virtual, Online Duration: 30 Aug 2021 → 3 Sept 2021

Conference

Conference	18th IFIP TC 13 International Conference on Human-Computer Interaction, INTERACT 2021
City	Virtual, Online
Period	30/08/2021 → 03/09/2021

Series	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	12935 LNCS
ISSN	0302-9743

Bibliographical note

Publisher Copyright:
© 2021, IFIP International Federation for Information Processing.

Keywords

Action research
Methods for HCI
Remote asynchronous usability evaluation
Usability evaluation

Access to Document

10.1007/978-3-030-85610-6_19

AUB Link

Search for the material in Aalborg University Library's search engine

Cite this

Pedersen, J. H. H., Sørensen, M., Stage, J., & Høegh, R. T. (2021). Introducing Asynchronous Remote Usability Testing in Practice: An Action Research Project. In C. Ardito, R. Lanzilotti, A. Malizia, A. Malizia, H. Petrie, A. Piccinno, G. Desolda, & K. Inkpen (Eds.), Human-Computer Interaction – INTERACT 2021: 18th IFIP TC 13 International Conference, Bari, Italy, August 30 – September 3, 2021, Proceedings, Part IV (Vol. IV, pp. 320-338). Springer. https://doi.org/10.1007/978-3-030-85610-6_19

Pedersen, Jonna Helene Holm ; Sørensen, Malene ; Stage, Jan et al. / Introducing Asynchronous Remote Usability Testing in Practice : An Action Research Project. Human-Computer Interaction – INTERACT 2021: 18th IFIP TC 13 International Conference, Bari, Italy, August 30 – September 3, 2021, Proceedings, Part IV. editor / Carmelo Ardito ; Rosa Lanzilotti ; Alessio Malizia ; Alessio Malizia ; Helen Petrie ; Antonio Piccinno ; Giuseppe Desolda ; Kori Inkpen. Vol. IV Springer, 2021. pp. 320-338 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 12935 LNCS).

@inproceedings{0e3be7197ee7498899e12db2ac4c29c4,

title = "Introducing Asynchronous Remote Usability Testing in Practice: An Action Research Project",

abstract = "Asynchronous remote usability testing is a usability evaluation method where users and evaluators are separated both in time and space, and users are directly involved in producing the evaluation results. This paper reports from an action research project on introduction of asynchronous remote usability testing in the IT organization of a bank. The IT organization had extensive experience with traditional usability evaluation but was interested in introducing asynchronous remote usability testing into their repertoire of evaluation methods. The project was initiated with an intensive two-month collaboration followed by a six-month maturation phase. The process of introducing the method and the motivations of the IT organization for introducing the method are described in detail. The findings indicate that the conceptual understanding of usability evaluation and the engagement of the users are crucial for the outcome of the evaluation, and the tool and materials used for the evaluation was an obstacle for high-quality results.",

keywords = "Action research, Methods for HCI, Remote asynchronous usability evaluation, Usability evaluation",

author = "Pedersen, {Jonna Helene Holm} and Malene S{\o}rensen and Jan Stage and H{\o}egh, {Rune Thaarup}",

note = "Publisher Copyright: {\textcopyright} 2021, IFIP International Federation for Information Processing.; 18th IFIP TC 13 International Conference on Human-Computer Interaction, INTERACT 2021 ; Conference date: 30-08-2021 Through 03-09-2021",

year = "2021",

doi = "10.1007/978-3-030-85610-6_19",

language = "English",

isbn = "978-3-030-85609-0",

volume = "IV",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer",

pages = "320--338",

editor = "Carmelo Ardito and Rosa Lanzilotti and Alessio Malizia and Alessio Malizia and Helen Petrie and Antonio Piccinno and Giuseppe Desolda and Kori Inkpen",

booktitle = "Human-Computer Interaction – INTERACT 2021",

address = "Germany",

}

Pedersen, JHH, Sørensen, M, Stage, J & Høegh, RT 2021, Introducing Asynchronous Remote Usability Testing in Practice: An Action Research Project. in C Ardito, R Lanzilotti, A Malizia, A Malizia, H Petrie, A Piccinno, G Desolda & K Inkpen (eds), Human-Computer Interaction – INTERACT 2021: 18th IFIP TC 13 International Conference, Bari, Italy, August 30 – September 3, 2021, Proceedings, Part IV. vol. IV, Springer, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 12935 LNCS, pp. 320-338, 18th IFIP TC 13 International Conference on Human-Computer Interaction, INTERACT 2021, Virtual, Online, 30/08/2021. https://doi.org/10.1007/978-3-030-85610-6_19

Introducing Asynchronous Remote Usability Testing in Practice: An Action Research Project. / Pedersen, Jonna Helene Holm; Sørensen, Malene; Stage, Jan et al.
Human-Computer Interaction – INTERACT 2021: 18th IFIP TC 13 International Conference, Bari, Italy, August 30 – September 3, 2021, Proceedings, Part IV. ed. / Carmelo Ardito; Rosa Lanzilotti; Alessio Malizia; Alessio Malizia; Helen Petrie; Antonio Piccinno; Giuseppe Desolda; Kori Inkpen. Vol. IV Springer, 2021. p. 320-338 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 12935 LNCS).

Research output: Contribution to book/anthology/report/conference proceeding › Article in proceeding › Research › peer-review

TY - GEN

T1 - Introducing Asynchronous Remote Usability Testing in Practice

T2 - 18th IFIP TC 13 International Conference on Human-Computer Interaction, INTERACT 2021

AU - Pedersen, Jonna Helene Holm

AU - Sørensen, Malene

AU - Stage, Jan

AU - Høegh, Rune Thaarup

PY - 2021

Y1 - 2021

N2 - Asynchronous remote usability testing is a usability evaluation method where users and evaluators are separated both in time and space, and users are directly involved in producing the evaluation results. This paper reports from an action research project on introduction of asynchronous remote usability testing in the IT organization of a bank. The IT organization had extensive experience with traditional usability evaluation but was interested in introducing asynchronous remote usability testing into their repertoire of evaluation methods. The project was initiated with an intensive two-month collaboration followed by a six-month maturation phase. The process of introducing the method and the motivations of the IT organization for introducing the method are described in detail. The findings indicate that the conceptual understanding of usability evaluation and the engagement of the users are crucial for the outcome of the evaluation, and the tool and materials used for the evaluation was an obstacle for high-quality results.

AB - Asynchronous remote usability testing is a usability evaluation method where users and evaluators are separated both in time and space, and users are directly involved in producing the evaluation results. This paper reports from an action research project on introduction of asynchronous remote usability testing in the IT organization of a bank. The IT organization had extensive experience with traditional usability evaluation but was interested in introducing asynchronous remote usability testing into their repertoire of evaluation methods. The project was initiated with an intensive two-month collaboration followed by a six-month maturation phase. The process of introducing the method and the motivations of the IT organization for introducing the method are described in detail. The findings indicate that the conceptual understanding of usability evaluation and the engagement of the users are crucial for the outcome of the evaluation, and the tool and materials used for the evaluation was an obstacle for high-quality results.

KW - Action research

KW - Methods for HCI

KW - Remote asynchronous usability evaluation

KW - Usability evaluation

UR - http://www.scopus.com/inward/record.url?scp=85115241537&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-85610-6_19

DO - 10.1007/978-3-030-85610-6_19

M3 - Article in proceeding

AN - SCOPUS:85115241537

SN - 978-3-030-85609-0

VL - IV

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 320

EP - 338

BT - Human-Computer Interaction – INTERACT 2021

A2 - Ardito, Carmelo

A2 - Lanzilotti, Rosa

A2 - Malizia, Alessio

A2 - Petrie, Helen

A2 - Piccinno, Antonio

A2 - Desolda, Giuseppe

A2 - Inkpen, Kori

PB - Springer

Y2 - 30 August 2021 through 3 September 2021

ER -

Pedersen JHH, Sørensen M, Stage J, Høegh RT. Introducing Asynchronous Remote Usability Testing in Practice: An Action Research Project. In Ardito C, Lanzilotti R, Malizia A, Malizia A, Petrie H, Piccinno A, Desolda G, Inkpen K, editors, Human-Computer Interaction – INTERACT 2021: 18th IFIP TC 13 International Conference, Bari, Italy, August 30 – September 3, 2021, Proceedings, Part IV. Vol. IV. Springer. 2021. p. 320-338. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), Vol. 12935 LNCS). doi: 10.1007/978-3-030-85610-6_19

Introducing Asynchronous Remote Usability Testing in Practice: An Action Research Project

Abstract

Conference

Bibliographical note

Keywords

Access to Document

AUB Link

Other files and links

Fingerprint

Cite this