Constructive eHealth evaluation: Lessons from evaluation of EHR development in 4 Danish hospitals

Research output: Contribution to journalJournal articleResearchpeer-review

1 Citation (Scopus)
192 Downloads (Pure)

Abstract


Abstract
Background: Information and communication sources in the healthcare sector are replaced with new eHealth technologies. This has led to problems arising from the lack of awareness of the importance of end-user involvement in eHealth development and of the difficulties caused by using traditional summative evaluation methods. The Constructive eHealth evaluation method (CeHEM) provides a solution to these problems by offering an evaluation framework for supporting and facilitating end-user involvement during all phases of eHealth development. The aim of this paper is to support this process by sharing experiences of the eHealth evaluation method used in the introduction of electronic health records (EHR) in the North Denmark Region of Denmark. It is the first time the fully developed method and the experiences on using the CeHEM in all five phases of a full lifecycle framework is presented.
Methods: A case study evaluation of the EHR development process in the North Denmark Region was conducted from 2004 to 2010. The population consisted of clinicians, IT professionals, administrators, and vendors. The study involved 4 hospitals in the region. Data were collected using questionnaires, observations, interviews, and insight gathered from relevant documents.
Results: The evaluation showed a need for a) Early involvement of clinicians, b) The best possible representation of clinicians, and c) Workload reduction for those involved. The consequences of not providing this were a lack of ownership of decisions and negative attitudes towards the clinical benefits related to these decisions.
Further, the result disclosed that by following the above recommendations, and by providing feedback to the 4 actor groups, the physicians’ involvement was improved. As a result they took ownership of decisions and gained a positive attitude to the clinical benefits.
Conclusions: The CeHEM has proven successful in formative evaluation of EHR development and can point at important issues that need to be taken care of by management. The method provides a framework that takes care of feedback and learning during eHealth development. It can thus support successful eHealth development in a broader context while building on a well-known success factor: end-user involvement in eHealth development.
Keywords: User involvement, End-user participation, Formative evaluation, eHealth development, Evaluation method, Constructive eHealth evaluation, Participation, End-user, Health information technology, Organizational factors
Original languageEnglish
Article number45
JournalBMC Medical Informatics and Decision Making
Volume17
Number of pages15
ISSN1472-6947
DOIs
Publication statusPublished - 2017

Fingerprint

Telemedicine
Electronic Health Records
Denmark
Ownership
Medical Informatics
Health Care Sector
Workload
Administrative Personnel
Communication
Interviews

Cite this

@article{c8045c713c894f448c1271664ca0ed6f,
title = "Constructive eHealth evaluation: Lessons from evaluation of EHR development in 4 Danish hospitals",
abstract = "AbstractBackground: Information and communication sources in the healthcare sector are replaced with new eHealth technologies. This has led to problems arising from the lack of awareness of the importance of end-user involvement in eHealth development and of the difficulties caused by using traditional summative evaluation methods. The Constructive eHealth evaluation method (CeHEM) provides a solution to these problems by offering an evaluation framework for supporting and facilitating end-user involvement during all phases of eHealth development. The aim of this paper is to support this process by sharing experiences of the eHealth evaluation method used in the introduction of electronic health records (EHR) in the North Denmark Region of Denmark. It is the first time the fully developed method and the experiences on using the CeHEM in all five phases of a full lifecycle framework is presented.Methods: A case study evaluation of the EHR development process in the North Denmark Region was conducted from 2004 to 2010. The population consisted of clinicians, IT professionals, administrators, and vendors. The study involved 4 hospitals in the region. Data were collected using questionnaires, observations, interviews, and insight gathered from relevant documents.Results: The evaluation showed a need for a) Early involvement of clinicians, b) The best possible representation of clinicians, and c) Workload reduction for those involved. The consequences of not providing this were a lack of ownership of decisions and negative attitudes towards the clinical benefits related to these decisions.Further, the result disclosed that by following the above recommendations, and by providing feedback to the 4 actor groups, the physicians’ involvement was improved. As a result they took ownership of decisions and gained a positive attitude to the clinical benefits.Conclusions: The CeHEM has proven successful in formative evaluation of EHR development and can point at important issues that need to be taken care of by management. The method provides a framework that takes care of feedback and learning during eHealth development. It can thus support successful eHealth development in a broader context while building on a well-known success factor: end-user involvement in eHealth development.Keywords: User involvement, End-user participation, Formative evaluation, eHealth development, Evaluation method, Constructive eHealth evaluation, Participation, End-user, Health information technology, Organizational factors",
author = "H{\o}stgaard, {Anna Marie Balling} and Bertelsen, {Pernille Scholdan} and Christian N{\o}hr",
year = "2017",
doi = "10.1186/s12911-017-0444-2",
language = "English",
volume = "17",
journal = "B M C Medical Informatics and Decision Making",
issn = "1472-6947",
publisher = "BioMed Central",

}

Constructive eHealth evaluation : Lessons from evaluation of EHR development in 4 Danish hospitals. / Høstgaard, Anna Marie Balling; Bertelsen, Pernille Scholdan; Nøhr, Christian.

In: BMC Medical Informatics and Decision Making, Vol. 17, 45, 2017.

Research output: Contribution to journalJournal articleResearchpeer-review

TY - JOUR

T1 - Constructive eHealth evaluation

T2 - Lessons from evaluation of EHR development in 4 Danish hospitals

AU - Høstgaard, Anna Marie Balling

AU - Bertelsen, Pernille Scholdan

AU - Nøhr, Christian

PY - 2017

Y1 - 2017

N2 - AbstractBackground: Information and communication sources in the healthcare sector are replaced with new eHealth technologies. This has led to problems arising from the lack of awareness of the importance of end-user involvement in eHealth development and of the difficulties caused by using traditional summative evaluation methods. The Constructive eHealth evaluation method (CeHEM) provides a solution to these problems by offering an evaluation framework for supporting and facilitating end-user involvement during all phases of eHealth development. The aim of this paper is to support this process by sharing experiences of the eHealth evaluation method used in the introduction of electronic health records (EHR) in the North Denmark Region of Denmark. It is the first time the fully developed method and the experiences on using the CeHEM in all five phases of a full lifecycle framework is presented.Methods: A case study evaluation of the EHR development process in the North Denmark Region was conducted from 2004 to 2010. The population consisted of clinicians, IT professionals, administrators, and vendors. The study involved 4 hospitals in the region. Data were collected using questionnaires, observations, interviews, and insight gathered from relevant documents.Results: The evaluation showed a need for a) Early involvement of clinicians, b) The best possible representation of clinicians, and c) Workload reduction for those involved. The consequences of not providing this were a lack of ownership of decisions and negative attitudes towards the clinical benefits related to these decisions.Further, the result disclosed that by following the above recommendations, and by providing feedback to the 4 actor groups, the physicians’ involvement was improved. As a result they took ownership of decisions and gained a positive attitude to the clinical benefits.Conclusions: The CeHEM has proven successful in formative evaluation of EHR development and can point at important issues that need to be taken care of by management. The method provides a framework that takes care of feedback and learning during eHealth development. It can thus support successful eHealth development in a broader context while building on a well-known success factor: end-user involvement in eHealth development.Keywords: User involvement, End-user participation, Formative evaluation, eHealth development, Evaluation method, Constructive eHealth evaluation, Participation, End-user, Health information technology, Organizational factors

AB - AbstractBackground: Information and communication sources in the healthcare sector are replaced with new eHealth technologies. This has led to problems arising from the lack of awareness of the importance of end-user involvement in eHealth development and of the difficulties caused by using traditional summative evaluation methods. The Constructive eHealth evaluation method (CeHEM) provides a solution to these problems by offering an evaluation framework for supporting and facilitating end-user involvement during all phases of eHealth development. The aim of this paper is to support this process by sharing experiences of the eHealth evaluation method used in the introduction of electronic health records (EHR) in the North Denmark Region of Denmark. It is the first time the fully developed method and the experiences on using the CeHEM in all five phases of a full lifecycle framework is presented.Methods: A case study evaluation of the EHR development process in the North Denmark Region was conducted from 2004 to 2010. The population consisted of clinicians, IT professionals, administrators, and vendors. The study involved 4 hospitals in the region. Data were collected using questionnaires, observations, interviews, and insight gathered from relevant documents.Results: The evaluation showed a need for a) Early involvement of clinicians, b) The best possible representation of clinicians, and c) Workload reduction for those involved. The consequences of not providing this were a lack of ownership of decisions and negative attitudes towards the clinical benefits related to these decisions.Further, the result disclosed that by following the above recommendations, and by providing feedback to the 4 actor groups, the physicians’ involvement was improved. As a result they took ownership of decisions and gained a positive attitude to the clinical benefits.Conclusions: The CeHEM has proven successful in formative evaluation of EHR development and can point at important issues that need to be taken care of by management. The method provides a framework that takes care of feedback and learning during eHealth development. It can thus support successful eHealth development in a broader context while building on a well-known success factor: end-user involvement in eHealth development.Keywords: User involvement, End-user participation, Formative evaluation, eHealth development, Evaluation method, Constructive eHealth evaluation, Participation, End-user, Health information technology, Organizational factors

U2 - 10.1186/s12911-017-0444-2

DO - 10.1186/s12911-017-0444-2

M3 - Journal article

VL - 17

JO - B M C Medical Informatics and Decision Making

JF - B M C Medical Informatics and Decision Making

SN - 1472-6947

M1 - 45

ER -