Research performance management in a CRIS environment: Does research evaluation affect publishing activity?

Brian Kirkegaard Lunn, Poul Meier Melchiorsen, Nils Thidemann, John Kruuse, Anne Lyhne Høj, Sabine Dreier Elgaard Jensen, Maria Abildgaard Madsen, Anne Marya Jensen

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

1 Citation (Scopus)
578 Downloads (Pure)

Abstract

In this article we describe the results from a study of researchers’ publishing activity at one Danish university before and after the implementation
of a national research evaluation system (RES). More specifically,
we investigate the extent to which researchers at Aalborg University publish in prestigious journals in a period of ten years.
Different yardsticks were used to measure the prestige of publications; an internal yardstick and several external yardsticks. The internal yardstick has been developed as part of the Bibliometric Research Indicator, namely the Authority List of Journals. The external yardsticks are the share of publications in Web of Science and Scopus and their measures of prestige, namely the Journal Impact Factor (JIF) and the Source Normalised Impact per Paper (SNIP).
The results regarding the publishing activity as measured by the national Danish RES show that the share of publications without level decreases, the share of publications in ‘normal’ (level 1) journals increases and the share of publications in ‘prestigious’ (level 2) journals is status quo.
The results regarding the publishing activity measured in relation to external yardsticks show that Aalborg University has had a relative larger
increase than Denmark and Norway in the amount of Scopus publications.
Aalborg University has also had a larger increase than Denmark in the amount of WOS publications. The results also show that Aalborg
University has published in slightly more prestigious journals if measured by JIF and SNIP. However, we do not have evidence supporting the
assumption underlying the implementation of the Bibliometric Research
Indicator, namely an increase in publications in prestigious journals.
Original languageEnglish
Title of host publicatione-­‐Infrastructures for Research and Innovation : Linking Information Systems to Improve Scientific Knowledge Production: Proceedings of the 11th International Conference on Current Research Information Systems
EditorsKeith G Jeffery, Jan Dvorák
Number of pages10
Place of PublicationPrag
PublisherAgentura Action M
Publication date2012
Pages233-242
ISBN (Print)978-80-86742-33-5
Publication statusPublished - 2012
Event11th international Conference on Current Research Information Systems:E-infrastructures for Research and Innovation: Linking Information Systems to Improve Scientific Knowledge Production - Prag, Czech Republic
Duration: 6 Jun 20129 Jun 2012
Conference number: 11

Conference

Conference11th international Conference on Current Research Information Systems:E-infrastructures for Research and Innovation
Number11
CountryCzech Republic
CityPrag
Period06/06/201209/06/2012

Fingerprint

evaluation research
management
performance
indicator research
prestige
Denmark
Norway
university
science

Cite this

Lunn, B. K., Melchiorsen, P. M., Thidemann, N., Kruuse, J., Høj, A. L., Jensen, S. D. E., ... Jensen, A. M. (2012). Research performance management in a CRIS environment: Does research evaluation affect publishing activity? In K. G. Jeffery, & J. Dvorák (Eds.), e-­‐Infrastructures for Research and Innovation: Linking Information Systems to Improve Scientific Knowledge Production: Proceedings of the 11th International Conference on Current Research Information Systems (pp. 233-242). Prag: Agentura Action M.
Lunn, Brian Kirkegaard ; Melchiorsen, Poul Meier ; Thidemann, Nils ; Kruuse, John ; Høj, Anne Lyhne ; Jensen, Sabine Dreier Elgaard ; Madsen, Maria Abildgaard ; Jensen, Anne Marya. / Research performance management in a CRIS environment : Does research evaluation affect publishing activity?. e-­‐Infrastructures for Research and Innovation: Linking Information Systems to Improve Scientific Knowledge Production: Proceedings of the 11th International Conference on Current Research Information Systems. editor / Keith G Jeffery ; Jan Dvorák. Prag : Agentura Action M, 2012. pp. 233-242
@inproceedings{7217f4cec0ce485db8a9f47fa40aa82c,
title = "Research performance management in a CRIS environment: Does research evaluation affect publishing activity?",
abstract = "In this article we describe the results from a study of researchers’ publishing activity at one Danish university before and after the implementation of a national research evaluation system (RES). More specifically,we investigate the extent to which researchers at Aalborg University publish in prestigious journals in a period of ten years. Different yardsticks were used to measure the prestige of publications; an internal yardstick and several external yardsticks. The internal yardstick has been developed as part of the Bibliometric Research Indicator, namely the Authority List of Journals. The external yardsticks are the share of publications in Web of Science and Scopus and their measures of prestige, namely the Journal Impact Factor (JIF) and the Source Normalised Impact per Paper (SNIP).The results regarding the publishing activity as measured by the national Danish RES show that the share of publications without level decreases, the share of publications in ‘normal’ (level 1) journals increases and the share of publications in ‘prestigious’ (level 2) journals is status quo. The results regarding the publishing activity measured in relation to external yardsticks show that Aalborg University has had a relative larger increase than Denmark and Norway in the amount of Scopus publications. Aalborg University has also had a larger increase than Denmark in the amount of WOS publications. The results also show that Aalborg University has published in slightly more prestigious journals if measured by JIF and SNIP. However, we do not have evidence supporting the assumption underlying the implementation of the Bibliometric Research Indicator, namely an increase in publications in prestigious journals.",
author = "Lunn, {Brian Kirkegaard} and Melchiorsen, {Poul Meier} and Nils Thidemann and John Kruuse and H{\o}j, {Anne Lyhne} and Jensen, {Sabine Dreier Elgaard} and Madsen, {Maria Abildgaard} and Jensen, {Anne Marya}",
year = "2012",
language = "English",
isbn = "978-80-86742-33-5",
pages = "233--242",
editor = "Jeffery, {Keith G} and Jan Dvor{\'a}k",
booktitle = "e-­‐Infrastructures for Research and Innovation",
publisher = "Agentura Action M",

}

Lunn, BK, Melchiorsen, PM, Thidemann, N, Kruuse, J, Høj, AL, Jensen, SDE, Madsen, MA & Jensen, AM 2012, Research performance management in a CRIS environment: Does research evaluation affect publishing activity? in KG Jeffery & J Dvorák (eds), e-­‐Infrastructures for Research and Innovation: Linking Information Systems to Improve Scientific Knowledge Production: Proceedings of the 11th International Conference on Current Research Information Systems. Agentura Action M, Prag, pp. 233-242, 11th international Conference on Current Research Information Systems:E-infrastructures for Research and Innovation, Prag, Czech Republic, 06/06/2012.

Research performance management in a CRIS environment : Does research evaluation affect publishing activity? / Lunn, Brian Kirkegaard; Melchiorsen, Poul Meier; Thidemann, Nils; Kruuse, John; Høj, Anne Lyhne; Jensen, Sabine Dreier Elgaard; Madsen, Maria Abildgaard; Jensen, Anne Marya.

e-­‐Infrastructures for Research and Innovation: Linking Information Systems to Improve Scientific Knowledge Production: Proceedings of the 11th International Conference on Current Research Information Systems. ed. / Keith G Jeffery; Jan Dvorák. Prag : Agentura Action M, 2012. p. 233-242.

Research output: Contribution to book/anthology/report/conference proceedingArticle in proceedingResearchpeer-review

TY - GEN

T1 - Research performance management in a CRIS environment

T2 - Does research evaluation affect publishing activity?

AU - Lunn, Brian Kirkegaard

AU - Melchiorsen, Poul Meier

AU - Thidemann, Nils

AU - Kruuse, John

AU - Høj, Anne Lyhne

AU - Jensen, Sabine Dreier Elgaard

AU - Madsen, Maria Abildgaard

AU - Jensen, Anne Marya

PY - 2012

Y1 - 2012

N2 - In this article we describe the results from a study of researchers’ publishing activity at one Danish university before and after the implementation of a national research evaluation system (RES). More specifically,we investigate the extent to which researchers at Aalborg University publish in prestigious journals in a period of ten years. Different yardsticks were used to measure the prestige of publications; an internal yardstick and several external yardsticks. The internal yardstick has been developed as part of the Bibliometric Research Indicator, namely the Authority List of Journals. The external yardsticks are the share of publications in Web of Science and Scopus and their measures of prestige, namely the Journal Impact Factor (JIF) and the Source Normalised Impact per Paper (SNIP).The results regarding the publishing activity as measured by the national Danish RES show that the share of publications without level decreases, the share of publications in ‘normal’ (level 1) journals increases and the share of publications in ‘prestigious’ (level 2) journals is status quo. The results regarding the publishing activity measured in relation to external yardsticks show that Aalborg University has had a relative larger increase than Denmark and Norway in the amount of Scopus publications. Aalborg University has also had a larger increase than Denmark in the amount of WOS publications. The results also show that Aalborg University has published in slightly more prestigious journals if measured by JIF and SNIP. However, we do not have evidence supporting the assumption underlying the implementation of the Bibliometric Research Indicator, namely an increase in publications in prestigious journals.

AB - In this article we describe the results from a study of researchers’ publishing activity at one Danish university before and after the implementation of a national research evaluation system (RES). More specifically,we investigate the extent to which researchers at Aalborg University publish in prestigious journals in a period of ten years. Different yardsticks were used to measure the prestige of publications; an internal yardstick and several external yardsticks. The internal yardstick has been developed as part of the Bibliometric Research Indicator, namely the Authority List of Journals. The external yardsticks are the share of publications in Web of Science and Scopus and their measures of prestige, namely the Journal Impact Factor (JIF) and the Source Normalised Impact per Paper (SNIP).The results regarding the publishing activity as measured by the national Danish RES show that the share of publications without level decreases, the share of publications in ‘normal’ (level 1) journals increases and the share of publications in ‘prestigious’ (level 2) journals is status quo. The results regarding the publishing activity measured in relation to external yardsticks show that Aalborg University has had a relative larger increase than Denmark and Norway in the amount of Scopus publications. Aalborg University has also had a larger increase than Denmark in the amount of WOS publications. The results also show that Aalborg University has published in slightly more prestigious journals if measured by JIF and SNIP. However, we do not have evidence supporting the assumption underlying the implementation of the Bibliometric Research Indicator, namely an increase in publications in prestigious journals.

M3 - Article in proceeding

SN - 978-80-86742-33-5

SP - 233

EP - 242

BT - e-­‐Infrastructures for Research and Innovation

A2 - Jeffery, Keith G

A2 - Dvorák, Jan

PB - Agentura Action M

CY - Prag

ER -

Lunn BK, Melchiorsen PM, Thidemann N, Kruuse J, Høj AL, Jensen SDE et al. Research performance management in a CRIS environment: Does research evaluation affect publishing activity? In Jeffery KG, Dvorák J, editors, e-­‐Infrastructures for Research and Innovation: Linking Information Systems to Improve Scientific Knowledge Production: Proceedings of the 11th International Conference on Current Research Information Systems. Prag: Agentura Action M. 2012. p. 233-242