Skip to main content
SpringerLink
Log in

Influence of a performance indicator on Danish research production and citation impact 2000–12

  • Published:
Scientometrics Aims and scope Submit manuscript

Abstract

This paper analyses the patterns of Danish research productivity, citation impact and (inter)national collaboration across document types 2000–2012, prior to and after the introduction of the Norwegian publication point-based performance indicator in 2008. Document types analysed are: research articles; conference proceedings papers excluding meeting abstracts; and review articles. The Danish Research & Innovation Agency’s basic statistics combined with Web of Science (WoS) are used for data collection and analyses. Findings demonstrate that the research article productivity increases steeply (37 %) after the start of the performance indicator and the citation impact progresses linearly over the entire period, regardless the introduction of the performance indicator. Academic staff progression is only 24 % during the same time period. The collaboration ratio between purely Danish and internationally cooperated research articles remains stable during the period, the number of collaborative countries increases while the ratio declines significantly for proceedings papers. The citation impact of internationally cooperated research articles increases since 2009 but drops for proceedings papers; also their productivity declines slightly from 2009 according to Research Agency statistics. Since 2006 the WoS indexing of proceedings papers is fast declining; as a consequence the ratio between Danish proceedings papers and research articles declines in WoS. According to Research Agency statistics a decline likewise takes place, starting from 2009. The positive growth in research articles mainly derives from the Science and Technology fields published in prestigious Level 2 journals; the development of articles published in less prestigious Level 1 journals derives from all fields. Three of the eight Danish universities have significantly altered their research publication profiles since 2009. The publication performance model is regarded as the significant accelerator of these processes in recent years.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

Notes

  1. Proceedings papers include this WoS document category and exclude the category ‘Meeting Abstracts’.

References

  • Aagaard, K., Bloch, C., Schneider, J., Henriksen, D., Kjeldager Ryan, T., & Lauridsen, P. S. (2014). Evaluering af den norske publiceringsindikator (Eng.: Evaluation of the Norwegian publication indicator). Aarhus: Dansk center for Forskningsanalyse, Aarhus Universitet.

    Google Scholar 

  • Aagaard, K., & Schneider, J. W. (2012). Den danske bibliometriske model; En dårlig kopi af den norske. Forskningspolitikk, 1, 28–29.

    Google Scholar 

  • Butler, L. (2003). Explaining Australia’s increased share of ISI publications—the effects of a funding formula based on publication counts. Research Policy, 32(1), 143–155.

    Article  Google Scholar 

  • Butler, L. (2004). What happens when funding is linked to publication counts? In H. F. Moed, W. Glänzel, & U. Schmoch (Eds.), Handbook of Quantitative Science and Technology (pp. 340–389). London: Kluwer Academic Publishers.

    Google Scholar 

  • Butler, L., & Visser, M. S. (2006). Extending citation analysis to non-source items. Scientometrics, 66(10), 327–343.

    Article  Google Scholar 

  • Debackere, K., & Glänzel, W. (2004). Using a bibliometric approach to support research policy making: The case of the Flemish BOF-key. Scientometrics, 59, 253–276.

    Article  Google Scholar 

  • Engels, T. C. E., Ossenblok, T. L. B., & Spruyt, E. H. J. (2012). Changing publication patterns in the Social Sciences and Humanities, 2000–2009. Scientometrics, 93, 373–390.

    Article  Google Scholar 

  • Forskningsstyrelsen. (2013). The Danish Research & Innovation Agency. (in Danish) available at: http://www.fi.dk/viden-og-politik/tal-og-analyser/den-bibliometriske-forskningsindikator.

  • Glänzel, W. (2002). Co-authorship patterns and trends in the sciences (1980–1998): A bibliometric study with implications for database indexing and search strategies. Library Trends, 50(3), 461–473.

    Google Scholar 

  • He, Y., & Guan, J. C. (2008). Contribution of Chinese publications in computer science: A case study on LNCS. Scientometrics, 75(28), 519–534.

    Article  Google Scholar 

  • Ingwersen, P., & Larsen, B. (2013). Influence of university mergers and the Norwegian performance indicator on overall Danish citation impact 2000-12. Proceedings of the International Society of Scientometrics and Informetrics, Wien, August 2013.Vol 1, 16 p. Available in: http://issi2013.org/Images/ISSI_Proceedings_Volume_I.pdf.

  • Ingwersen, P., Larsen, B., Garcia-Zorita, J.C., Serrano-López, E.A., & Sanz-Casado, E. (2014). Influence of Proceedings Papers on Citation Impact in Seven Sub-fields of Sustainable Energy Research 2005-2011. Scientometrics (under review).

  • Luo, J. Y., Flynn, J. M., Solnick, R. E., Ecklund, E. H., & Matthews, K. R. W. (2011). International stem cell collaboration: How disparate policies between the United States and the United Kingdom impact research. Plos One, 6(3), 1–7.

    Article  Google Scholar 

  • Martins, W. S., Goncalves, M. A., Laender, A. H. F., & Ziviani, N. (2010). Assessing the quality of scientific conferences based on bibliographic citations. Scientometrics, 83(19), 133–155.

    Article  Google Scholar 

  • Moed, H. F. (2005). Citation analysis in research evaluation. Dordrecht: Springer.

    Google Scholar 

  • Narin, F., Stevens, K., & Whitlow, E. S. (1991). Scientific cooperation in Europe and the citation of multinationally authored papers. Scientometrics, 21(3), 313–323.

    Article  Google Scholar 

  • Ossenblok, T. L. B., Engels, T. C. E., & Sivertsen, G. (2012). The representation of the social sciences and humanities in the Web of Science. A comparison of publication patterns and incentive structures in Flanders and Norway (2005–2009). Research Evaluation, 21(4), 280–290.

    Article  Google Scholar 

  • Schneider, J. W. (2009). An outline of the bibliometric indicator used for performance-based funding of research institutions in Norway. European Political Science, 8(3), 364–378.

    Article  Google Scholar 

  • Sivertsen, G. (2010). A performance indicator based on complete data for the scientific publication output at research institutions. ISSI Newsletter, 6(19), 22–28.

    Google Scholar 

  • Sivertsen, G., & Schneider J. W. (2012). Evaluering av den bibliometriske forskningsindikator. Oslo: NIFU. 75 p. (Rapport 17/2012, in Norwegian).

  • van Raan, A. F. J. (1999). Advanced bibliometric methods for evaluation of universities. Scientometrics, 45(3), 417–423.

    Article  Google Scholar 

  • van Raan, A. F. J. (2005). Fatal attraction: Conceptual and methodological problems in the ranking of universities by bibliometric methods. Scientometrics, 62(1), 133–143.

    Article  Google Scholar 

  • http://www.forskeren.dk. Visited 22 Apr 2013.

  • http://professorvaelde.blogspot.com. Visited 22 Apr 2013.

  • Wainer, J., de Oliveira, H. P., & Anido, R. (2011). Patterns of bibliographic references in the ACM published papers. Information Processing & Management, 47(13), 135–142.

    Article  Google Scholar 

  • Thomson-Reuters. ISI. http://wokinfo.com/products_tools/multidicplinary/webodscience/cpci/.

Download references

Acknowledgment

We wish to thank Karen Skytte Larsen from the Danish Agency of Research & Innovation for access to the Agency data.

Author information

Authors and Affiliations

  1. Royal School of Information and Library Science, University of Copenhagen, Birketinget 6, 2300, Copenhagen S, Denmark

    Peter Ingwersen

  2. Department of Communication and Psychology, Aalborg University Copenhagen, A.C. Meyers Vænge 15, 2450, Copenhagen SV, Denmark

    Birger Larsen

Authors
  1. Peter Ingwersen
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Birger Larsen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Peter Ingwersen.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ingwersen, P., Larsen, B. Influence of a performance indicator on Danish research production and citation impact 2000–12. Scientometrics 101, 1325–1344 (2014). https://doi.org/10.1007/s11192-014-1291-x

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11192-014-1291-x

Keywords

Search

Navigation