Skip to main content

2017 | OriginalPaper | Buchkapitel

Metrics and Rankings: Myths and Fallacies

verfasst von : Yannis Manolopoulos, Dimitrios Katsaros

Erschienen in: Data Analytics and Management in Data Intensive Domains

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In this paper we provide an introduction to the field of Bibliometrics. In particular, first we briefly describe its beginning and its evolution; we mention the main research fora as well. Further we categorize metrics according to their entity scope: metrics for journals, conferences and authors. Several rankings have appeared based on such metrics. It is argued that these metrics and rankings should be treated with caution, in a light relative way and not in an absolute manner. Primarily, it is the human expertise that can rigorously evaluate the above entities.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
4.
Zurück zum Zitat Althouse, B., West, J., Bergstrom, T., Bergstrom, C.: Differences in impact factor across fields and over time. J. Am. Soc. Inf. Sci. Technol. 60(1), 27–34 (2009)CrossRef Althouse, B., West, J., Bergstrom, T., Bergstrom, C.: Differences in impact factor across fields and over time. J. Am. Soc. Inf. Sci. Technol. 60(1), 27–34 (2009)CrossRef
6.
Zurück zum Zitat Bergstrom, C.T., West, J.D., Wiseman, M.A.: The Eigenfactor metrics. J. Neurosci. 28(45), 11433–11434 (2008)CrossRef Bergstrom, C.T., West, J.D., Wiseman, M.A.: The Eigenfactor metrics. J. Neurosci. 28(45), 11433–11434 (2008)CrossRef
8.
Zurück zum Zitat Bollen, J., van de Sompel, H., Hagberg, A., Chute, R.: A principal component analysis of 39 scientific impact measures. PLoS ONE 4, e6022 (2009)CrossRef Bollen, J., van de Sompel, H., Hagberg, A., Chute, R.: A principal component analysis of 39 scientific impact measures. PLoS ONE 4, e6022 (2009)CrossRef
9.
Zurück zum Zitat Bornmann, L., Haunschild, R.: Relative Citation Ratio (RCR): an empirical attempt to study a new field-normalized bibliometric indicator, J. Assoc. Inf. Sci. Technol. (2017, to appear) Bornmann, L., Haunschild, R.: Relative Citation Ratio (RCR): an empirical attempt to study a new field-normalized bibliometric indicator, J. Assoc. Inf. Sci. Technol. (2017, to appear)
10.
Zurück zum Zitat Bornmann, L., Mutz, R., Hug, S., Daniel, H.D.: A multilevel meta-analysis of studies reporting correlations between the h-index and 37 different h-index variants. J. Inform. 5(3), 346–359 (2011)CrossRef Bornmann, L., Mutz, R., Hug, S., Daniel, H.D.: A multilevel meta-analysis of studies reporting correlations between the h-index and 37 different h-index variants. J. Inform. 5(3), 346–359 (2011)CrossRef
11.
Zurück zum Zitat Brin, S., Page, L.: The anatomy of a large-scale hypertextual web search engine. Comput. Netw. ISDN Syst. 30(1–7), 107–117 (1998)CrossRef Brin, S., Page, L.: The anatomy of a large-scale hypertextual web search engine. Comput. Netw. ISDN Syst. 30(1–7), 107–117 (1998)CrossRef
12.
Zurück zum Zitat Campbell, P.: Escape from the impact factor. Ethics Sci. Environ. Politics 8, 5–7 (2008)CrossRef Campbell, P.: Escape from the impact factor. Ethics Sci. Environ. Politics 8, 5–7 (2008)CrossRef
13.
Zurück zum Zitat Callaway, E.: Publishing elite turns against impact factor. Nature 535, 210–211 (2016)CrossRef Callaway, E.: Publishing elite turns against impact factor. Nature 535, 210–211 (2016)CrossRef
25.
Zurück zum Zitat Garfield, E.: Citation indexes for science: a new dimension in documentation through association of ideas. Science 122, 108–111 (1955)CrossRef Garfield, E.: Citation indexes for science: a new dimension in documentation through association of ideas. Science 122, 108–111 (1955)CrossRef
26.
Zurück zum Zitat Giles, C.L., Bollacker, K., Lawrence, S.: CiteSeer: an automatic citation indexing system. In: Proceedings 3rd ACM Conference on Digital Libraries, pp. 89–98 (1998) Giles, C.L., Bollacker, K., Lawrence, S.: CiteSeer: an automatic citation indexing system. In: Proceedings 3rd ACM Conference on Digital Libraries, pp. 89–98 (1998)
27.
Zurück zum Zitat Gogoglou, A., Sidiropoulos, A., Katsaros, D., Manolopoulos, Y.: Quantifying an individual’s scientific output using the fractal dimension of the whole citation curve, In: Proceedings 12th International Conference on Webometrics, Informetrics & Scientometrics (WIS), Nancy (2016) Gogoglou, A., Sidiropoulos, A., Katsaros, D., Manolopoulos, Y.: Quantifying an individual’s scientific output using the fractal dimension of the whole citation curve, In: Proceedings 12th International Conference on Webometrics, Informetrics & Scientometrics (WIS), Nancy (2016)
29.
Zurück zum Zitat Gupta, H., Campanha, J., Pesce, R.: Power-law distributions for the citation index of scientific publications and scientists. Braz. J. Phys. 35(4a), 981–986 (2005)CrossRef Gupta, H., Campanha, J., Pesce, R.: Power-law distributions for the citation index of scientific publications and scientists. Braz. J. Phys. 35(4a), 981–986 (2005)CrossRef
30.
Zurück zum Zitat Harzing, A.W.: Publish or Perish, Tarma Software Research (2010) Harzing, A.W.: Publish or Perish, Tarma Software Research (2010)
31.
Zurück zum Zitat Hicks, D., Wouters, P., Waltman, L., de Rijke, S., Rafols, I.: The Leiden Manifesto for research metrics. Nature 520(7548), 429–431 (2015)CrossRef Hicks, D., Wouters, P., Waltman, L., de Rijke, S., Rafols, I.: The Leiden Manifesto for research metrics. Nature 520(7548), 429–431 (2015)CrossRef
32.
Zurück zum Zitat Hirsch, J.E.: An index to quantify an individual’s scientific research output. Proc. Natl. Acad. Sci. 102(46), 16569–16572 (2005)CrossRefMATH Hirsch, J.E.: An index to quantify an individual’s scientific research output. Proc. Natl. Acad. Sci. 102(46), 16569–16572 (2005)CrossRefMATH
33.
Zurück zum Zitat Hvistendahl, M.: China’s publication bazaar. Science 342(6162), 1035–1039 (2013)CrossRef Hvistendahl, M.: China’s publication bazaar. Science 342(6162), 1035–1039 (2013)CrossRef
37.
Zurück zum Zitat Hutchins, B.I., Yuan, X., Anderson, J.M., Santangelo, G.M.: Relative Citation Ratio (RCR): a new metric that uses citation rates to measure influence at the article level. PLoS Biol. 14(9), e1002541 (2016)CrossRef Hutchins, B.I., Yuan, X., Anderson, J.M., Santangelo, G.M.: Relative Citation Ratio (RCR): a new metric that uses citation rates to measure influence at the article level. PLoS Biol. 14(9), e1002541 (2016)CrossRef
38.
Zurück zum Zitat ImpactStory Blog. A new framework for altmetrics (2012) ImpactStory Blog. A new framework for altmetrics (2012)
39.
Zurück zum Zitat Kuo, W., Rupe, J.: R-impact factor: reliability-based citation impact factor. IEEE Trans. Reliab. 56(3), 366–367 (2007)CrossRef Kuo, W., Rupe, J.: R-impact factor: reliability-based citation impact factor. IEEE Trans. Reliab. 56(3), 366–367 (2007)CrossRef
41.
Zurück zum Zitat Lariviere, V., Kiermer, V., MacCallum, C.J., McNutt, M., Patterson, M., Pulverer, B., Swaminathan, S., Taylor, S., Curry, S.: A simple proposal for the publication of journal citation distributions, Technical report. http://dx.doi.org/10.1101/062109 Lariviere, V., Kiermer, V., MacCallum, C.J., McNutt, M., Patterson, M., Pulverer, B., Swaminathan, S., Taylor, S., Curry, S.: A simple proposal for the publication of journal citation distributions, Technical report. http://​dx.​doi.​org/​10.​1101/​062109
42.
Zurück zum Zitat Lee, D., Kang, J., Mitra, P., Giles, L., On, B.W.: Are your citations clean? Commun. ACM 50(12), 33–38 (2007)CrossRef Lee, D., Kang, J., Mitra, P., Giles, L., On, B.W.: Are your citations clean? Commun. ACM 50(12), 33–38 (2007)CrossRef
43.
Zurück zum Zitat Manolopoulos, Y.: On the value and use of metrics and rankings: a position paper. In: Selected Papers of the 18th International Conference on Data Analytics & Management in Data Intensive Domains (DAMDID 2016), vol. 1752, pp. 133–139. CEUR Workshop Proceedings (2016) Manolopoulos, Y.: On the value and use of metrics and rankings: a position paper. In: Selected Papers of the 18th International Conference on Data Analytics & Management in Data Intensive Domains (DAMDID 2016), vol. 1752, pp. 133–139. CEUR Workshop Proceedings (2016)
45.
Zurück zum Zitat Nalimov, V., Mul’chenko, Z.M.: Naukometriya, the study of the development of science as an information process in Russian, p. 191. Nauka, Moscow (1969) Nalimov, V., Mul’chenko, Z.M.: Naukometriya, the study of the development of science as an information process in Russian, p. 191. Nauka, Moscow (1969)
47.
Zurück zum Zitat Nature Publishing Group: A guide to the nature index. Nature 515(7526), S94 (2014)CrossRef Nature Publishing Group: A guide to the nature index. Nature 515(7526), S94 (2014)CrossRef
48.
Zurück zum Zitat Piazza, R.: On house renovation and co-authoring – tricks of the trade to boost your h-index. Europhys. News 46(1), 19–22 (2015)CrossRef Piazza, R.: On house renovation and co-authoring – tricks of the trade to boost your h-index. Europhys. News 46(1), 19–22 (2015)CrossRef
49.
Zurück zum Zitat Priem, J., Taraborelli, D., Groth, P., Neylon, C.: Altmetrics: a manifesto. altmetrics.org Priem, J., Taraborelli, D., Groth, P., Neylon, C.: Altmetrics: a manifesto. altmetrics.org
50.
Zurück zum Zitat Pritchard, A.: Statistical bibliography or bibliometrics? J. Doc. 25(4), 348–349 (1969) Pritchard, A.: Statistical bibliography or bibliometrics? J. Doc. 25(4), 348–349 (1969)
57.
Zurück zum Zitat Sidiropoulos, A., Katsaros, D., Manolopoulos, Y.: Generalized Hirsch h-index for disclosing latent facts in citation networks. Scientometrics 72(2), 253–280 (2007)CrossRef Sidiropoulos, A., Katsaros, D., Manolopoulos, Y.: Generalized Hirsch h-index for disclosing latent facts in citation networks. Scientometrics 72(2), 253–280 (2007)CrossRef
58.
Zurück zum Zitat Sidiropoulos, A., Katsaros, D., Manolopoulos, Y.: Ranking and identifying influential scientists vs. mass producers by the perfectionism index. Scientometrics 103(1), 1–31 (2015)CrossRef Sidiropoulos, A., Katsaros, D., Manolopoulos, Y.: Ranking and identifying influential scientists vs. mass producers by the perfectionism index. Scientometrics 103(1), 1–31 (2015)CrossRef
61.
Zurück zum Zitat Todeschini, R., Baccini, A.: Handbook of Bibliometric Indicators. Wiley (2016) Todeschini, R., Baccini, A.: Handbook of Bibliometric Indicators. Wiley (2016)
62.
Zurück zum Zitat Tüür-Fröhlich, T.: The Non-trivial Effects of Trivial Errors in Scientific Communication and Evaluation. Verlag Werner Hülsbusch, Glückstadt (2016) Tüür-Fröhlich, T.: The Non-trivial Effects of Trivial Errors in Scientific Communication and Evaluation. Verlag Werner Hülsbusch, Glückstadt (2016)
64.
Zurück zum Zitat Van Bevern, R., Komusiewicz, C., Niedermeier, R., Sorge, M., Walsh, T.: H-index manipulation by merging articles: models, theory and experiments. Artif. Intell. 240, 19–35 (2016)MathSciNetCrossRefMATH Van Bevern, R., Komusiewicz, C., Niedermeier, R., Sorge, M., Walsh, T.: H-index manipulation by merging articles: models, theory and experiments. Artif. Intell. 240, 19–35 (2016)MathSciNetCrossRefMATH
65.
Zurück zum Zitat van Noorden, R.: Impact factor gets heavyweight rival: citeScore uses larger database and gets different results. Nature 540, 325–326 (2016)CrossRef van Noorden, R.: Impact factor gets heavyweight rival: citeScore uses larger database and gets different results. Nature 540, 325–326 (2016)CrossRef
66.
Zurück zum Zitat Vardi, M.: Academic rankings considered harmful! Commun. ACM 59(9), 5 (2016)CrossRef Vardi, M.: Academic rankings considered harmful! Commun. ACM 59(9), 5 (2016)CrossRef
67.
Zurück zum Zitat Vitanov, N.: Science Dynamics and Research Production. Springer, Cham (2016)CrossRef Vitanov, N.: Science Dynamics and Research Production. Springer, Cham (2016)CrossRef
69.
Zurück zum Zitat Wildgaard, L., Schneider, J.W., Larsen, B.: A review of the characteristics of 108 author-level bibliometric indicators. Scientometrics 101, 125–158 (2014)CrossRef Wildgaard, L., Schneider, J.W., Larsen, B.: A review of the characteristics of 108 author-level bibliometric indicators. Scientometrics 101, 125–158 (2014)CrossRef
70.
Zurück zum Zitat Yan, Z., Wu, Q., Li, X.: Do Hirsch-type indices behave the same in assessing single publications? An empirical study of 29 bibliometric indicators. Scientometrics 109(3), 1815–1833 (2016)CrossRef Yan, Z., Wu, Q., Li, X.: Do Hirsch-type indices behave the same in assessing single publications? An empirical study of 29 bibliometric indicators. Scientometrics 109(3), 1815–1833 (2016)CrossRef
Metadaten
Titel
Metrics and Rankings: Myths and Fallacies
verfasst von
Yannis Manolopoulos
Dimitrios Katsaros
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-57135-5_19

Premium Partner