Skip to main content
Disciplines
Automotive Business IT + Informatics Construction + Real Estate Electrical Engineering + Electronics Energy + Sustainability Insurance + Risk Finance + Banking Management + Leadership Marketing + Sales Mechanical Engineering + Materials
Events
DE
EN
Books
Journals
Topic Page
Marketing
Start single access now
Access for companies
EXTENDED SEARCH
Log in
Top
Published in:
Conceptualization of Methods and Experiments in Data Intensive Research Domains Read chapter Read first chapter

2017 | OriginalPaper | Chapter

Metrics and Rankings: Myths and Fallacies

Authors : Yannis Manolopoulos, Dimitrios Katsaros

Published in: Data Analytics and Management in Data Intensive Domains

Publisher: Springer International Publishing

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

In this paper we provide an introduction to the field of Bibliometrics. In particular, first we briefly describe its beginning and its evolution; we mention the main research fora as well. Further we categorize metrics according to their entity scope: metrics for journals, conferences and authors. Several rankings have appeared based on such metrics. It is argued that these metrics and rankings should be treated with caution, in a light relative way and not in an absolute manner. Primarily, it is the human expertise that can rigorously evaluate the above entities.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

inform now
previous chapter Metadata for Experiments in Nanoscience Foundries
Literature
1.
2.
3.
4.
Althouse, B., West, J., Bergstrom, T., Bergstrom, C.: Differences in impact factor across fields and over time. J. Am. Soc. Inf. Sci. Technol. 60(1), 27–34 (2009)CrossRef
5.
6.
Bergstrom, C.T., West, J.D., Wiseman, M.A.: The Eigenfactor metrics. J. Neurosci. 28(45), 11433–11434 (2008)CrossRef
7.
8.
Bollen, J., van de Sompel, H., Hagberg, A., Chute, R.: A principal component analysis of 39 scientific impact measures. PLoS ONE 4, e6022 (2009)CrossRef
9.
Bornmann, L., Haunschild, R.: Relative Citation Ratio (RCR): an empirical attempt to study a new field-normalized bibliometric indicator, J. Assoc. Inf. Sci. Technol. (2017, to appear)
10.
Bornmann, L., Mutz, R., Hug, S., Daniel, H.D.: A multilevel meta-analysis of studies reporting correlations between the h-index and 37 different h-index variants. J. Inform. 5(3), 346–359 (2011)CrossRef
11.
Brin, S., Page, L.: The anatomy of a large-scale hypertextual web search engine. Comput. Netw. ISDN Syst. 30(1–7), 107–117 (1998)CrossRef
12.
Campbell, P.: Escape from the impact factor. Ethics Sci. Environ. Politics 8, 5–7 (2008)CrossRef
13.
Callaway, E.: Publishing elite turns against impact factor. Nature 535, 210–211 (2016)CrossRef
14.
15.
16.
17.
18.
19.
20.
21.
22.
23.
24.
25.
Garfield, E.: Citation indexes for science: a new dimension in documentation through association of ideas. Science 122, 108–111 (1955)CrossRef
26.
Giles, C.L., Bollacker, K., Lawrence, S.: CiteSeer: an automatic citation indexing system. In: Proceedings 3rd ACM Conference on Digital Libraries, pp. 89–98 (1998)
27.
Gogoglou, A., Sidiropoulos, A., Katsaros, D., Manolopoulos, Y.: Quantifying an individual’s scientific output using the fractal dimension of the whole citation curve, In: Proceedings 12th International Conference on Webometrics, Informetrics & Scientometrics (WIS), Nancy (2016)
28.
29.
Gupta, H., Campanha, J., Pesce, R.: Power-law distributions for the citation index of scientific publications and scientists. Braz. J. Phys. 35(4a), 981–986 (2005)CrossRef
30.
Harzing, A.W.: Publish or Perish, Tarma Software Research (2010)
31.
Hicks, D., Wouters, P., Waltman, L., de Rijke, S., Rafols, I.: The Leiden Manifesto for research metrics. Nature 520(7548), 429–431 (2015)CrossRef
32.
Hirsch, J.E.: An index to quantify an individual’s scientific research output. Proc. Natl. Acad. Sci. 102(46), 16569–16572 (2005)CrossRefMATH
33.
Hvistendahl, M.: China’s publication bazaar. Science 342(6162), 1035–1039 (2013)CrossRef
34.
35.
36.
37.
Hutchins, B.I., Yuan, X., Anderson, J.M., Santangelo, G.M.: Relative Citation Ratio (RCR): a new metric that uses citation rates to measure influence at the article level. PLoS Biol. 14(9), e1002541 (2016)CrossRef
38.
ImpactStory Blog. A new framework for altmetrics (2012)
39.
Kuo, W., Rupe, J.: R-impact factor: reliability-based citation impact factor. IEEE Trans. Reliab. 56(3), 366–367 (2007)CrossRef
40.
41.
Lariviere, V., Kiermer, V., MacCallum, C.J., McNutt, M., Patterson, M., Pulverer, B., Swaminathan, S., Taylor, S., Curry, S.: A simple proposal for the publication of journal citation distributions, Technical report. http://​dx.​doi.​org/​10.​1101/​062109
42.
Lee, D., Kang, J., Mitra, P., Giles, L., On, B.W.: Are your citations clean? Commun. ACM 50(12), 33–38 (2007)CrossRef
43.
Manolopoulos, Y.: On the value and use of metrics and rankings: a position paper. In: Selected Papers of the 18th International Conference on Data Analytics & Management in Data Intensive Domains (DAMDID 2016), vol. 1752, pp. 133–139. CEUR Workshop Proceedings (2016)
44.
45.
Nalimov, V., Mul’chenko, Z.M.: Naukometriya, the study of the development of science as an information process in Russian, p. 191. Nauka, Moscow (1969)
46.
47.
Nature Publishing Group: A guide to the nature index. Nature 515(7526), S94 (2014)CrossRef
48.
Piazza, R.: On house renovation and co-authoring – tricks of the trade to boost your h-index. Europhys. News 46(1), 19–22 (2015)CrossRef
49.
Priem, J., Taraborelli, D., Groth, P., Neylon, C.: Altmetrics: a manifesto. altmetrics.org
50.
Pritchard, A.: Statistical bibliography or bibliometrics? J. Doc. 25(4), 348–349 (1969)
51.
52.
53.
54.
55.
56.
57.
Sidiropoulos, A., Katsaros, D., Manolopoulos, Y.: Generalized Hirsch h-index for disclosing latent facts in citation networks. Scientometrics 72(2), 253–280 (2007)CrossRef
58.
Sidiropoulos, A., Katsaros, D., Manolopoulos, Y.: Ranking and identifying influential scientists vs. mass producers by the perfectionism index. Scientometrics 103(1), 1–31 (2015)CrossRef
59.
60.
61.
Todeschini, R., Baccini, A.: Handbook of Bibliometric Indicators. Wiley (2016)
62.
Tüür-Fröhlich, T.: The Non-trivial Effects of Trivial Errors in Scientific Communication and Evaluation. Verlag Werner Hülsbusch, Glückstadt (2016)
63.
64.
Van Bevern, R., Komusiewicz, C., Niedermeier, R., Sorge, M., Walsh, T.: H-index manipulation by merging articles: models, theory and experiments. Artif. Intell. 240, 19–35 (2016)MathSciNetCrossRefMATH
65.
van Noorden, R.: Impact factor gets heavyweight rival: citeScore uses larger database and gets different results. Nature 540, 325–326 (2016)CrossRef
66.
Vardi, M.: Academic rankings considered harmful! Commun. ACM 59(9), 5 (2016)CrossRef
67.
Vitanov, N.: Science Dynamics and Research Production. Springer, Cham (2016)CrossRef
68.
69.
Wildgaard, L., Schneider, J.W., Larsen, B.: A review of the characteristics of 108 author-level bibliometric indicators. Scientometrics 101, 125–158 (2014)CrossRef
70.
Yan, Z., Wu, Q., Li, X.: Do Hirsch-type indices behave the same in assessing single publications? An empirical study of 29 bibliometric indicators. Scientometrics 109(3), 1815–1833 (2016)CrossRef
Metadata
Title
Metrics and Rankings: Myths and Fallacies
Authors
Yannis Manolopoulos
Dimitrios Katsaros
Copyright Year
2017
Book
Data Analytics and Management in Data Intensive Domains

Print ISBN: 978-3-319-57134-8

Electronic ISBN: 978-3-319-57135-5

Copyright Year: 2017

DOI
https://doi.org/10.1007/978-3-319-57135-5_19

Premium Partner

    Image Credits