Abstract
Citation information helps researchers observe the evolution of the knowledge. In scientific publications, a review paper discusses a professional field and thus tends to have more citations than general papers do. This study investigated whether specific characteristics of review papers induce different results in citation-based analysis. From the Scopus database, we collected scientific publications in a specific research field, e-tourism, to examine the role of review papers in citation-based analysis. The dataset includes 1421 publications covering the period from the 1988–2015. Empirical statistics show that review papers’ specific citation patterns influence citation analysis. First, in the main path analysis, the result expresses review papers’ integrative role in linking papers from diverse perspectives toward a clear mainstream topic. Second, in a well-defined research context, review papers introduce bias in citation-based clustering analysis because the specific high citation pattern in review papers obfuscates the grouping process. When using citation information in analysis, scholars must consider the purpose of the study and treat review papers distinctly to avoid bias when using certain analysis methods and datasets.
Similar content being viewed by others
Notes
In this study, to identify ‘review’ papers, we consider whether the content of a certain study involves an overall discussion of a theory’s (or a research field’s) development. Thus, in this study, the definition of a ‘review’ paper is not limited to that used in the Scopus database. Additional details are discussed in Sect. 3.
References
Acs, Z. J., Audretsch, D. B., & Feldman, M. P. (1994). Research-and-development spillovers and recipient firm size. Review of Economics and Statistics, 76(2), 336–340.
Amaro, S., & Duarte, P. (2013). Online travel purchasing: A literature review. Journal of Travel & Tourism Marketing, 30(8), 755–785.
Anselin, L., Varga, A., & Acs, Z. (2000). Geographical spillovers and university research: A spatial econometric perspective. Growth and Change, 31(4), 501–515.
Barrios, M., Guilera, G., & Gomez-Benito, J. (2013). Impact of meta-analytical studies, standard articles and reviews: Similarities and differences, 14th International Society of Scientormetrics and Informatrics Conference 2013, Vienna, Austria (pp. 966–977).
Batagelj, V. (2003). Efficient algorithms for citation network analysis. http://arxiv.org/abs/cs.DL/0309023.
Benckendorff, P., & Zehrer, A. (2013). A network analysis of tourism research. Annals of Tourism Research, 43, 121–149.
Bhupatiraju, S., Nomaler, O., Triulzi, G., & Verspagen, B. (2012). Knowledge flows—Analyzing the core literature of innovation, entrepreneurship and science and technology studies. Research Policy, 41(7), 1205–1218.
Buhalis, D. (1998). Strategic use of information technologies in the tourism industry. Tourism management, 19(5), 409–421.
Buhalis, D. (2003). eTourism: Information technology for strategic tourism management. Pearson Education.
Buhalis, D., & Law, R. (2008). Progress in information technology and tourism management: 20 years on and 10 years after the Internet—The state of eTourism research. Tourism Management, 29(4), 609–623. doi:10.1016/j.tourman.2008.01.005.
Colebunders, R., Kenyon, C., & Rousseau, R. (2014). Increase in numbers and proportions of review articles in tropical medicine, infectious diseases, and oncology. Journal of the Association for Information Science and Technology, 65, 201–205.
Colebunders, R., & Rousseau, R. (2013), On the definition of a review, and does it matter. 14th International Society of Scientormetrics and Informatrics Conference 2013, Vienna, Austria, pp. 2072–2074.
Frew, A. J. (2000). Information and communications technology research in the travel and tourism domain: Perspective and direction. Journal of travel Research, 39(2), 136–145.
Girvan, M., & Newman, M. E. (2002). Community structure in social and biological networks. Proceedings of the National Academy of Sciences, 99(12), 7821–7826.
Glanzel, W. (2012). Bibliometric methods for detecting and analysing emerging research topics. Profesional De La Informacion, 21(2), 194–201.
Glanzel, W., & Czerwon, H. J. (1996). A new methodological approach to bibliographic coupling and its application to the national, regional and institutional level. Scientometrics, 37(2), 195–221.
Guerrero-Bote, V. P. & Moya-Anegon, F. (2013). Relationship between downloads and citation and the influence of language. 14th International Society of Scientormetrics and Informetrics Conference 2013, Vienna, Austria, pp. 1469–1484.
Gupta, U. G. (1997). Using citation analysis to explore the intellectual base, knowledge dissemination and research impact of Interfaces (1970–1992). Interfaces, 27(2), 85–101.
Hummon, N. P., & Doreian, P. (1989). Connectivity in a citation network: The development of DNA theory. Social Networks, 11(1), 39–63.
Jaffe, A. B., Trajtenberg, M., & Fogarty, M. S. (2000). Knowledge spillovers and patent citations: Evidence from a survey of inventors. American Economic Review, 90(2), 215–218.
Jaffe, A. B., Trajtenberg, M., & Henderson, R. (1993). Geographic localization of knowledge spillovers as evidenced by patent citations. The Quarterly Journal of Economics, 108, 577–598.
Karki, M. M. S. (1997). Patent citation analysis: A policy analysis tool. World Patent Information, 19(4), 269–272.
Knottnerus, J. A., & Kottnerus, B. J. (2009). Let’s make the studies within systematic reviews count. The Lancet, 373(9675), 1605.
Lachance, C., Poirier, S., & Larivière, V. (2014). The kiss of death? The effect of being cited in a review on subsequent citations. Journal of the Association for Information Science and Technology, 65, 1501–1505.
Law, R., Leung, R., & Buhalis, D. (2009). Information technology applications in hospitality and tourism: A review of publications from 2005 to 2007. Journal of Travel & Tourism Marketing, 26(5–6), 599–623.
Leung, D., Law, R., van Hoof, H., & Buhalis, D. (2013). Social media in tourism and hospitality: A literature review. Journal of Travel & Tourism Marketing, 30(1–2), 3–22.
Liu, J. S., & Kuan, C.-H. (2016). A new approach for the main path analysis: Decay in knowledge diffusion. Journal of the American Society for Information Science and Technology, 67(2), 465–476.
Liu, J. S., & Lu, L. Y. Y. (2012). An integrated approach for main path analysis: Development of the Hirsch index as an example. Journal of the American Society for Information Science and Technology, 63(3), 528–542.
Liu, J. S., Lu, L. Y., & Lu, W. M. (2016). Research fronts in data envelopment analysis. Omega, 58, 33–45.
Liu, J. S., Lu, L. Y. Y., Lu, W. M., & Lin, B. J. Y. (2013). Data envelopment analysis 1978–2010: A citation-based literature survey. Omega-International Journal of Management Science, 41(1), 3–15.
Maurseth, P. B., & Verspagen, B. (2002). Knowledge spillovers in Europe: A patent citations analysis. Scandinavian Journal of Economics, 104(4), 531–545.
Meyer, M., Libaers, D., Thijs, B., Grant, K., Glänzel, W., & Debackere, K. (2014). Origin and emergence of entrepreneurship as a research field. Scientometrics, 98(1), 473–485.
Nelson, A. J. (2009). Measuring knowledge spillovers: What patents, licenses and publications reveal about innovation diffusion. Research Policy, 38(6), 994–1005.
Newman, M. E. (2006). Modularity and community structure in networks. Proceedings of the National Academy of Sciences, 103(23), 8577–8582.
Newman, M. E., & Girvan, M. (2004). Finding and evaluating community structure in networks. Physical Review E, 69(2), 026113.
O’Connor, P., & Murphy, J. (2004). Research on information technology in the hospitality industry. International Journal of Hospitality Management, 23(5), 473–484.
Sharif, N. (2006). Emergence and development of the National Innovation Systems concept. Research Policy, 35(5), 745–766.
Snow, Bonnie. (1989). Review articles in MEDLINE—past and present. Online, 13(2), 101–105.
Van Buskirk, N. E. (1984). The review article in MEDLINE: Ambiguity of definition and implications for online searchers. Bulletin of the Medical Library Association, 72(4), 349.
Verspagen, B. (2000). The role of large multinationals in the Dutch technology infrastructure. A patent citation analysis. Scientometrics, 47(2), 427–448.
Verspagen, B. (2007). Mapping technological trajectories as patent citation networks: A study on the history of fuel cell research. Advances in Complex Systems, 10(01), 93–115.
Acknowledgements
The authors would like to thank anonymous reviewers for their constructive suggestions that have much improved the accuracy and readability of this article. This study is partially supported by Taiwan’s Ministry of Science and Technology grant: MOST 104-2410-M-011-027-MY2 and MOST105-2410-H-011-021-MY3.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Ho, M.HC., Liu, J.S. & Chang, K.CT. To include or not: the role of review papers in citation-based analysis. Scientometrics 110, 65–76 (2017). https://doi.org/10.1007/s11192-016-2158-0
Received:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11192-016-2158-0