Synthesizing information systems knowledge: A typology of literature reviews

https://doi.org/10.1016/j.im.2014.08.008Get rights and content

Highlights

  • We proposed a typology of nine review types based on seven core dimensions.

  • The number of reviews in top-ranked IS journals has increased between 1999 and 2013.

  • Theoretical and narrative reviews are the most prevalent types in top IS journals.

  • We found inconsistencies in the labels used by authors to qualify IS reviews.

  • A majority of IS reviews reported only scholars as their target audience.

Abstract

In this article we develop a typology of review types and provide a descriptive insight into the most common reviews found in top IS journals. Our assessment reveals that the number of IS reviews has increased over the years. The majority of the 139 reviews are theoretical in nature, followed by narrative reviews, meta-analyses, descriptive reviews, hybrid reviews, critical reviews, and scoping reviews. Considering the calls for IS research to develop a cumulative tradition, we hope more review articles will be published in the future and encourage researchers who start a review to use our typology to position their contribution.

Introduction

The information systems (IS) community has grown considerably since it first emerged in the 1960s. Over the past 50 years, the development of IS as a scientific field is evidenced by the solid research tradition that has been built. Indeed, an increasing volume of IS research uses IS itself as the reference discipline [1]. The growth of our field is also related to the fact that IS research is emerging as an important reference discipline for other fields, such as psychology, education, marketing, operations management, and many other management domains [2]. The rapid diffusion of IS knowledge both within and outside its own boundaries requires researchers to find a way to quickly synthesize the extent of the literature on various topics of interest and address any and all relevant gaps [3].

The accumulation of knowledge is an essential condition for a field to “be scientific” and to develop [4]. More precisely, conducting effective literature reviews is essential to advance the knowledge and understand the breadth of the research on a topic of interest, synthesize the empirical evidence, develop theories or provide a conceptual background for subsequent research, and identify the topics or research domains that require more investigation [5], [6], [7], [8]. Literature reviews are also valuable as a means of becoming oriented in an emerging domain and as an aid in teaching [9], [10]. While the importance of producing high-quality literature reviews in the IS domain is well recognized [11], [12], [13], we feel there remains confusion about the term “review” and, most importantly, the types of review articles that are published in our field.

The most prevalent type of review is commonly labeled the “literature review” or “theoretical background” within an empirical article. This section of a paper usually provides the theoretical foundations and context of the research question and helps bring the research question into focus [14]. According to Baker [15], it represents an “essential first step and foundation when undertaking a research project” (p. 219). More precisely, the literature review section helps the researcher understand the existing body of knowledge, provides a theoretical foundation for the proposed empirical study, substantiates the presence of the research problem, justifies the proposed study as one that contributes something new to the cumulated knowledge, and/or frames the valid research methodologies, approaches, goals and research questions for the proposed study [12].

There exists another type of literature review that constitutes an original and valuable work of research in and of itself. Rather than providing a basis for the researcher's own endeavors, it creates a solid starting point for all other members of the academic community that are interested in a particular topic [9], [16]. The so-called “review article” is a journal-length article that has an overarching purpose of summarizing or synthesizing the literature in a field without collecting or analyzing any primary data. Review articles can be undertaken for several reasons, such as analyzing the progress of a specific stream of research, aggregating findings or reconciling equivocal results of prior studies, reviewing the application of a theoretical model or a methodological approach, developing a new theory or research model and providing a critical account of prior research on a particular topic or method [5].

Recognizing that knowledge accumulation increasingly relies on the integration of previous studies and findings, several senior IS scholars have made calls for more review articles in our field [2], [11], [17]. As a clear indication of the increasing need for review articles, the MIS Quarterly Review department was created in 2001 with the aim of representing an ideal communication outlet for synthesizing prior research and sharing knowledge [17]. In 2007, this department became MISQ Theory and Review with the goal of redirecting the attention of researchers to the concepts and theories used in the IS field and encouraging them to embark on IS theory building [18]. Despite this shift in focus toward theory building, MISQ Theory and Review has maintained the review component as part of its mission. In short, we believe that the enhanced role of review articles in our field requires that this expository form be given careful scrutiny.

Our primary goal in this article is to demystify the various types of literature reviews that exist. To do so, we first review the extant literature on that topic to come up with a typology that identifies, defines and contrasts various forms of research syntheses. It is our hope that the proposed typology will serve as a valuable resource for those that conduct, evaluate and/or interpret reviews both within and outside the IS field. Our second objective is to provide descriptive insight into the most common review types found in top-ranked IS journals. To our knowledge, no prior research has conducted a formal assessment of the review practices in our domain. The present study attempts to fill this gap. In the next sections, we explain the process that we followed to develop our typology and then describe and illustrate each review type.

Section snippets

Development of the typology

Classification is one of the most central and generic conceptual exercises. Bailey [19] and Smith [20] make a clear distinction between two forms of classification, namely, typologies and taxonomies. While a typology is derived in a deductive manner, a taxonomy is usually derived empirically or inductively using cluster analysis or other statistical methods. Given that knowledge synthesis is not a new concept and that leading methodologists have proposed several approaches and methods to review

Methodology

To apply our typology of literature reviews to IS research, we conducted a descriptive review. As mentioned above, descriptive reviews seek to determine the extent to which a body of empirical studies supports or reveals any interpretable patterns or trends with respect to pre-existing propositions, theories, methodologies or findings [2]. In this line of thought, our goal is to provide answers to the following research questions: (1) What are the current review practices in the IS field? (2)

Results

A preliminary assessment of our sample proves itself to be interesting and therefore deserves some attention. All 139 reviews were classified according to journal names and publication dates. Table 4 reveals that the number of review articles differs widely from journal to journal. Journal of the AIS and MIS Quarterly lead with 31% and 30% of the review papers appearing in their issues, respectively. These journals are followed by Information and Management (19%), Information Systems Research

Discussion

In light of the calls for an increased use of evidence-based management and research to generate stronger evidence, review articles become essential tools for summarizing or synthesizing the existing literature in all applied fields, such as medicine, nursing, engineering, and information systems. When appropriately conducted, reviews represent powerful information sources for researchers as well as practitioners that seek existing evidence to guide their decision making and practices. In its

Conclusion

Considering the calls for research in our field to be more relevant and for IS to develop a cumulative tradition [117], [118], we hope that more review articles will be published in the future, and we encourage researchers who start a review article to use our typology to position their contribution. The publication of rigorous and relevant reviews will also contribute to the development of vast knowledge and theories related to the development, implementation and management of IS in

Guy Paré is a Professor of information technologies and Holder of the Chair in Information Technology in Health Care at HEC Montréal. His current research interests involve the impacts of health information systems on health care professionals and patients as well as the barriers to adoption and implementation of information systems in healthcare organizations. His publications have appeared in top-ranked journals including MIS Quarterly, Journal of the American Medical Informatics Association,

References (118)

  • W.R. King et al.

    Understanding the role and methods of meta-analysis in IS research

    Commun. Assoc. Inf. Syst.

    (2005)
  • W. Bandara et al.

    A systematic, tool-supported method for conducting literature reviews in information systems

  • J.E. Hunter et al.

    Meta-analysis: Cumulating Research Findings across Studies

    (1982)
  • H.M. Cooper

    Organizing knowledge syntheses: a taxonomy of literature reviews

    Knowl. Soc.

    (1988)
  • C.D. Mulrow

    Rationale for systematic reviews

    Br. Med. J.

    (1994)
  • C. Hart

    Doing a Literature Review: Releasing the Social Science Research Imagination

    (1999)
  • P.D. Leedy et al.

    Practical Research: Planning and Design

    (2001)
  • J. Pfeffer et al.

    Evidence-based management

    Harv. Bus. Rev.

    (2006)
  • J. Webster et al.

    Analyzing the past to prepare for the future: writing a literature review

    MIS Quart.

    (2002)
  • Y. Levy et al.

    A systems approach to conduct an effective literature review in support of information systems research

    Inf. Sci.

    (2006)
  • J. vom Brocke et al.

    Reconstructing the giant: on the importance of rigour in documenting the literature search process

  • C. Okoli et al.

    A guide to conducting a systematic literature review of information systems research

    Sprouts: Work. Papers Inf. Syst.

    (2010)
  • M.J. Baker

    Writing a literature review

    Market. Rev.

    (2000)
  • C.D. Mulrow

    The medical review article: state of the science

    Ann. Intern. Med.

    (1987)
  • R.T. Watson

    Introducing MISQ review – a new department in MIS Quarterly

    MIS Quart.

    (2001)
  • M.L. Markus et al.

    Looking for a few good concepts and theories for the information systems field

    MIS Quart.

    (2007)
  • K.B. Smith

    Typologies, taxonomies, and the benefits of policy classification

    Policy Stud. J.

    (2002)
  • H.M. Blalock

    Theory Construction: From Verbal to Mathematical Formulations

    (1969)
  • D.H. Doty et al.

    Typologies as a unique form of theory building: towards improved understanding and modelling

    Acad. Manage. Rev.

    (1994)
  • I. Chalmers et al.

    A brief history of research synthesis

    Eval. Health Prof.

    (2002)
  • H. Cooper et al.

    The Handbook of Research Synthesis

    (1994)
  • R.J. Light et al.

    Summing Up: The Science of Reviewing Research

    (1984)
  • G.V. Glass

    Primary, secondary and meta-analysis of research

    Educ. Res.

    (1976)
  • G.B. Jackson

    Methods for integrative reviews

    Rev. Educ. Res.

    (1980)
  • D.B. Pillemer

    Conceptual issues in research synthesis

    J. Spec. Educ.

    (1984)
  • A.D. Oxman et al.

    Guidelines for reading literature reviews

    Can. Med. Assoc. J.

    (1988)
  • M. Dixon-Woods et al.

    Synthesizing qualitative and quantitative evidence: a review of possible methods

    J. Health Serv. Res. Policy

    (2005)
  • M.P.J.M. Dijkers

    The task force on systematic reviews and guidelines: the value of traditional reviews in the era of systematic reviewing

    Am. J. Phys. Med. Rehabil.

    (2009)
  • M. Borenstein et al.

    Introduction to Meta-analysis

    (2011)
  • M.J. Grant et al.

    A typology of reviews: an analysis of 14 review types and associated methodologies

    Health Inf. Libr. J.

    (2009)
  • N.A. Card

    Applied Meta-analysis for Social Science Research

    (2012)
  • D.J. Cook et al.

    Systematic reviews: synthesis of best evidence for clinical decisions

    Ann. Intern. Med.

    (1997)
  • P. Davies

    The relevance of systematic reviews to educational policy and practice

    Oxf. Rev. Educ.

    (2000)
  • M. Dixon-Woods et al.

    How can systematic reviews incorporate qualitative research? A critical perspective

    Qual. Res.

    (2006)
  • D. Gough et al.

    Clarifying differences between review designs and methods

    Syst. Rev.

    (2012)
  • M. Kirkevold

    Integrative nursing research – an important strategy to further the development of nursing science and nursing practice

    J. Adv. Nurs.

    (1997)
  • B. Kitchenham et al.

    Evidence-based software engineering and systematic literature reviews

    Eur. J. Inf. Prof.

    (2009)
  • D.M. Rousseau et al.

    11 Evidence in management and organizational science: assembling the field's full weight of scientific knowledge through syntheses

    Acad. Manage. Ann.

    (2008)
  • P.D. Rumrill et al.

    Using scoping literature reviews as a means of understanding and interpreting existing literature

    Work J. Prev. Assess. Rehabil.

    (2010)
  • Cited by (1027)

    View all citing articles on Scopus

    Guy Paré is a Professor of information technologies and Holder of the Chair in Information Technology in Health Care at HEC Montréal. His current research interests involve the impacts of health information systems on health care professionals and patients as well as the barriers to adoption and implementation of information systems in healthcare organizations. His publications have appeared in top-ranked journals including MIS Quarterly, Journal of the American Medical Informatics Association, and Journal of Information Technology. Professor Paré’s expertise has been sought by numerous organizations including the World Health Organization, the Department of Health in France, and Canada Health Infoway.

    Marie-Claude Trudel is an Associate Professor in the Department of Information Technology at HEC Montréal. She holds a PhD in business administration (MIS) from the University of Western Ontario in London, Canada. Her research interests include health information systems, information systems for cultural organizations, IT in education, and research methods. Her work has been published in journals such as International Journal of Medical Informatics, Health Care Management Review, JMIR Medical Informatics, and International Journal of Social & Organizational Dynamics in Information Technology.

    Mirou Jaana is an Associate Professor at Telfer School of Management in the University of Ottawa. Her research interests come at the intersection of Health Care Management and Medical Informatics, and involve the implementation of information systems in hospitals, risks in clinical IT projects, strategic IT planning and IT management issues in hospitals, evidence-based health care management, and home telemonitoring for chronic diseases. She published articles in top peer-reviewed journals including the American Journal of Managed Care, Health Care Management Review, Journal of Medical Internet Research, International Journal of Medical Informatics, and Journal of the American Medical Informatics Association.

    Spyros Kitsiou is an Assistant Professor in the Department of Biomedical and Health Information Sciences at the University of Illinois at Chicago. His current research interests involve the effectiveness of home telemonitoring and mobile health interventions for the management of patients with chronic conditions as well as the conduct of systematic reviews, meta-analyses, and overviews of systematic reviews to support evidence-based practice in health informatics. His publications have appeared in the Journal of Medical Internet Research, International Journal of Healthcare Technology and Management, and International Journal for Quality of Life Research.

    View full text