Skip to main content
Top
Published in: Business & Information Systems Engineering 2/2023

05-12-2022 | State of the Art

Self-reporting Limitations in Information Systems Design Science Research

Typology and Guidelines

Authors: João Barata, Paulo Rupino da Cunha, António Dias de Figueiredo

Published in: Business & Information Systems Engineering | Issue 2/2023

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Besides increasing transparency and demonstrating awareness of the author, self-reported limitations enable other researchers to effectively learn from, build on, validate, and extend the original work. However, this topic is understudied in information systems design science research (IS DSR). The study has assessed 243 IS DSR papers published in the period 2013–2022 and built a typology of the 19 most relevant limitations, organized into four categories: (1) Input Knowledge and Technology, (2) Research Process, (3) Resulting Artifact, and (4) Design Knowledge. Further, the contribution suggests actions to mitigate each type of limitation throughout the entire IS DSR project lifecycle. The authors have also created guidelines to report the limitations in a useful way for knowledge accumulation. The proposed typology and guidelines enable reviewers and editors to better frame self-reported limitations, assess rigor and relevance more systematically, and provide more precise feedback. Moreover, the contribution may help design researchers identify, mitigate, and effectively communicate the uncertainties inherent to all scientific advances.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Show more products
Appendix
Available only for authorised users
Literature
go back to reference Baskerville R, Pries-Heje J (2019) Projectability in design science research. J Inf Technol Theory Appl 20:53–76 Baskerville R, Pries-Heje J (2019) Projectability in design science research. J Inf Technol Theory Appl 20:53–76
go back to reference Briggs RO, Nunamaker J, Sprague R (2011) Applied science research in information systems: the last research mile. J Manag Inf Syst 28:13–16CrossRef Briggs RO, Nunamaker J, Sprague R (2011) Applied science research in information systems: the last research mile. J Manag Inf Syst 28:13–16CrossRef
go back to reference Connelly LM (2013) Limitation section. MEDSURG Nurs 22:2013 Connelly LM (2013) Limitation section. MEDSURG Nurs 22:2013
go back to reference Diederich S, Lichtenberg S, Brendel AB, Trang S (2020) Promoting sustainable mobility beliefs with persuasive and anthropomorphic design: insights from an experiment with a conversational agent. In: 40th international conference on information systems ICIS 2019. pp 1–17 Diederich S, Lichtenberg S, Brendel AB, Trang S (2020) Promoting sustainable mobility beliefs with persuasive and anthropomorphic design: insights from an experiment with a conversational agent. In: 40th international conference on information systems ICIS 2019. pp 1–17
go back to reference Dinter B, Krawatzeck R (2015) Towards a configurative publication schema for design science research. In: International conference on information systems ICIS 2015. pp 1–13 Dinter B, Krawatzeck R (2015) Towards a configurative publication schema for design science research. In: International conference on information systems ICIS 2015. pp 1–13
go back to reference Feine J, Morana S, Maedche A (2019) Designing a chatbot social cue configuration system. In: 40th international conference on information systems ICIS 2019. pp1–17 Feine J, Morana S, Maedche A (2019) Designing a chatbot social cue configuration system. In: 40th international conference on information systems ICIS 2019. pp1–17
go back to reference French J (1953) Experiments in field settings. In: Festinger L, Katz D (eds) Research methods in behavioral sciences. Dryden Press, Hinsdale, p 101 French J (1953) Experiments in field settings. In: Festinger L, Katz D (eds) Research methods in behavioral sciences. Dryden Press, Hinsdale, p 101
go back to reference Gregor S (2006) The nature of theory in information systems. MIS Q 30:611–642CrossRef Gregor S (2006) The nature of theory in information systems. MIS Q 30:611–642CrossRef
go back to reference Gregor S, Hevner AR (2013) Positioning and presenting design science research for maximum impact. MIS Q 37:337–355CrossRef Gregor S, Hevner AR (2013) Positioning and presenting design science research for maximum impact. MIS Q 37:337–355CrossRef
go back to reference Grotherr C, Semmann M, Böhmann T (2018) Engaging users to co-create - implications for service systems design by evaluating an engagement platform. In: Hawaii international conference on system sciences Grotherr C, Semmann M, Böhmann T (2018) Engaging users to co-create - implications for service systems design by evaluating an engagement platform. In: Hawaii international conference on system sciences
go back to reference Hevner AR, March ST, Park J, Ram S (2004) Design science in information systems research. MIS Q 28:75–105CrossRef Hevner AR, March ST, Park J, Ram S (2004) Design science in information systems research. MIS Q 28:75–105CrossRef
go back to reference Hobert S (2019) Say hello to ’Coding Tutor’! Design and evaluation of a chatbot-based learning system supporting students to learn to program. In: 40th international conference on information systems. pp 1–17 Hobert S (2019) Say hello to ’Coding Tutor’! Design and evaluation of a chatbot-based learning system supporting students to learn to program. In: 40th international conference on information systems. pp 1–17
go back to reference Hovav A (2014) Using scenarios to understand the frontiers of IS: fifteen years later (a postscript). Inf Syst Front 16:347–352CrossRef Hovav A (2014) Using scenarios to understand the frontiers of IS: fifteen years later (a postscript). Inf Syst Front 16:347–352CrossRef
go back to reference Hovorka DS, Peter S (2019) How the future is done. In: 52nd Hawaii international conference on system science. Grand Wailea, pp 6290–6299 Hovorka DS, Peter S (2019) How the future is done. In: 52nd Hawaii international conference on system science. Grand Wailea, pp 6290–6299
go back to reference Kammler F, Brinker J, Vogel J, et al (2019) How do we support technical tasks in the age of augmented reality? Some evidence from prototyping in mechanical engineering. In: 40th international conference on information systems. pp 1–17 Kammler F, Brinker J, Vogel J, et al (2019) How do we support technical tasks in the age of augmented reality? Some evidence from prototyping in mechanical engineering. In: 40th international conference on information systems. pp 1–17
go back to reference Kitchenham B (2004) Procedures for performing systematic reviews. Technical report TR/SE-0401 and NICTA technical report 0400011T.1. Staffordshire Kitchenham B (2004) Procedures for performing systematic reviews. Technical report TR/SE-0401 and NICTA technical report 0400011T.1. Staffordshire
go back to reference Köster A, Bergert C, Gundlach J (2018) Information as a life vest: understanding the role of social networking sites for the social inclusion of Syrian refugees. In: 39th international conference on information systems. pp 1–9 Köster A, Bergert C, Gundlach J (2018) Information as a life vest: understanding the role of social networking sites for the social inclusion of Syrian refugees. In: 39th international conference on information systems. pp 1–9
go back to reference Larsen KR, Lukyanenko R, Mueller RM, Storey VC (2020) Validity in design science research. In: International conference on design science research in information systems and technology. pp 1–15 Larsen KR, Lukyanenko R, Mueller RM, Storey VC (2020) Validity in design science research. In: International conference on design science research in information systems and technology. pp 1–15
go back to reference Lee AS, Hubona G (2009) A scientific basis for rigor in information systems research. Manag Inf Syst Q 33:237–262CrossRef Lee AS, Hubona G (2009) A scientific basis for rigor in information systems research. Manag Inf Syst Q 33:237–262CrossRef
go back to reference March ST, Smith GF (1995) Design and natural science research on information technology. Decis Support Syst 15:251–266CrossRef March ST, Smith GF (1995) Design and natural science research on information technology. Decis Support Syst 15:251–266CrossRef
go back to reference Neville K, Pope A, O’Riordan S, Ó’Lionáird M (2018) Evaluating an emergency management decision support system with practitioner-driven scenarios: action design research. In: 39th international conference on information systems. pp 1–17 Neville K, Pope A, O’Riordan S, Ó’Lionáird M (2018) Evaluating an emergency management decision support system with practitioner-driven scenarios: action design research. In: 39th international conference on information systems. pp 1–17
go back to reference Niemöller C, Metzger D, Berkemeier L et al (2019) Mobile service support based on smart glasses. J Inf Technol Theory Appl 20:4 Niemöller C, Metzger D, Berkemeier L et al (2019) Mobile service support based on smart glasses. J Inf Technol Theory Appl 20:4
go back to reference Olbrich S, Frank U, Gregor S et al (2017) On the merits and limits of replication and negation for IS research. AIS Trans Replication Res 3:1–19CrossRef Olbrich S, Frank U, Gregor S et al (2017) On the merits and limits of replication and negation for IS research. AIS Trans Replication Res 3:1–19CrossRef
go back to reference Peffers K, Tuunanen T, Rothenberger MA, Chatterjee S (2007) A design science research methodology for information systems research. J Manag Inf Syst 24:45–78CrossRef Peffers K, Tuunanen T, Rothenberger MA, Chatterjee S (2007) A design science research methodology for information systems research. J Manag Inf Syst 24:45–78CrossRef
go back to reference Popper K (1982) Unended quest: an intellectual autobiography. Open Court Publishing, La Salle Popper K (1982) Unended quest: an intellectual autobiography. Open Court Publishing, La Salle
go back to reference Rose J, Holgersson J, Söderström E (2019) Designing innovative digital services for government: a business model canvas adaptation. In: European conference on information systems. pp 1–13 Rose J, Holgersson J, Söderström E (2019) Designing innovative digital services for government: a business model canvas adaptation. In: European conference on information systems. pp 1–13
go back to reference Schoormann T, Behrens D, Knackstedt R (2018) The noblest way to learn wisdom is by reflection: designing software tools for reflecting sustainability in business models. In: 39th international conference on information systems. pp 1–17 Schoormann T, Behrens D, Knackstedt R (2018) The noblest way to learn wisdom is by reflection: designing software tools for reflecting sustainability in business models. In: 39th international conference on information systems. pp 1–17
go back to reference Schuster R, Wagner G, Schryen G (2018) Information systems design science research and cumulative knowledge development: an exploratory study. In: International conference on information systems, pp 1–17 Schuster R, Wagner G, Schryen G (2018) Information systems design science research and cumulative knowledge development: an exploratory study. In: International conference on information systems, pp 1–17
go back to reference Sein MK, Henfridsson O, Purao S et al (2011) Action design research. MIS Q 35:37–56CrossRef Sein MK, Henfridsson O, Purao S et al (2011) Action design research. MIS Q 35:37–56CrossRef
go back to reference Shrestha A, Cater-Steel A, Toleman M (2014) How to communicate evaluation work in design science research? An exemplar case study. ACIS Shrestha A, Cater-Steel A, Toleman M (2014) How to communicate evaluation work in design science research? An exemplar case study. ACIS
go back to reference Simon H (1996) The sciences of the artificial, 3rd edn. MIT Press, Cambridge Simon H (1996) The sciences of the artificial, 3rd edn. MIT Press, Cambridge
go back to reference Simon BMK, Goes J (2013) Assumptions, limitations, delimitations, and scope of the study. Retrieved from Diss.com Simon BMK, Goes J (2013) Assumptions, limitations, delimitations, and scope of the study. Retrieved from Diss.com
go back to reference Storey MA, Engstrom E, Host M, et al (2017) Using a visual abstract as a lens for communicating and promoting design science research in software engineering. In: International symposium on empirical software engineering and measurement. pp 181–186. https://doi.org/10.1109/ESEM.2017.28 Storey MA, Engstrom E, Host M, et al (2017) Using a visual abstract as a lens for communicating and promoting design science research in software engineering. In: International symposium on empirical software engineering and measurement. pp 181–186. https://​doi.​org/​10.​1109/​ESEM.​2017.​28
go back to reference Vaishnavi VK, Kuechler W (2015) Design science research methods and patterns: innovating information and communication technology. CRC Press, FloridaCrossRef Vaishnavi VK, Kuechler W (2015) Design science research methods and patterns: innovating information and communication technology. CRC Press, FloridaCrossRef
go back to reference Van Aken J, Chandrasekaran A, Halman J (2016) Conducting and publishing design science research. J Oper Manag 47–48:1–8CrossRef Van Aken J, Chandrasekaran A, Halman J (2016) Conducting and publishing design science research. J Oper Manag 47–48:1–8CrossRef
go back to reference Venable J, Pries-Heje J, Baskerville R (2016) FEDS: a framework for evaluation in design science research. Eur J Inf Syst 25:77–89CrossRef Venable J, Pries-Heje J, Baskerville R (2016) FEDS: a framework for evaluation in design science research. Eur J Inf Syst 25:77–89CrossRef
go back to reference Venable JR (2015) Five and ten years on: have DSR standards changed? In: DESRIST 2015: new horizons in design science: broadening the research Agenda. pp 264–279 Venable JR (2015) Five and ten years on: have DSR standards changed? In: DESRIST 2015: new horizons in design science: broadening the research Agenda. pp 264–279
go back to reference Vom Brocke J, Maedche A (2019) The DSR grid: six core dimensions for effectively planning and communicating design science research projects. Electron Mark 29:379–385CrossRef Vom Brocke J, Maedche A (2019) The DSR grid: six core dimensions for effectively planning and communicating design science research projects. Electron Mark 29:379–385CrossRef
go back to reference Webster J, Watson RT (2002) Analyzing the past to prepare the future. MIS Q 26:xiii–xxiii Webster J, Watson RT (2002) Analyzing the past to prepare the future. MIS Q 26:xiii–xxiii
go back to reference Wickboldt C (2019) Blockchain for workshop event certificates – a proof of concept in the aviation industry. In: Eur Conf Inf Syst. pp 0–15 Wickboldt C (2019) Blockchain for workshop event certificates – a proof of concept in the aviation industry. In: Eur Conf Inf Syst. pp 0–15
go back to reference Wieringa R (2014) Design science methodology for information systems and software engineering. Springer, HeidelbergCrossRef Wieringa R (2014) Design science methodology for information systems and software engineering. Springer, HeidelbergCrossRef
Metadata
Title
Self-reporting Limitations in Information Systems Design Science Research
Typology and Guidelines
Authors
João Barata
Paulo Rupino da Cunha
António Dias de Figueiredo
Publication date
05-12-2022
Publisher
Springer Fachmedien Wiesbaden
Published in
Business & Information Systems Engineering / Issue 2/2023
Print ISSN: 2363-7005
Electronic ISSN: 1867-0202
DOI
https://doi.org/10.1007/s12599-022-00782-8

Other articles of this Issue 2/2023

Business & Information Systems Engineering 2/2023 Go to the issue

Premium Partner