Skip to main content
Top

Hint

Swipe to navigate through the chapters of this book

2017 | Supplement | Chapter

The Role of International Standards to Corroborate Artefact Development and Evaluation: Experiences from a Design Science Research Project in Process Assessment

Authors : Anup Shrestha, Aileen Cater-Steel, Mark Toleman, Terry Rout

Published in: Software Process Improvement and Capability Determination

Publisher: Springer International Publishing

share
SHARE

Abstract

International standards were used to corroborate artefact development and evaluation in a Design Science Research (DSR) project within the context of Process Assessments in IT Service Management (ITSM). While there have been significant research efforts towards extending DSR guidelines and the development and revisions of the standards, reports of the application of International Standards to validate DSR artefacts are scant. DSR, akin to any academic research, is required to demonstrate rigour and relevance with the use of theories and prior knowledge. Moreover, DSR presents an artefact as a solution to a class of problems and reports how the artefact is developed and evaluated. Our DSR project demonstrated that concerns about the quality of artefacts can be addressed and thereby the utility and validity of the artefact can be verified with the use of International Standards. Using three International Standards, process assessment ISO/IEC 15504-33000 series, IT Service Management ISO/IEC 20000, and System and Software Quality Models ISO/IEC 25010, this paper presents an account of a real-life DSR project that demonstrates the significant role of International Standards to guide DSR researchers during artefact design, development and evaluation.
Literature
1.
go back to reference Hevner, A.R., March, S.T., Park, J., Ram, S.: Design science in information systems research. MIS Q. 28(1), 75–105 (2004) Hevner, A.R., March, S.T., Park, J., Ram, S.: Design science in information systems research. MIS Q. 28(1), 75–105 (2004)
2.
go back to reference Peffers, K., Tuunanen, T., Rothenberger, M.A., Chatterjee, S.: A design science research methodology for information systems research. J. Manag. Inf. Syst. 24(3), 45–77 (2008) CrossRef Peffers, K., Tuunanen, T., Rothenberger, M.A., Chatterjee, S.: A design science research methodology for information systems research. J. Manag. Inf. Syst. 24(3), 45–77 (2008) CrossRef
3.
go back to reference Österle, H., Becker, J., Frank, U., Hess, T., Karagiannis, D., Krcmar, H., Loos, P., Mertens, P., Oberweis, A., Sinz, E.J.: Memorandum on design-oriented information systems research. Eur. J. Inf. Syst. 20(1), 7–10 (2011) CrossRef Österle, H., Becker, J., Frank, U., Hess, T., Karagiannis, D., Krcmar, H., Loos, P., Mertens, P., Oberweis, A., Sinz, E.J.: Memorandum on design-oriented information systems research. Eur. J. Inf. Syst. 20(1), 7–10 (2011) CrossRef
4.
go back to reference Iivari, J.: A paradigmatic analysis of information systems as a design science. Scand. J. Inf. Syst. 19(2), 39–64 (2007) Iivari, J.: A paradigmatic analysis of information systems as a design science. Scand. J. Inf. Syst. 19(2), 39–64 (2007)
5.
go back to reference Walls, J.G., Widmeyer, G.R., El Sawy, O.A.: Assessing information system design theory in perspective: how useful was our 1992 initial rendition. J. Inf. Technol. Theor. Appl. 6(2), 43–58 (2004) Walls, J.G., Widmeyer, G.R., El Sawy, O.A.: Assessing information system design theory in perspective: how useful was our 1992 initial rendition. J. Inf. Technol. Theor. Appl. 6(2), 43–58 (2004)
6.
go back to reference Van Aken, J.E.: The Nature of Organizing Design: Both Like and Unlike Material Object Design. Eindhoven Center for Innovation Studies: Technische Universiteit Eindhoven. The Netherlands (2006) Van Aken, J.E.: The Nature of Organizing Design: Both Like and Unlike Material Object Design. Eindhoven Center for Innovation Studies: Technische Universiteit Eindhoven. The Netherlands (2006)
7.
go back to reference Carlsson, S.A., Henningsson, S., Hrastinski, S., Keller, C.: Socio-technical IS design science research: developing design theory for IS integration management. IseB 9(1), 109–131 (2011) CrossRef Carlsson, S.A., Henningsson, S., Hrastinski, S., Keller, C.: Socio-technical IS design science research: developing design theory for IS integration management. IseB 9(1), 109–131 (2011) CrossRef
8.
go back to reference Getronics: Implementing Leading Standards for IT Management. 1st edn. Van Haren Publishing, Zaltmobbel (2006) Getronics: Implementing Leading Standards for IT Management. 1st edn. Van Haren Publishing, Zaltmobbel (2006)
9.
go back to reference Kumbakara, N.: Managed IT services: the role of IT standards. Inf. Manag. Comput. Secur. 16(4), 336–359 (2008) CrossRef Kumbakara, N.: Managed IT services: the role of IT standards. Inf. Manag. Comput. Secur. 16(4), 336–359 (2008) CrossRef
10.
go back to reference ISO/IEC: ISO/IEC 15504-1:2005 – Information Technology – Process Assessment – Part 1: Concepts and Vocabulary. International Organisation for Standardisation (2005) ISO/IEC: ISO/IEC 15504-1:2005 – Information Technology – Process Assessment – Part 1: Concepts and Vocabulary. International Organisation for Standardisation (2005)
11.
go back to reference ISO/IEC: ISO/IEC 20000-1:2011 – Information Technology – Service Management – Part 1: Service Management System Requirements. International Organisation for Standardisation (2011) ISO/IEC: ISO/IEC 20000-1:2011 – Information Technology – Service Management – Part 1: Service Management System Requirements. International Organisation for Standardisation (2011)
12.
go back to reference ISO/IEC: ISO/IEC 15504-2:2004 – Information Technology – Process Assessment – Part 2: Performing an Assessment. International Organisation for Standardisation (2004) ISO/IEC: ISO/IEC 15504-2:2004 – Information Technology – Process Assessment – Part 2: Performing an Assessment. International Organisation for Standardisation (2004)
13.
go back to reference ISO/IEC: ISO/IEC 25010:2011 – Systems and Software Engineering – Systems and Software Quality Requirements and Evaluation (SQuaRE) - System and Software Quality Models. International Organisation for Standardisation (2011) ISO/IEC: ISO/IEC 25010:2011 – Systems and Software Engineering – Systems and Software Quality Requirements and Evaluation (SQuaRE) - System and Software Quality Models. International Organisation for Standardisation (2011)
14.
go back to reference Shrestha, A., Cater-Steel, A., Toleman, M., Rout, T.: Evaluation of Software Mediated Process Assessments for IT Service Management. In: Rout, T., O’Connor, Rory V., Dorling, A. (eds.) SPICE 2015. CCIS, vol. 526, pp. 72–84. Springer, Cham (2015). doi: 10.​1007/​978-3-319-19860-6_​7 CrossRef Shrestha, A., Cater-Steel, A., Toleman, M., Rout, T.: Evaluation of Software Mediated Process Assessments for IT Service Management. In: Rout, T., O’Connor, Rory V., Dorling, A. (eds.) SPICE 2015. CCIS, vol. 526, pp. 72–84. Springer, Cham (2015). doi: 10.​1007/​978-3-319-19860-6_​7 CrossRef
15.
go back to reference Baskerville, R.: What design science is not. Eur. J. Inf. Syst. 17(5), 441–443 (2008) CrossRef Baskerville, R.: What design science is not. Eur. J. Inf. Syst. 17(5), 441–443 (2008) CrossRef
16.
go back to reference Winter, R.: Design science research in Europe. Eur. J. Inf. Syst. 17(5), 470–475 (2008) CrossRef Winter, R.: Design science research in Europe. Eur. J. Inf. Syst. 17(5), 470–475 (2008) CrossRef
17.
go back to reference March, S.T., Smith, G.F.: Design and natural science research on information technology. Decis. Support Syst. 15(4), 251–266 (1995) CrossRef March, S.T., Smith, G.F.: Design and natural science research on information technology. Decis. Support Syst. 15(4), 251–266 (1995) CrossRef
18.
go back to reference Gregor, S., Hevner, A.R.: Positioning and presenting design science research for maximum impact. MIS Q. 37(2), 337–355 (2013) Gregor, S., Hevner, A.R.: Positioning and presenting design science research for maximum impact. MIS Q. 37(2), 337–355 (2013)
19.
go back to reference Mandviwalla, M.: Generating and justifying design theory. J. Assoc. Inf. Syst. 16(5), 314–344 (2015) Mandviwalla, M.: Generating and justifying design theory. J. Assoc. Inf. Syst. 16(5), 314–344 (2015)
20.
go back to reference Weedman, J.: Client as designer in collaborative design science research projects: what does social science design theory tell us? Eur. J. Inf. Syst. 17(5), 476–488 (2008) CrossRef Weedman, J.: Client as designer in collaborative design science research projects: what does social science design theory tell us? Eur. J. Inf. Syst. 17(5), 476–488 (2008) CrossRef
21.
go back to reference ISO/IEC JTC1/SC7 WG10: Transition from ISO/IEC 15504 to ISO/IEC 330xx. Standing Document (2017) ISO/IEC JTC1/SC7 WG10: Transition from ISO/IEC 15504 to ISO/IEC 330xx. Standing Document (2017)
23.
go back to reference Jung, H.W., Hunter, R., Goldenson, D.R., El-Emam, K.: Findings from phase 2 of the SPICE trials. Softw. Process: Improv. Pract. 6(4), 205–242 (2001) CrossRef Jung, H.W., Hunter, R., Goldenson, D.R., El-Emam, K.: Findings from phase 2 of the SPICE trials. Softw. Process: Improv. Pract. 6(4), 205–242 (2001) CrossRef
24.
go back to reference Rout, T.P., El Emam, K., Fusani, M., Goldenson, D., Jung, H.W.: SPICE in retrospect: developing a standard for process assessment. J. Syst. Softw. 80(9), 1483–1493 (2007) CrossRef Rout, T.P., El Emam, K., Fusani, M., Goldenson, D., Jung, H.W.: SPICE in retrospect: developing a standard for process assessment. J. Syst. Softw. 80(9), 1483–1493 (2007) CrossRef
25.
go back to reference Malzahn, D.: Integrated product life cycle management for software: CMMI, SPICE, and ISO/IEC 20000. In: Cater-Steel, A. (ed.) Information Technology Governance and Service Management: Frameworks and Adaptations, pp. 423–442. Information Science Reference, Hershey (2007) Malzahn, D.: Integrated product life cycle management for software: CMMI, SPICE, and ISO/IEC 20000. In: Cater-Steel, A. (ed.) Information Technology Governance and Service Management: Frameworks and Adaptations, pp. 423–442. Information Science Reference, Hershey (2007)
26.
go back to reference ISO/IEC: ISO/IEC 20000-2:2012 – Information Technology – Service Management – Part 2: Guidance on the Application of Service Management Systems. International Organisation for Standardisation (2012) ISO/IEC: ISO/IEC 20000-2:2012 – Information Technology – Service Management – Part 2: Guidance on the Application of Service Management Systems. International Organisation for Standardisation (2012)
27.
go back to reference ISO/IEC: ISO/IEC TR 20000-4:2010 – Information Technology – Service Management – Part 4: Process Reference Model. International Organisation for Standardisation (2010) ISO/IEC: ISO/IEC TR 20000-4:2010 – Information Technology – Service Management – Part 4: Process Reference Model. International Organisation for Standardisation (2010)
28.
go back to reference ISO/IEC: ISO/IEC 25040:2011 – Systems and Software Engineering – Systems and Software Quality Requirements and Evaluation (SQuaRE) - Evaluation Process. International Organisation for Standardisation (2011) ISO/IEC: ISO/IEC 25040:2011 – Systems and Software Engineering – Systems and Software Quality Requirements and Evaluation (SQuaRE) - Evaluation Process. International Organisation for Standardisation (2011)
29.
30.
go back to reference Shrestha, A., Cater-Steel, A., Toleman, M., Rout, T.: Towards Transparent and Efficient Process Assessments for IT Service Management. In: Mitasiunas, A., Rout, T., O’Connor, Rory V., Dorling, A. (eds.) SPICE 2014. CCIS, vol. 477, pp. 165–176. Springer, Cham (2014). doi: 10.​1007/​978-3-319-13036-1_​15 Shrestha, A., Cater-Steel, A., Toleman, M., Rout, T.: Towards Transparent and Efficient Process Assessments for IT Service Management. In: Mitasiunas, A., Rout, T., O’Connor, Rory V., Dorling, A. (eds.) SPICE 2014. CCIS, vol. 477, pp. 165–176. Springer, Cham (2014). doi: 10.​1007/​978-3-319-13036-1_​15
31.
go back to reference ISO/IEC: ISO/IEC TS 15504-8:2012 - Information Technology - Process Assessment - Part 8: An Exemplar Process Assessment Model for IT Service Management. International Organisation for Standardisation (2012) ISO/IEC: ISO/IEC TS 15504-8:2012 - Information Technology - Process Assessment - Part 8: An Exemplar Process Assessment Model for IT Service Management. International Organisation for Standardisation (2012)
32.
go back to reference Barafort, B., Rousseau, A., Dubois, E.: How to Design an Innovative Framework for Process Improvement? The TIPA for ITIL Case. In: Barafort, B., O’Connor, Rory V., Poth, A., Messnarz, R. (eds.) EuroSPI 2014. CCIS, vol. 425, pp. 48–59. Springer, Heidelberg (2014). doi: 10.​1007/​978-3-662-43896-1_​5 Barafort, B., Rousseau, A., Dubois, E.: How to Design an Innovative Framework for Process Improvement? The TIPA for ITIL Case. In: Barafort, B., O’Connor, Rory V., Poth, A., Messnarz, R. (eds.) EuroSPI 2014. CCIS, vol. 425, pp. 48–59. Springer, Heidelberg (2014). doi: 10.​1007/​978-3-662-43896-1_​5
34.
go back to reference Rout, T.: Studies on the assessment process: usage of objective evidence in assessing process capability. J. Soft.: Evol. Process 22(4), 297–305 (2010) Rout, T.: Studies on the assessment process: usage of objective evidence in assessing process capability. J. Soft.: Evol. Process 22(4), 297–305 (2010)
36.
go back to reference Rudd, C., Sansbury, J.: ITIL® Maturity Model and Self-assessment Service: User Guide. AXELOS Limited, Norwich (2013) Rudd, C., Sansbury, J.: ITIL® Maturity Model and Self-assessment Service: User Guide. AXELOS Limited, Norwich (2013)
37.
go back to reference Nehfort, A.: SPICE Assessments for IT Service Management according to ISO/IEC 20000-1. In: International SPICE 2007 Conference, Frankfurt, Germany (2007) Nehfort, A.: SPICE Assessments for IT Service Management according to ISO/IEC 20000-1. In: International SPICE 2007 Conference, Frankfurt, Germany (2007)
38.
go back to reference Venable, J., Pries-Heje, J., Baskerville, R.: A Comprehensive Framework for Evaluation in Design Science Research. In: Peffers, K., Rothenberger, M., Kuechler, B. (eds.) DESRIST 2012. LNCS, vol. 7286, pp. 423–438. Springer, Heidelberg (2012). doi: 10.​1007/​978-3-642-29863-9_​31 CrossRef Venable, J., Pries-Heje, J., Baskerville, R.: A Comprehensive Framework for Evaluation in Design Science Research. In: Peffers, K., Rothenberger, M., Kuechler, B. (eds.) DESRIST 2012. LNCS, vol. 7286, pp. 423–438. Springer, Heidelberg (2012). doi: 10.​1007/​978-3-642-29863-9_​31 CrossRef
39.
go back to reference ISO/IEC: Using and Referencing ISO and IEC Standards to Support Public Policy. International Organization for Standardization (2014) ISO/IEC: Using and Referencing ISO and IEC Standards to Support Public Policy. International Organization for Standardization (2014)
40.
go back to reference Barafort, B., Di Renzo, B., Lejeune, V., Prime, S., Simon, J.: ITIL based service management measurement and ISO/IEC 15504 process assessment: a win-win opportunity. In: 5th International SPICE 2005 Conference, Klagenfurt, Austria (2005) Barafort, B., Di Renzo, B., Lejeune, V., Prime, S., Simon, J.: ITIL based service management measurement and ISO/IEC 15504 process assessment: a win-win opportunity. In: 5th International SPICE 2005 Conference, Klagenfurt, Austria (2005)
41.
go back to reference Hilbert, R., Renault, A.: Assessing IT service management processes with AIDA– experience feedback. In: 14th European Conference for Software Process Improvement, Potsdam, Germany (2007) Hilbert, R., Renault, A.: Assessing IT service management processes with AIDA– experience feedback. In: 14th European Conference for Software Process Improvement, Potsdam, Germany (2007)
42.
go back to reference Johnson, M.W., Hately, A., Miller, B., Orr, R.: Evolving standards for IT service management. IBM Syst. J. 46(3), 583–597 (2007) CrossRef Johnson, M.W., Hately, A., Miller, B., Orr, R.: Evolving standards for IT service management. IBM Syst. J. 46(3), 583–597 (2007) CrossRef
43.
go back to reference Lepmets, M., Mesquida, A.L., Cater-Steel, A., Mas, A., Ras, E.: The evaluation of the IT service quality measurement framework in industry. Glob. J. Flex. Syst. Manag. 15(1), 39–57 (2014) CrossRef Lepmets, M., Mesquida, A.L., Cater-Steel, A., Mas, A., Ras, E.: The evaluation of the IT service quality measurement framework in industry. Glob. J. Flex. Syst. Manag. 15(1), 39–57 (2014) CrossRef
44.
go back to reference ISO/IEC: ISO/IEC 33001:2015 – Information Technology - Process Assessment - Concepts and Terminology. International Organisation for Standardisation (2015) ISO/IEC: ISO/IEC 33001:2015 – Information Technology - Process Assessment - Concepts and Terminology. International Organisation for Standardisation (2015)
Metadata
Title
The Role of International Standards to Corroborate Artefact Development and Evaluation: Experiences from a Design Science Research Project in Process Assessment
Authors
Anup Shrestha
Aileen Cater-Steel
Mark Toleman
Terry Rout
Copyright Year
2017
DOI
https://doi.org/10.1007/978-3-319-67383-7_32

Premium Partner