Skip to main content

2013 | OriginalPaper | Buchkapitel

A Business View on Testing ERP Systems with Value-Based Requirements Coverage

verfasst von : Rudolf Ramler, Theodorich Kopetzky, Wolfgang Platz

Erschienen in: Innovation and Future of Enterprise Information Systems

Verlag: Springer Berlin Heidelberg

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Testing has been identified as a critical factor for a successful implementation of ERP systems. However, most testing activities are still value-neutral and do not utilize the information about the system’s achievable business value, which is a particularly promising improvement for testing of business software and ERP systems. In this paper we therefore present an approach for value-based coverage measurement that can be used to align the testing effort to the value associated with requirements and typical usage scenarios. It has been implemented as part of the commercial test tool TOSCA Testsuite by Tricentis and was successfully applied in real-world projects. The results demonstrated its ability to adequately capture the distribution of the business value involved in different functional units. Furthermore, when compared with a value-neutral and a pure requirements-based approach for test case prioritization, it produced a higher benefit curve and an early positive ROI from testing.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Al-Mashari, M., Al-Mudimigh, A., Zairi, M.: Enterprise resource planning: a taxonomy of critical factors. Eur. J. Oper. Res. 146(2), 352–364 (2003)CrossRef Al-Mashari, M., Al-Mudimigh, A., Zairi, M.: Enterprise resource planning: a taxonomy of critical factors. Eur. J. Oper. Res. 146(2), 352–364 (2003)CrossRef
2.
Zurück zum Zitat Bach, J.: Risk and requirements-based testing. IEEE Comput. 32(6), 113–114 (1999) Bach, J.: Risk and requirements-based testing. IEEE Comput. 32(6), 113–114 (1999)
3.
Zurück zum Zitat Boehm, B.: Value-based software engineering: overview and agenda. In: Biffl, S., et al. (eds.) Value-Based Software Engineering, pp. 3–14. Springer, Berlin (2006) Boehm, B.: Value-based software engineering: overview and agenda. In: Biffl, S., et al. (eds.) Value-Based Software Engineering, pp. 3–14. Springer, Berlin (2006)
4.
Zurück zum Zitat Boehm, B., Basili, V.R.: Software defect reduction top 10 list. Computer 34(1), 135–137 (2001) Boehm, B., Basili, V.R.: Software defect reduction top 10 list. Computer 34(1), 135–137 (2001)
5.
Zurück zum Zitat Brooks, P.A., Memon, A.M.: Automated GUI testing guided by usage profiles. In: Proceedings of the Twenty-Second IEEE/ACM International Conference on Automated Software Engineering. ASE’07, pp. 333–342. ACM, New York (2007) Brooks, P.A., Memon, A.M.: Automated GUI testing guided by usage profiles. In: Proceedings of the Twenty-Second IEEE/ACM International Conference on Automated Software Engineering. ASE’07, pp. 333–342. ACM, New York (2007)
6.
Zurück zum Zitat Chen, C.C., Law, C., Yang, S.C.: Managing ERP implementation failure: a project management perspective. IEEE Trans. Eng. Manage. 56(1), 157–170 (2009)CrossRef Chen, C.C., Law, C., Yang, S.C.: Managing ERP implementation failure: a project management perspective. IEEE Trans. Eng. Manage. 56(1), 157–170 (2009)CrossRef
7.
Zurück zum Zitat Daneva, M.: ERP requirements engineering practice: lessons learned. Softw. IEEE 21(2), 26–33 (2004)CrossRef Daneva, M.: ERP requirements engineering practice: lessons learned. Softw. IEEE 21(2), 26–33 (2004)CrossRef
8.
Zurück zum Zitat Farago, D.: Nondeterministic coverage metrics as key performance indicator for model- and value-based testing. 31. Treffen der GI-Fachgruppe Test, Analyse and Verifikation von Software (TAV) (2011) Farago, D.: Nondeterministic coverage metrics as key performance indicator for model- and value-based testing. 31. Treffen der GI-Fachgruppe Test, Analyse and Verifikation von Software (TAV) (2011)
9.
Zurück zum Zitat Felderer, M., et al.: Integrating manual and automatic risk assessment for risk-based testing. In: Software Quality. Process Automation in Software Development. Software Quality Days 2012, pp. 159–180. Vienna (2012) Felderer, M., et al.: Integrating manual and automatic risk assessment for risk-based testing. In: Software Quality. Process Automation in Software Development. Software Quality Days 2012, pp. 159–180. Vienna (2012)
10.
Zurück zum Zitat Gerrard, P.: Test methods and tools for ERP implementations. In: IEEE, pp. 40–46 (2007) Gerrard, P.: Test methods and tools for ERP implementations. In: IEEE, pp. 40–46 (2007)
11.
Zurück zum Zitat Gittens, M., Romanufa, K., Godwin, D., Racicot, J.: All code coverage is not created equal: a case study in prioritized code coverage. In: Proceedings of the 2006 Conference of the Center for Advanced Studies on Collaborative Research (CASCON ‘06) (2006) Gittens, M., Romanufa, K., Godwin, D., Racicot, J.: All code coverage is not created equal: a case study in prioritized code coverage. In: Proceedings of the 2006 Conference of the Center for Advanced Studies on Collaborative Research (CASCON ‘06) (2006)
12.
Zurück zum Zitat Holland, C.R., Light, B.: A critical success factors model for ERP implementation. Softw. IEEE 16(3), 30–36 (1999)CrossRef Holland, C.R., Light, B.: A critical success factors model for ERP implementation. Softw. IEEE 16(3), 30–36 (1999)CrossRef
13.
Zurück zum Zitat Huang, L., Boehm, B.: How much software quality investment is enough: a value-based approach. IEEE Softw. 23(5), 88–95 (2006)CrossRef Huang, L., Boehm, B.: How much software quality investment is enough: a value-based approach. IEEE Softw. 23(5), 88–95 (2006)CrossRef
14.
Zurück zum Zitat Krishnamoorthi, R., Mary, S.A.: Factor oriented requirement coverage based system test case prioritization of new and regression test cases. Inf. Softw. Technol. 51(4), 799–808 (2009) Krishnamoorthi, R., Mary, S.A.: Factor oriented requirement coverage based system test case prioritization of new and regression test cases. Inf. Softw. Technol. 51(4), 799–808 (2009)
15.
Zurück zum Zitat Kumar, M., Suresh, A.V., Prashanth, P.: Analyzing the quality issues in ERP implementation: a case study. In: Proceedings of the Second International Conference on Emerging Trends in Engineering and Technology, ICETET 2009, pp. 759–764 (2009) Kumar, M., Suresh, A.V., Prashanth, P.: Analyzing the quality issues in ERP implementation: a case study. In: Proceedings of the Second International Conference on Emerging Trends in Engineering and Technology, ICETET 2009, pp. 759–764 (2009)
16.
Zurück zum Zitat Lehtola, L., Kauppinen, M., Kujala, S.: Linking the business view to requirements engineering: long-term product planning by roadmapping. In Proceedings of the 13th IEEE International Conference on Requirements Engineering. RE’05, pp. 439–446. IEEE Computer Society, Washington, DC (2005) Lehtola, L., Kauppinen, M., Kujala, S.: Linking the business view to requirements engineering: long-term product planning by roadmapping. In Proceedings of the 13th IEEE International Conference on Requirements Engineering. RE’05, pp. 439–446. IEEE Computer Society, Washington, DC (2005)
17.
Zurück zum Zitat Li, Q., Li, M., Yang, Y., Wang, Q., Tan, T., Boehm, B., Hu, C.: Bridge the gap between software test process and business value: a case study. Proceedings of the International Conference on Software Process: Trustworthy Software Development Processes (ICSP ‘09) (2009) Li, Q., Li, M., Yang, Y., Wang, Q., Tan, T., Boehm, B., Hu, C.: Bridge the gap between software test process and business value: a case study. Proceedings of the International Conference on Software Process: Trustworthy Software Development Processes (ICSP ‘09) (2009)
18.
Zurück zum Zitat Li, Q., Yang, Y., Li, M., Wang, Q., Boehm, B., Hu, C.: Improving software testing process: feature prioritization to make winners of success-critical stakeholders. J. Softw. Maint. Evol. Res. Pract. (2010). doi: 10.1002/smr.512 Li, Q., Yang, Y., Li, M., Wang, Q., Boehm, B., Hu, C.: Improving software testing process: feature prioritization to make winners of success-critical stakeholders. J. Softw. Maint. Evol. Res. Pract. (2010). doi: 10.​1002/​smr.​512
19.
Zurück zum Zitat Pandian, C.P.: Applied Software Risk Management: A Guide for Software Project Managers. Auerbach Publications, Boston (2006) Pandian, C.P.: Applied Software Risk Management: A Guide for Software Project Managers. Auerbach Publications, Boston (2006)
20.
Zurück zum Zitat Petschenik, N. H.: Practical priorities in system testing. IEEE Softw. 2(5), 18–23 1985 Petschenik, N. H.: Practical priorities in system testing. IEEE Softw. 2(5), 18–23 1985
21.
Zurück zum Zitat Ramler, R., Biffl, S. Grünbacher, P.: Value-based management of software testing. In: Biffl, S., et al. (eds.) Value-Based Software Engineering, pp. 225–244. Springer, Berlin (2006) Ramler, R., Biffl, S. Grünbacher, P.: Value-based management of software testing. In: Biffl, S., et al. (eds.) Value-Based Software Engineering, pp. 225–244. Springer, Berlin (2006)
22.
Zurück zum Zitat Ramler, R., Kopetzky, T., Platz, W.: Combinatorial test design in the TOSCA testsuite: lessons learned and practical implications. In: Proceedings of the 2012 Workshop on Combinatorial Testing, ICST 2012 (2012) Ramler, R., Kopetzky, T., Platz, W.: Combinatorial test design in the TOSCA testsuite: lessons learned and practical implications. In: Proceedings of the 2012 Workshop on Combinatorial Testing, ICST 2012 (2012)
23.
Zurück zum Zitat Srikanth, H., Williams, L.: On the economics of requirements-based test case prioritization. In: Proceedings of the Seventh International Workshop on Economics-Driven Software Engineering Research (EDSER ‘05) (2005) Srikanth, H., Williams, L.: On the economics of requirements-based test case prioritization. In: Proceedings of the Seventh International Workshop on Economics-Driven Software Engineering Research (EDSER ‘05) (2005)
24.
Zurück zum Zitat Srivastva, P.R., Kumar, K., Raghurama, G.: Test case prioritization based on requirements and risk factors. SIGSOFT Softw. Eng. Notes 33(4), Article 7 (2008) Srivastva, P.R., Kumar, K., Raghurama, G.: Test case prioritization based on requirements and risk factors. SIGSOFT Softw. Eng. Notes 33(4), Article 7 (2008)
25.
Zurück zum Zitat Urem, F., Mikulic, Z.: Developing operational profile for ERP software module reliability prediction. In: 2010 Proceedings of the 33rd International Convention MIPRO, pp. 409–413 (2010) Urem, F., Mikulic, Z.: Developing operational profile for ERP software module reliability prediction. In: 2010 Proceedings of the 33rd International Convention MIPRO, pp. 409–413 (2010)
26.
Zurück zum Zitat Zhang, D.: Machine learning in value-based software test data generation. In: Proceedings of the 18th IEEE International Conference on Tools with Artificial Intelligence (ICTAI ‘06) (2006) Zhang, D.: Machine learning in value-based software test data generation. In: Proceedings of the 18th IEEE International Conference on Tools with Artificial Intelligence (ICTAI ‘06) (2006)
27.
Zurück zum Zitat Zhang, D.A.: Value-based framework for software evolutionary testing. Int J Softw Sci Comput Intell 3(2), 62–82 (2011)CrossRef Zhang, D.A.: Value-based framework for software evolutionary testing. Int J Softw Sci Comput Intell 3(2), 62–82 (2011)CrossRef
Metadaten
Titel
A Business View on Testing ERP Systems with Value-Based Requirements Coverage
verfasst von
Rudolf Ramler
Theodorich Kopetzky
Wolfgang Platz
Copyright-Jahr
2013
Verlag
Springer Berlin Heidelberg
DOI
https://doi.org/10.1007/978-3-642-37021-2_17

Premium Partner