Skip to main content

2017 | OriginalPaper | Buchkapitel

Uncertainty in Software Testing

verfasst von : Salman Abdul Moiz

Erschienen in: Trends in Software Testing

Verlag: Springer Singapore

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The primary objective of software development is to deliver high quality product at low cost. Testing is inherent in each phase of development as the deliverables of each phase is to be tested to produce a better quality artifact before proceeding to the next phase of development. Software testing describes the discrepancies between the software deliverables and the customer expectations. Software testing life cycle covers test selection, test classification, test execution, and quality estimation. The quality of the deliverable produced may not always be as per the expected outcome or within a probabilistic range. The outcome of testing may be error prone and uncertain because of inadequate techniques for estimation, selection, classification, and execution of test cases. Hence, there is a requirement to model uncertainties after completion of each phase of development. Mechanisms are needed to address uncertainty in each of the deliverables produced during software development process. The uncertainty metrics can help in assessing the degree of uncertainty. Effective modeling techniques for uncertainty are needed at each phase of development.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat W. Royce, Measuring agility and architectural integrity. Int. J. Softw. Inform. 5(3), 415–433 (2011) W. Royce, Measuring agility and architectural integrity. Int. J. Softw. Inform. 5(3), 415–433 (2011)
2.
Zurück zum Zitat R.B. Paramkushan, A decision theoretic model for information technology. Manag. Stud. 1(1), 47–63 (2013) R.B. Paramkushan, A decision theoretic model for information technology. Manag. Stud. 1(1), 47–63 (2013)
3.
Zurück zum Zitat B. Kitchenham, S. Linkman, Estimates, uncertainty and risk. IEEE Softw. 14(3), 69–74 (1997)CrossRef B. Kitchenham, S. Linkman, Estimates, uncertainty and risk. IEEE Softw. 14(3), 69–74 (1997)CrossRef
4.
Zurück zum Zitat H. Madsen, P. Thyregod, B. Burtschy, G. Albenau, F. Popentiu, A fuzzy logic approach to software testing & debugging, in Safety & Reliability for Managing Risk (ESREL 2006), vol. 11, ed. by C. Guedes Soares, E. Zio (Taylor & Francisc Group, Abingdon, 2006), pp. 1435–1442 H. Madsen, P. Thyregod, B. Burtschy, G. Albenau, F. Popentiu, A fuzzy logic approach to software testing & debugging, in Safety & Reliability for Managing Risk (ESREL 2006), vol. 11, ed. by C. Guedes Soares, E. Zio (Taylor & Francisc Group, Abingdon, 2006), pp. 1435–1442
5.
Zurück zum Zitat H. Ziv, D.J. Richardson, Bayesian-network confirmation of software testing uncertainties, in Proceedings of Sixth European Software Engineering Conference (ESEC), 1997 H. Ziv, D.J. Richardson, Bayesian-network confirmation of software testing uncertainties, in Proceedings of Sixth European Software Engineering Conference (ESEC), 1997
6.
Zurück zum Zitat R. Buxton, Modeling uncertainty in expert systems. Int. J. Man Mach. Stud. 31(4), 415–476 (1989)CrossRef R. Buxton, Modeling uncertainty in expert systems. Int. J. Man Mach. Stud. 31(4), 415–476 (1989)CrossRef
7.
Zurück zum Zitat W.A. Wrigh, G. Ramage, D. Cornford, I.T. Nabney, Neural network modeling with input uncertainty: theory & applications. J. VLSI Signal Process. Syst. Signal Image Video Technol. 26(1), 169–188 (2000)CrossRefMATH W.A. Wrigh, G. Ramage, D. Cornford, I.T. Nabney, Neural network modeling with input uncertainty: theory & applications. J. VLSI Signal Process. Syst. Signal Image Video Technol. 26(1), 169–188 (2000)CrossRefMATH
8.
Zurück zum Zitat V.B. Robinson, A.U. Frank, About kinds of uncertainty in collection of spatial data, in Proceedings of AUTO-CARTO 7 (1985), pp. 440–449 V.B. Robinson, A.U. Frank, About kinds of uncertainty in collection of spatial data, in Proceedings of AUTO-CARTO 7 (1985), pp. 440–449
9.
Zurück zum Zitat Luqi, D. Cooke, The management of uncertainty in software development, in Proceedings of 16th International Conference on Computer Software & Applications (1992), pp. 381–386 Luqi, D. Cooke, The management of uncertainty in software development, in Proceedings of 16th International Conference on Computer Software & Applications (1992), pp. 381–386
10.
Zurück zum Zitat M.M. Lehman, Programs, life cycles and laws of software evolution. Proc. IEEE 68(9), 1060–1075 (1980)CrossRef M.M. Lehman, Programs, life cycles and laws of software evolution. Proc. IEEE 68(9), 1060–1075 (1980)CrossRef
11.
Zurück zum Zitat Computer Society IEEE, IEEE guide for the use of IEEE standard dictionary of measures to produce reliable software, in IEEE Standards Collection Software Engineering (IEEE Computer Society Press, New York, 1994) Computer Society IEEE, IEEE guide for the use of IEEE standard dictionary of measures to produce reliable software, in IEEE Standards Collection Software Engineering (IEEE Computer Society Press, New York, 1994)
12.
Zurück zum Zitat H. Ziv, D.J. Richardson, The uncertainty principle in software engineering, in Proceedings of 19th International Conference on Software Engineering, 1996 H. Ziv, D.J. Richardson, The uncertainty principle in software engineering, in Proceedings of 19th International Conference on Software Engineering, 1996
13.
Zurück zum Zitat A. Gemmer, Risk management: moving beyond process. IEEE Comput. 30(5), 33–43 (1997)CrossRef A. Gemmer, Risk management: moving beyond process. IEEE Comput. 30(5), 33–43 (1997)CrossRef
14.
Zurück zum Zitat E. Letier, D. Stefan, E.T. Barr, Uncertainty, risk and information value in software requirements & architecture, in Proceedings of 36th International Conference on Software Engineering (2014), pp. 883–894 E. Letier, D. Stefan, E.T. Barr, Uncertainty, risk and information value in software requirements & architecture, in Proceedings of 36th International Conference on Software Engineering (2014), pp. 883–894
15.
Zurück zum Zitat C.E. Medowell, D.P. Helmbold, Debugging concurrent programs. ACM Comput. Surv. 21(4), 593–628 (1989) C.E. Medowell, D.P. Helmbold, Debugging concurrent programs. ACM Comput. Surv. 21(4), 593–628 (1989)
16.
Zurück zum Zitat C.H. Ledoux, D.S. Paker Jr, Saving traces for Ada debugging, in Proceedings of the Ada International Conference ACM (1985), pp. 97–108 C.H. Ledoux, D.S. Paker Jr, Saving traces for Ada debugging, in Proceedings of the Ada International Conference ACM (1985), pp. 97–108
17.
Zurück zum Zitat Jason Gait, A probe effect in concurrent programs. Softw. Pract. Exp. 16(3), 225–233 (1986)CrossRef Jason Gait, A probe effect in concurrent programs. Softw. Pract. Exp. 16(3), 225–233 (1986)CrossRef
18.
Zurück zum Zitat J. Gait, A debugger for concurrent programs. Softw. Pract. Exp. 15(6), 539–594 (1985)CrossRefMATH J. Gait, A debugger for concurrent programs. Softw. Pract. Exp. 15(6), 539–594 (1985)CrossRefMATH
19.
Zurück zum Zitat C.V. Ramamoorthy, Danilel E. Cooke, The Correspondence between Methods of Artificial Intelligence and the Production and Maintenance of Evolutionary Software, in Proceedings of the 3rd International IEEE Conference on Tools for Artificial Intelligence (1991), pp. 114–118 C.V. Ramamoorthy, Danilel E. Cooke, The Correspondence between Methods of Artificial Intelligence and the Production and Maintenance of Evolutionary Software, in Proceedings of the 3rd International IEEE Conference on Tools for Artificial Intelligence (1991), pp. 114–118
20.
Zurück zum Zitat D. Garlan, Software engineering in an uncertain world, in ACM Proceedings of FOSER (2010), pp. 125–128 D. Garlan, Software engineering in an uncertain world, in ACM Proceedings of FOSER (2010), pp. 125–128
21.
Zurück zum Zitat D. Garlan, B. Schmerl, The RADAR architecture for personal cognitive assistance. Int. J. Softw. Eng. Knowl. Eng. 17(2) (2007) D. Garlan, B. Schmerl, The RADAR architecture for personal cognitive assistance. Int. J. Softw. Eng. Knowl. Eng. 17(2) (2007)
22.
Zurück zum Zitat A.L. Goel, Software reliability models: assumptions, limitations and applicability. IEEE Trans. Softw. Eng. SE-11(12),1411–1423 (1985) A.L. Goel, Software reliability models: assumptions, limitations and applicability. IEEE Trans. Softw. Eng. SE-11(12),1411–1423 (1985)
23.
Zurück zum Zitat M. Kumar, A. Sharma, R. Kumar, multi-faceted measurement framework for test case classification & fitness evaluation using fuzzy logic based approach. Chiang Mai J. Sci. 39(3), 486–497 (2012) M. Kumar, A. Sharma, R. Kumar, multi-faceted measurement framework for test case classification & fitness evaluation using fuzzy logic based approach. Chiang Mai J. Sci. 39(3), 486–497 (2012)
24.
Zurück zum Zitat N.G. Leveson, C.S. Turner, An investigation of the Therac-25 accidents. IEEE Comput. 26(7), 18–41 (1993)CrossRef N.G. Leveson, C.S. Turner, An investigation of the Therac-25 accidents. IEEE Comput. 26(7), 18–41 (1993)CrossRef
25.
Zurück zum Zitat S. Elbaum, D.S. rosenblum, Known unknowns: testing in the presence of uncertainty, in Proceedings of FSE (2014), pp. 833–836 S. Elbaum, D.S. rosenblum, Known unknowns: testing in the presence of uncertainty, in Proceedings of FSE (2014), pp. 833–836
26.
Zurück zum Zitat D.J. Richardson, S.L. Aha, T.O. O’Malley, Specification based test oracles for reactive systems, in Proceedings of 14th International Conference on Software Engineering (ICSE) (1992), pp. 105–118 D.J. Richardson, S.L. Aha, T.O. O’Malley, Specification based test oracles for reactive systems, in Proceedings of 14th International Conference on Software Engineering (ICSE) (1992), pp. 105–118
27.
Zurück zum Zitat P.T. Devanbu, R.J. Brachman, P.J. Selfridge, B.W. Ballard, LaSSIE: a knowledge based software information systems, in Proceedings of 12th International Conference on Software Engineering (1990), pp. 249–261 P.T. Devanbu, R.J. Brachman, P.J. Selfridge, B.W. Ballard, LaSSIE: a knowledge based software information systems, in Proceedings of 12th International Conference on Software Engineering (1990), pp. 249–261
28.
Zurück zum Zitat A.M. Davis, Tracing: a simple necessity neglected. IEEE Softw. 12(5), 6–7 (1995) A.M. Davis, Tracing: a simple necessity neglected. IEEE Softw. 12(5), 6–7 (1995)
29.
Zurück zum Zitat S.A. Moiz, R. Lakshmi, Single lock manager approach for achieving concurrency in mobile environments, in 14th IEEE International Conference on High Performance Computing (HiPC) (Springer LNCS 4873, 2007), pp. 650–660 S.A. Moiz, R. Lakshmi, Single lock manager approach for achieving concurrency in mobile environments, in 14th IEEE International Conference on High Performance Computing (HiPC) (Springer LNCS 4873, 2007), pp. 650–660
30.
Zurück zum Zitat P.A. Laplante, C.J. Neil, Modeling uncertainty in software engineering using rough sets. Innovations Syst. Softw. Eng. I, 71–78 (2005)CrossRef P.A. Laplante, C.J. Neil, Modeling uncertainty in software engineering using rough sets. Innovations Syst. Softw. Eng. I, 71–78 (2005)CrossRef
31.
Zurück zum Zitat B.W. Boehm, Software Risk Management (IEEE Computer Society Press, Washington, D.C., 1989)CrossRef B.W. Boehm, Software Risk Management (IEEE Computer Society Press, Washington, D.C., 1989)CrossRef
32.
Zurück zum Zitat B.W. Boehm, Software risk management: principles and practices. IEEE Softw. 8(1), 32–41 (1991)CrossRef B.W. Boehm, Software risk management: principles and practices. IEEE Softw. 8(1), 32–41 (1991)CrossRef
33.
Zurück zum Zitat B. Littlewood, How to measure software reliability and how not to. IEEE Trans. Reliab. R-28(2), 103–110 (1979) B. Littlewood, How to measure software reliability and how not to. IEEE Trans. Reliab. R-28(2), 103–110 (1979)
34.
Zurück zum Zitat B. Littlewood, L. Strigini, Validation of ultrahigh dependability for software-based systems. Commun. ACM 36(11), 69–80 (1993)CrossRef B. Littlewood, L. Strigini, Validation of ultrahigh dependability for software-based systems. Commun. ACM 36(11), 69–80 (1993)CrossRef
35.
Zurück zum Zitat J. Pearl, Probabilistic reasoning in intelligent systems: networks of plausible inference (Morgan Kaufmann Publishers, San Mateo, 1988)MATH J. Pearl, Probabilistic reasoning in intelligent systems: networks of plausible inference (Morgan Kaufmann Publishers, San Mateo, 1988)MATH
36.
Zurück zum Zitat R.E. Neapolitan, Probabilistic reasoning in expert systems: theory and algorithms (Wiley, New York, 1990) R.E. Neapolitan, Probabilistic reasoning in expert systems: theory and algorithms (Wiley, New York, 1990)
37.
Zurück zum Zitat D.E. Heckerman, A. Mamdani, M.P. Wellman, Real-world applications of Bayesian networks. Uncertainty AI Commun. ACM 38(3), 24–26 (1995)CrossRef D.E. Heckerman, A. Mamdani, M.P. Wellman, Real-world applications of Bayesian networks. Uncertainty AI Commun. ACM 38(3), 24–26 (1995)CrossRef
38.
Zurück zum Zitat M. Kumar, A. Sharma, R. Kumar, Towards multi-faceted test cases optimization. J. Softw. Eng. Appl. 4(9), 550–557 (2011)CrossRef M. Kumar, A. Sharma, R. Kumar, Towards multi-faceted test cases optimization. J. Softw. Eng. Appl. 4(9), 550–557 (2011)CrossRef
39.
Zurück zum Zitat M. Kumar, A. Sharma, R. Kumar, Soft computing-based software test cases optimization: a survey. Int. Rev. Comp. Softw. 6(4), 512–526 (2011) M. Kumar, A. Sharma, R. Kumar, Soft computing-based software test cases optimization: a survey. Int. Rev. Comp. Softw. 6(4), 512–526 (2011)
40.
Zurück zum Zitat S. Yogesh, A. Kaur, B. Suri, Test case prioritization using ant colony optimization. ACM SIGSOFT Softw. Eng. Notes 35(4), 1–7 (2010) S. Yogesh, A. Kaur, B. Suri, Test case prioritization using ant colony optimization. ACM SIGSOFT Softw. Eng. Notes 35(4), 1–7 (2010)
42.
Zurück zum Zitat L.P. Khoo, S.B. Tor, L.Y. Zhai, A rough-set-based approach for classification and rule induction. Int. J. Adv. Manuf. Technol. 15(7), 438–444 (1999)CrossRef L.P. Khoo, S.B. Tor, L.Y. Zhai, A rough-set-based approach for classification and rule induction. Int. J. Adv. Manuf. Technol. 15(7), 438–444 (1999)CrossRef
43.
Zurück zum Zitat J.W. Grazymala-Busse, A new version of the rule induction system lers. J. Fundamenta Informaticae 31(1), 27–39 (1997)MATH J.W. Grazymala-Busse, A new version of the rule induction system lers. J. Fundamenta Informaticae 31(1), 27–39 (1997)MATH
45.
Zurück zum Zitat A. Frank, Conceptual framework for land information system—a first approach, in Proceedings of Commission 3 of the FIG (1982) A. Frank, Conceptual framework for land information system—a first approach, in Proceedings of Commission 3 of the FIG (1982)
46.
Zurück zum Zitat K. Forsberg, H. Mooz, The relationship of system engineering to the project cycle, in Proceedings of First Annual Symposium of National Council on System Engineering (1991), pp. 57–65 K. Forsberg, H. Mooz, The relationship of system engineering to the project cycle, in Proceedings of First Annual Symposium of National Council on System Engineering (1991), pp. 57–65
47.
Zurück zum Zitat PA Laplante, CJ Neils, Uncertainty: a meta-property of software, in Proceedings of the IEEE/NASA 29th Software Engineering Workshop (2005), pp. 228–233 PA Laplante, CJ Neils, Uncertainty: a meta-property of software, in Proceedings of the IEEE/NASA 29th Software Engineering Workshop (2005), pp. 228–233
Metadaten
Titel
Uncertainty in Software Testing
verfasst von
Salman Abdul Moiz
Copyright-Jahr
2017
Verlag
Springer Singapore
DOI
https://doi.org/10.1007/978-981-10-1415-4_4