Skip to main content
Erschienen in: Empirical Software Engineering 4-5/2012

01.08.2012

On the use of calling structure information to improve fault prediction

verfasst von: Yonghee Shin, Robert M Bell, Thomas J Ostrand, Elaine J Weyuker

Erschienen in: Empirical Software Engineering | Ausgabe 4-5/2012

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Previous studies have shown that software code attributes, such as lines of source code, and history information, such as the number of code changes and the number of faults in prior releases of software, are useful for predicting where faults will occur. In this study of two large industrial software systems, we investigate the effectiveness of adding information about calling structure to fault prediction models. Adding calling structure information to a model based solely on non-calling structure code attributes modestly improved prediction accuracy. However, the addition of calling structure information to a model that included both history and non-calling structure code attributes produced no improvement.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
We also corrected a previous data error affecting four of the calling structure attributes in this paper. However, the overall conclusions remain the same as those observed in our earlier study.
 
Literatur
Zurück zum Zitat Andersson C, Runeson P (2007) A replicated quantitative analysis of fault distributions in complex software systems. IEEE Trans Software Eng 33(5):273–286CrossRef Andersson C, Runeson P (2007) A replicated quantitative analysis of fault distributions in complex software systems. IEEE Trans Software Eng 33(5):273–286CrossRef
Zurück zum Zitat Arisholm E, Briand LC (Sep. 21-22 2006) Predicting fault-prone components in a Java Legacy System. In: the 2006 ACM/IEEE International Symposium on Empirical Software Engineering, Rio de Janeiro, Brazil, pp 8–17. Arisholm E, Briand LC (Sep. 21-22 2006) Predicting fault-prone components in a Java Legacy System. In: the 2006 ACM/IEEE International Symposium on Empirical Software Engineering, Rio de Janeiro, Brazil, pp 8–17.
Zurück zum Zitat Basili VR, Perricone BR (1984) Software errors and complexity: an empirical investigation. Comm ACM 27:42–52CrossRef Basili VR, Perricone BR (1984) Software errors and complexity: an empirical investigation. Comm ACM 27:42–52CrossRef
Zurück zum Zitat Basili VR, Briand LC, Melo WL (1996) A validation of object-oriented design metrics as quality indicators. IEEE Trans Software Eng 22(10):751–761CrossRef Basili VR, Briand LC, Melo WL (1996) A validation of object-oriented design metrics as quality indicators. IEEE Trans Software Eng 22(10):751–761CrossRef
Zurück zum Zitat Boehm BW (1981) Software engineering economics. Prentice-Hall, Englewood CliffsMATH Boehm BW (1981) Software engineering economics. Prentice-Hall, Englewood CliffsMATH
Zurück zum Zitat Briand LC, Wust J, Ikonomovski SV, Lounis H (16–22 May 1999) Investigating quality factors in object-oriented designs: an industrial case study. In: the 1999 International Conference on Software Engineering (ICSE’99), Los Angeles, CA, USA, pp 345–354. Briand LC, Wust J, Ikonomovski SV, Lounis H (16–22 May 1999) Investigating quality factors in object-oriented designs: an industrial case study. In: the 1999 International Conference on Software Engineering (ICSE’99), Los Angeles, CA, USA, pp 345–354.
Zurück zum Zitat Chidamber SR, Kemerer CF (1994) A metrics suite for object-oriented design. IEEE Trans Software Eng 20(6):476–493CrossRef Chidamber SR, Kemerer CF (1994) A metrics suite for object-oriented design. IEEE Trans Software Eng 20(6):476–493CrossRef
Zurück zum Zitat Fenton NE, Ohlsson N (2000) Quantitative analysis of faults and failures in a complex software system. IEEE Trans Software Eng 26(8):797–814CrossRef Fenton NE, Ohlsson N (2000) Quantitative analysis of faults and failures in a complex software system. IEEE Trans Software Eng 26(8):797–814CrossRef
Zurück zum Zitat Graves TL, Karr AF, Marron JS, Siy H (2000) Predicting fault incidence using software change history. IEEE Trans Software Eng 26(7):653–661CrossRef Graves TL, Karr AF, Marron JS, Siy H (2000) Predicting fault incidence using software change history. IEEE Trans Software Eng 26(7):653–661CrossRef
Zurück zum Zitat Guyon I, Elisseeff A (2003) An introduction to variable and feature selection. J Mach Learn Research:1157–1182. Guyon I, Elisseeff A (2003) An introduction to variable and feature selection. J Mach Learn Research:1157–1182.
Zurück zum Zitat Hassan AE (2009) Predicting faults using the complexity of code changes. In: the 31st International Conference on Software Engineering, pp 78–88. Hassan AE (2009) Predicting faults using the complexity of code changes. In: the 31st International Conference on Software Engineering, pp 78–88.
Zurück zum Zitat Kamiya T, Kusumoto S, Inoue K (1999) Prediction of fault-proneness at early phase in object-oriented development. In: 2nd IEEE International Symposium Object-Oriented Real-Time Distributed Computing, pp 253–258. Kamiya T, Kusumoto S, Inoue K (1999) Prediction of fault-proneness at early phase in object-oriented development. In: 2nd IEEE International Symposium Object-Oriented Real-Time Distributed Computing, pp 253–258.
Zurück zum Zitat Khoshgoftaar TM, Allen EB, Kalaichelvan KS, Goel N (1996) Early quality prediction: a case study in telecommunications. IEEE Software 13(1):65–71CrossRef Khoshgoftaar TM, Allen EB, Kalaichelvan KS, Goel N (1996) Early quality prediction: a case study in telecommunications. IEEE Software 13(1):65–71CrossRef
Zurück zum Zitat Khoshgoftaar TM, Allen EB, Deng J (2002) Using regression trees to classify fault-prone software modules. IEEE Trans Reliab 51(4):455–462CrossRef Khoshgoftaar TM, Allen EB, Deng J (2002) Using regression trees to classify fault-prone software modules. IEEE Trans Reliab 51(4):455–462CrossRef
Zurück zum Zitat Kim S, Zimmermann T, E. James Whitehead J, Zeller A (2007) Predicting faults from cached history. In: the 29th International Conference on Software Engineering, pp 489–498. Kim S, Zimmermann T, E. James Whitehead J, Zeller A (2007) Predicting faults from cached history. In: the 29th International Conference on Software Engineering, pp 489–498.
Zurück zum Zitat McFadden D (1974) Conditional logit analysis of qualitative choice behavior. Frontiers in Econometrics 1(2):105–142 McFadden D (1974) Conditional logit analysis of qualitative choice behavior. Frontiers in Econometrics 1(2):105–142
Zurück zum Zitat Menzies T, Greenwald J, Frank A (2007) Data mining static code attributes to learn defect predictors. IEEE Trans Software Eng 33(1):2–13CrossRef Menzies T, Greenwald J, Frank A (2007) Data mining static code attributes to learn defect predictors. IEEE Trans Software Eng 33(1):2–13CrossRef
Zurück zum Zitat Nagappan N, Ball T (20–21 Sept. 2007) Using software dependencies and churn metrics to predict field failures: an empirical case study. In: First International Symposium on Empirical Software Engineering and Measurement, Madrid, Spain, pp 364–373. Nagappan N, Ball T (20–21 Sept. 2007) Using software dependencies and churn metrics to predict field failures: an empirical case study. In: First International Symposium on Empirical Software Engineering and Measurement, Madrid, Spain, pp 364–373.
Zurück zum Zitat Nagappan N, Ball T, Zeller A (May 20–28 2006) Mining metrics to predict component failures. In: the 28th International Conference on Software Engineering, Shanghai, China, pp 452–461. Nagappan N, Ball T, Zeller A (May 20–28 2006) Mining metrics to predict component failures. In: the 28th International Conference on Software Engineering, Shanghai, China, pp 452–461.
Zurück zum Zitat Nguyen THD, Adams B, Hassa AE (2010) Studying the impact of dependency network measures on software quality. In: 26th IEEE International Conference on Software Maintenance Timisoara, Romania, pp 1–10. Nguyen THD, Adams B, Hassa AE (2010) Studying the impact of dependency network measures on software quality. In: 26th IEEE International Conference on Software Maintenance Timisoara, Romania, pp 1–10.
Zurück zum Zitat NIST (2002) The economic impacts of inadequate infrastructure for software testing. National Institute of Standards & Technology. NIST (2002) The economic impacts of inadequate infrastructure for software testing. National Institute of Standards & Technology.
Zurück zum Zitat Ohlsson N, Alberg H (1996) Predicting fault-prone software modules in telephone switches. IEEE Trans Software Eng 22(12):886–894CrossRef Ohlsson N, Alberg H (1996) Predicting fault-prone software modules in telephone switches. IEEE Trans Software Eng 22(12):886–894CrossRef
Zurück zum Zitat Ostrand TJ, Weyuker EJ (July 22–24 2002) The distribution of faults in a large industrial software system. In: the 2002 ACM SIGSOFT International Symposium on Software Testing and Analysis, Roma, Italy, pp 55–64. Ostrand TJ, Weyuker EJ (July 22–24 2002) The distribution of faults in a large industrial software system. In: the 2002 ACM SIGSOFT International Symposium on Software Testing and Analysis, Roma, Italy, pp 55–64.
Zurück zum Zitat Ostrand TJ, Weyuker EJ, Bell RM (2005) Predicting the location and number of faults in large software systems. IEEE Trans Software Eng 31(4):340–355CrossRef Ostrand TJ, Weyuker EJ, Bell RM (2005) Predicting the location and number of faults in large software systems. IEEE Trans Software Eng 31(4):340–355CrossRef
Zurück zum Zitat Shin Y, Bell R, Ostrand T, Weyuker E (May 16–17 2009) Does calling structure information improve the accuracy of fault prediction? In: 6th IEEE International Working Conference on Mining Software Repositories, Vancouver, BC, Canada, pp 61–70. Shin Y, Bell R, Ostrand T, Weyuker E (May 16–17 2009) Does calling structure information improve the accuracy of fault prediction? In: 6th IEEE International Working Conference on Mining Software Repositories, Vancouver, BC, Canada, pp 61–70.
Zurück zum Zitat Stevens WP, Myers GJ, Constantine LL (1974) Structured design. IBM Systems Journal 13(2):115–139CrossRef Stevens WP, Myers GJ, Constantine LL (1974) Structured design. IBM Systems Journal 13(2):115–139CrossRef
Zurück zum Zitat Tosun A, Turhan B, Bener A (May 18–19 2009) Validation of network measures as indicators of defective modules in software systems. In: Proceedings of the 5th International Conference on Predictor Models in Software Engineering (PROMISE ’09), Vancouver, Canada. Tosun A, Turhan B, Bener A (May 18–19 2009) Validation of network measures as indicators of defective modules in software systems. In: Proceedings of the 5th International Conference on Predictor Models in Software Engineering (PROMISE ’09), Vancouver, Canada.
Zurück zum Zitat Weyuker EJ, Ostrand TJ (July 20 2008) Comparing methods to identify defect reports in a change management database. In: International Workshop on Defects in Large Software Systems (DEFFECTS’08), Seattle, WA. Weyuker EJ, Ostrand TJ (July 20 2008) Comparing methods to identify defect reports in a change management database. In: International Workshop on Defects in Large Software Systems (DEFFECTS’08), Seattle, WA.
Zurück zum Zitat Weyuker EJ, Ostrand TJ, Bell RM (20 May 2007) Using developer information as a factor for fault prediction. In: International Workshop on Predictor Models in Software Engineering (PROMISE ’07), Minneapolis, MN. Weyuker EJ, Ostrand TJ, Bell RM (20 May 2007) Using developer information as a factor for fault prediction. In: International Workshop on Predictor Models in Software Engineering (PROMISE ’07), Minneapolis, MN.
Zurück zum Zitat Weyuker EJ, Ostrand TJ, Bell RM (May 12–13 2008a) Comparing negative binomial and recursive partitioning models for fault prediction. In: the 4th International Workshop on Predictor Models in Software Engineering (PROMISE’08), Leipzig, Germany, pp 3–10. Weyuker EJ, Ostrand TJ, Bell RM (May 12–13 2008a) Comparing negative binomial and recursive partitioning models for fault prediction. In: the 4th International Workshop on Predictor Models in Software Engineering (PROMISE’08), Leipzig, Germany, pp 3–10.
Zurück zum Zitat Weyuker EJ, Ostrand TJ, Bell RM (2008b) Do too many cooks spoil the broth? Using the number of developers to enhance defect prediction models. Empir Software Eng 13(5):539–559CrossRef Weyuker EJ, Ostrand TJ, Bell RM (2008b) Do too many cooks spoil the broth? Using the number of developers to enhance defect prediction models. Empir Software Eng 13(5):539–559CrossRef
Zurück zum Zitat Weyuker EJ, Ostrand TJ, Bell RM (2010) Comparing the effectiveness of several modeling methods for fault prediction. Empir Software Eng 15(3). Weyuker EJ, Ostrand TJ, Bell RM (2010) Comparing the effectiveness of several modeling methods for fault prediction. Empir Software Eng 15(3).
Zurück zum Zitat Zhou Y, Leung H (2006) Empirical analysis of object-oriented design metrics for predicting high and low severity faults. IEEE Trans Software Eng 32(10):771–789CrossRef Zhou Y, Leung H (2006) Empirical analysis of object-oriented design metrics for predicting high and low severity faults. IEEE Trans Software Eng 32(10):771–789CrossRef
Zurück zum Zitat Zimmermann T, Nagappan N (10–18 May 2008) Predicting defects using network analysis on dependency graphs. In: the 13th International Conference on Software Engineering, pp 531–540. Zimmermann T, Nagappan N (10–18 May 2008) Predicting defects using network analysis on dependency graphs. In: the 13th International Conference on Software Engineering, pp 531–540.
Zurück zum Zitat Zimmermann T, Weißgerber P (May 2004) Preprocessing CVS data for fine-grained analysis. In: 1st International Workshop on Mining Software Repositories (MSR’04), Edinburgh, UK. Zimmermann T, Weißgerber P (May 2004) Preprocessing CVS data for fine-grained analysis. In: 1st International Workshop on Mining Software Repositories (MSR’04), Edinburgh, UK.
Metadaten
Titel
On the use of calling structure information to improve fault prediction
verfasst von
Yonghee Shin
Robert M Bell
Thomas J Ostrand
Elaine J Weyuker
Publikationsdatum
01.08.2012
Verlag
Springer US
Erschienen in
Empirical Software Engineering / Ausgabe 4-5/2012
Print ISSN: 1382-3256
Elektronische ISSN: 1573-7616
DOI
https://doi.org/10.1007/s10664-011-9165-9

Weitere Artikel der Ausgabe 4-5/2012

Empirical Software Engineering 4-5/2012 Zur Ausgabe

Premium Partner