Skip to main content

2018 | OriginalPaper | Buchkapitel

To What Extent Does Performance Awareness Support Developers in Fixing Performance Bugs?

verfasst von : Alexandru Danciu, Helmut Krcmar

Erschienen in: Computer Performance Engineering

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Current research on performance awareness evaluates approaches primarily for their functional correctness but does not assess to what extent developers are supported in improving software implementations. This article presents the evaluation of an existing approach for supporting developers of Java Enterprise Edition (EE) applications with response time estimations based on a controlled human-oriented experiment. The main goal of the experiment is to quantify the effectiveness of employing the approach while optimizing the response time of an implementation. Subjects’ optimizations are quantified by the amount of fixed performance bugs. Having employed the approach, subjects fixed on average over three times more performance bugs. The results further indicate that in the absence of a performance awareness aid, the success of optimizing a previously unknown implementation is far less dependent of the behavior and skill level of the developer.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Bulej, L., Bureš, T., Keznikl, J., Koubková, A., Podzimek, A., Tůma, P.: Capturing performance assumptions using stochastic performance logic. In: 3rd ACM/SPEC International Conference on Performance Engineering, pp. 311–322 (2012) Bulej, L., Bureš, T., Keznikl, J., Koubková, A., Podzimek, A., Tůma, P.: Capturing performance assumptions using stochastic performance logic. In: 3rd ACM/SPEC International Conference on Performance Engineering, pp. 311–322 (2012)
2.
Zurück zum Zitat Cito, J., Leitner, P., Gall, H.C., Dadashi, A., Keller, A., Roth, A.: Runtime metric meets developer: building better cloud applications using feedback. In: ACM International Symposium on New Ideas, New Paradigms, and Reflections on Programming and Software, pp. 14–27 (2015) Cito, J., Leitner, P., Gall, H.C., Dadashi, A., Keller, A., Roth, A.: Runtime metric meets developer: building better cloud applications using feedback. In: ACM International Symposium on New Ideas, New Paradigms, and Reflections on Programming and Software, pp. 14–27 (2015)
4.
Zurück zum Zitat Elliott, A.C., Woodward, W.A.: Statistical Analysis Quick Reference Guidebook: With SPSS Examples. Sage, Thousand Oaks (2007)CrossRef Elliott, A.C., Woodward, W.A.: Statistical Analysis Quick Reference Guidebook: With SPSS Examples. Sage, Thousand Oaks (2007)CrossRef
5.
Zurück zum Zitat Heger, C., Happe, J., Farahbod, R.: Automated root cause isolation of performance regressions during software development. In: 4th ACM/SPEC International Conference on Performance Engineering, pp. 27–38 (2013) Heger, C., Happe, J., Farahbod, R.: Automated root cause isolation of performance regressions during software development. In: 4th ACM/SPEC International Conference on Performance Engineering, pp. 27–38 (2013)
6.
Zurück zum Zitat Horký, V., Libic, P., Marek, L., Steinhauser, A., Tůma, P.: Utilizing performance unit tests to increase performance awareness. In: 6th International Conference on Performance Engineering, pp. 289–300 (2015) Horký, V., Libic, P., Marek, L., Steinhauser, A., Tůma, P.: Utilizing performance unit tests to increase performance awareness. In: 6th International Conference on Performance Engineering, pp. 289–300 (2015)
7.
Zurück zum Zitat Höst, M., Regnell, B., Wohlin, C.: Using students as subjects–a comparative study of students and professionals in lead-time impact assessment. Empir. Softw. Eng. 5(3), 201–214 (2000)CrossRef Höst, M., Regnell, B., Wohlin, C.: Using students as subjects–a comparative study of students and professionals in lead-time impact assessment. Empir. Softw. Eng. 5(3), 201–214 (2000)CrossRef
8.
Zurück zum Zitat Jin, G., Song, L., Shi, X., Scherpelz, J., Lu, S.: Understanding and detecting real-world performance bugs. SIGPLAN Not. 47(6), 77–88 (2012)CrossRef Jin, G., Song, L., Shi, X., Scherpelz, J., Lu, S.: Understanding and detecting real-world performance bugs. SIGPLAN Not. 47(6), 77–88 (2012)CrossRef
9.
Zurück zum Zitat Kitchenham, B., Fry, J., Linkman, S.: The case against cross-over designs in software engineering. In: 11th International Workshop on Software Technology and Engineering Practice, pp. 65–67 (2003) Kitchenham, B., Fry, J., Linkman, S.: The case against cross-over designs in software engineering. In: 11th International Workshop on Software Technology and Engineering Practice, pp. 65–67 (2003)
10.
Zurück zum Zitat Kitchenham, B.A., et al.: Preliminary guidelines for empirical research in software engineering. IEEE Trans. Softw. Eng. 28(8), 721–734 (2002)CrossRef Kitchenham, B.A., et al.: Preliminary guidelines for empirical research in software engineering. IEEE Trans. Softw. Eng. 28(8), 721–734 (2002)CrossRef
11.
Zurück zum Zitat Minelli, R., Mocci, A., Lanza, M.: I know what you did last summer - an investigation of how developers spend their time. In: 23rd IEEE International Conference on Program Comprehension, pp. 25–35 (2015) Minelli, R., Mocci, A., Lanza, M.: I know what you did last summer - an investigation of how developers spend their time. In: 23rd IEEE International Conference on Program Comprehension, pp. 25–35 (2015)
12.
Zurück zum Zitat Reussner, R., Becker, S., Happe, J., Koziolek, H., Krogmann, K., Kuperberg, M.: The Palladio Component Model. Universität Karlsruhe (2007) Reussner, R., Becker, S., Happe, J., Koziolek, H., Krogmann, K., Kuperberg, M.: The Palladio Component Model. Universität Karlsruhe (2007)
13.
Zurück zum Zitat Robillard, M.P., Coelho, W., Murphy, G.C.: How effective developers investigate source code: an exploratory study. IEEE Trans. Softw. Eng. 30(12), 889–903 (2004)CrossRef Robillard, M.P., Coelho, W., Murphy, G.C.: How effective developers investigate source code: an exploratory study. IEEE Trans. Softw. Eng. 30(12), 889–903 (2004)CrossRef
14.
Zurück zum Zitat Sanchez, H., Robbes, R., Gonzalez, V.M.: An empirical study of work fragmentation in software evolution tasks. In: 22nd IEEE International Conference on Software Analysis, Evolution, and Reengineering, pp. 251–260 (2015) Sanchez, H., Robbes, R., Gonzalez, V.M.: An empirical study of work fragmentation in software evolution tasks. In: 22nd IEEE International Conference on Software Analysis, Evolution, and Reengineering, pp. 251–260 (2015)
15.
Zurück zum Zitat Smith, C.U., Williams, L.G.: More new software performance antipatterns: even more ways to shoot yourself in the foot. In: Computer Measurement Group Conference, pp. 717–725 (2003) Smith, C.U., Williams, L.G.: More new software performance antipatterns: even more ways to shoot yourself in the foot. In: Computer Measurement Group Conference, pp. 717–725 (2003)
16.
Zurück zum Zitat Tůma, P.: Performance awareness: keynote abstract. In: 5th ACM/SPEC International Conference on Performance Engineering, pp. 135–136 (2014) Tůma, P.: Performance awareness: keynote abstract. In: 5th ACM/SPEC International Conference on Performance Engineering, pp. 135–136 (2014)
17.
Zurück zum Zitat Weiss, C., Westermann, D., Heger, C., Moser, M.: Systematic performance evaluation based on tailored benchmark applications. In: 4th ACM/SPEC International Conference on Performance Engineering, pp. 411–420 (2013) Weiss, C., Westermann, D., Heger, C., Moser, M.: Systematic performance evaluation based on tailored benchmark applications. In: 4th ACM/SPEC International Conference on Performance Engineering, pp. 411–420 (2013)
18.
Zurück zum Zitat Wert, A.: Performance problem diagnostics by systematic experimentation. Ph.D. thesis, KIT-Bibliothek (2015) Wert, A.: Performance problem diagnostics by systematic experimentation. Ph.D. thesis, KIT-Bibliothek (2015)
Metadaten
Titel
To What Extent Does Performance Awareness Support Developers in Fixing Performance Bugs?
verfasst von
Alexandru Danciu
Helmut Krcmar
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-030-02227-3_2

Neuer Inhalt