Skip to main content
Erschienen in: Innovations in Systems and Software Engineering 2-3/2017

13.06.2017 | Original Paper

Empirical assessment of machine learning models for agile software development effort estimation using story points

verfasst von: Shashank Mouli Satapathy, Santanu Kumar Rath

Erschienen in: Innovations in Systems and Software Engineering | Ausgabe 2-3/2017

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

In the present day developing houses, the procedures adopted during the development of software using agile methodologies are acknowledged as a better option than the procedures followed during conventional software development due to its innate characteristics such as iterative development, rapid delivery and reduced risk. Hence, it is desirable that the software development industries should have proper planning for estimating the effort required in agile software development. The existing techniques such as expert opinion, analogy and disaggregation are mostly observed to be ad hoc and in this manner inclined to be mistaken in a number of cases. One of the various approaches for calculating effort of agile projects in an empirical way is the story point approach (SPA). This paper presents a study on analysis of prediction accuracy of estimation process executed in order to improve it using SPA. Different machine learning techniques such as decision tree, stochastic gradient boosting and random forest are considered in order to assess prediction more qualitatively. A comparative analysis of these techniques with existing techniques is also presented and analyzed in order to critically examine their performance.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Abrahamsson P, Fronza I, Moser R, Vlasenko J, Pedrycz W (2011) Predicting development effort from user stories. In: Empirical software engineering and measurement (ESEM), 2011 international symposium on, IEEE, pp 400–403 Abrahamsson P, Fronza I, Moser R, Vlasenko J, Pedrycz W (2011) Predicting development effort from user stories. In: Empirical software engineering and measurement (ESEM), 2011 international symposium on, IEEE, pp 400–403
2.
Zurück zum Zitat Azzeh M, Nassif AB, Minku LL (2015) An empirical evaluation of ensemble adjustment methods for analogy-based effort estimation. J Syst Softw 103:36–52CrossRef Azzeh M, Nassif AB, Minku LL (2015) An empirical evaluation of ensemble adjustment methods for analogy-based effort estimation. J Syst Softw 103:36–52CrossRef
4.
Zurück zum Zitat Britto R, Mendes E, Borstler J (2015) An empirical investigation on effort estimation in agile global software development. In: Global Software Engineering (ICGSE), 2015 IEEE 10th International Conference on. IEEE, IEEE, pp 38–45 Britto R, Mendes E, Borstler J (2015) An empirical investigation on effort estimation in agile global software development. In: Global Software Engineering (ICGSE), 2015 IEEE 10th International Conference on. IEEE, IEEE, pp 38–45
5.
Zurück zum Zitat Coelho E, Basu A (2012) Effort estimation in agile software development using story points. Int J Appl Inf Syst (IJAIS) 3(7) Coelho E, Basu A (2012) Effort estimation in agile software development using story points. Int J Appl Inf Syst (IJAIS) 3(7)
6.
Zurück zum Zitat Cohen D, Lindvall M, Costa P (2004) An introduction to agile methods. Adv Comput 62:1–66CrossRef Cohen D, Lindvall M, Costa P (2004) An introduction to agile methods. Adv Comput 62:1–66CrossRef
7.
Zurück zum Zitat Foss T, Stensrud E, Kitchenham B, Myrtveit I (2003) A simulation study of the model evaluation criterion mmre. IEEE Trans Softw Eng 29(11):985–995CrossRef Foss T, Stensrud E, Kitchenham B, Myrtveit I (2003) A simulation study of the model evaluation criterion mmre. IEEE Trans Softw Eng 29(11):985–995CrossRef
8.
Zurück zum Zitat Fowler M, Highsmith J (2001) The agile manifesto. Softw Dev 9(8):28–35 Fowler M, Highsmith J (2001) The agile manifesto. Softw Dev 9(8):28–35
10.
Zurück zum Zitat Garg S, Gupta D (2015) PCA based cost estimation model for agile software development projects. In: Industrial Engineering and Operations Management (IEOM), 2015 International Conference on, IEEE, pp 1–7 Garg S, Gupta D (2015) PCA based cost estimation model for agile software development projects. In: Industrial Engineering and Operations Management (IEOM), 2015 International Conference on, IEEE, pp 1–7
11.
Zurück zum Zitat Grapenthin S, Poggel S, Book M, Gruhn V (2014) Facilitating task breakdown in sprint planning meeting 2 with an interaction room: an experience report. In: Software engineering and advanced applications (SEAA), 2014 40th EUROMICRO Conference on, IEEE, pp 1–8 Grapenthin S, Poggel S, Book M, Gruhn V (2014) Facilitating task breakdown in sprint planning meeting 2 with an interaction room: an experience report. In: Software engineering and advanced applications (SEAA), 2014 40th EUROMICRO Conference on, IEEE, pp 1–8
12.
Zurück zum Zitat Hamouda AED (2014) Using agile story points as an estimation technique in cmmi organizations. In: Agile conference (AGILE), 2014, IEEE, pp 16–23 Hamouda AED (2014) Using agile story points as an estimation technique in cmmi organizations. In: Agile conference (AGILE), 2014, IEEE, pp 16–23
13.
Zurück zum Zitat Hearty P, Fenton N, Marquez D, Neil M (2009) Predicting project velocity in xp using a learning dynamic bayesian network model. IEEE Trans. Softw. Eng. 35(1):124–137CrossRef Hearty P, Fenton N, Marquez D, Neil M (2009) Predicting project velocity in xp using a learning dynamic bayesian network model. IEEE Trans. Softw. Eng. 35(1):124–137CrossRef
14.
Zurück zum Zitat Hussain I, Kosseim L, Ormandjieva O (2013) Approximation of cosmic functional size to support early effort estimation in agile. Data Knowl Eng 85:2–14CrossRef Hussain I, Kosseim L, Ormandjieva O (2013) Approximation of cosmic functional size to support early effort estimation in agile. Data Knowl Eng 85:2–14CrossRef
15.
Zurück zum Zitat Kang S, Choi O, Baik J (2010) Model-based dynamic cost estimation and tracking method for agile software development. In: Computer and information science (ICIS), 2010 IEEE/ACIS 9th International Conference on, IEEE, pp 743–748 Kang S, Choi O, Baik J (2010) Model-based dynamic cost estimation and tracking method for agile software development. In: Computer and information science (ICIS), 2010 IEEE/ACIS 9th International Conference on, IEEE, pp 743–748
16.
Zurück zum Zitat Keaveney S, Conboy K (2006) Cost estimation in agile development projects. In: ECIS, pp 183–197 Keaveney S, Conboy K (2006) Cost estimation in agile development projects. In: ECIS, pp 183–197
18.
Zurück zum Zitat Lenarduzzi V, Lunesu I, Matta M, Taibi D (2015) Functional size measures and effort estimation in agile development: a replicated study. In: Agile processes, in software engineering, and extreme programming. Springer, Berlin, pp 105–116 Lenarduzzi V, Lunesu I, Matta M, Taibi D (2015) Functional size measures and effort estimation in agile development: a replicated study. In: Agile processes, in software engineering, and extreme programming. Springer, Berlin, pp 105–116
19.
Zurück zum Zitat Mahnic V (2011) A case study on agile estimating and planning using scrum. Elektron ir Elektrotech 111(5):123–128CrossRef Mahnic V (2011) A case study on agile estimating and planning using scrum. Elektron ir Elektrotech 111(5):123–128CrossRef
20.
Zurück zum Zitat Mahnic V, Zabkar N (2012) Measuring progress of scrum-based software projects. Elektron ir Elektrotech 18(8):73–76CrossRef Mahnic V, Zabkar N (2012) Measuring progress of scrum-based software projects. Elektron ir Elektrotech 18(8):73–76CrossRef
21.
Zurück zum Zitat Menzies T, Chen Z, Hihn J, Lum K (2006) Selecting best practices for effort estimation. IEEE Trans Softw Eng 32(11):883–895CrossRef Menzies T, Chen Z, Hihn J, Lum K (2006) Selecting best practices for effort estimation. IEEE Trans Softw Eng 32(11):883–895CrossRef
22.
Zurück zum Zitat Moreira ME (2013) Working with story points, velocity, and burndowns. In: Being Agile, Springer, Berlin, pp 187–194 Moreira ME (2013) Working with story points, velocity, and burndowns. In: Being Agile, Springer, Berlin, pp 187–194
23.
Zurück zum Zitat Morgan JN, Messenger RC (1973) THAID: a sequential analysis program for the analysis of nominal scale dependent variables. Survey Research Center, Institute for Social Research, University of Michigan, Ann Arbor Morgan JN, Messenger RC (1973) THAID: a sequential analysis program for the analysis of nominal scale dependent variables. Survey Research Center, Institute for Social Research, University of Michigan, Ann Arbor
24.
Zurück zum Zitat Morgan JN, Sonquist JA (1963) Problems in the analysis of survey data, and a proposal. J Am Stat Assoc 58(302):415–434CrossRefMATH Morgan JN, Sonquist JA (1963) Problems in the analysis of survey data, and a proposal. J Am Stat Assoc 58(302):415–434CrossRefMATH
25.
Zurück zum Zitat Nassif AB, Capretz LF, Ho D, Azzeh M (2012) A treeboost model for software effort estimation based on use case points. In: Machine learning and applications (ICMLA), 2012 11th international conference on, IEEE, vol 2, pp 314–319 Nassif AB, Capretz LF, Ho D, Azzeh M (2012) A treeboost model for software effort estimation based on use case points. In: Machine learning and applications (ICMLA), 2012 11th international conference on, IEEE, vol 2, pp 314–319
26.
Zurück zum Zitat Nassif AB, Azzeh M, Capretz LF, Ho D (2013a) A comparison between decision trees and decision tree forest models for software development effort estimation. In: Communications and Information Technology (ICCIT), 2013 Third International Conference on, IEEE, pp 220–224 Nassif AB, Azzeh M, Capretz LF, Ho D (2013a) A comparison between decision trees and decision tree forest models for software development effort estimation. In: Communications and Information Technology (ICCIT), 2013 Third International Conference on, IEEE, pp 220–224
27.
Zurück zum Zitat Nassif AB, Ho D, Capretz LF (2013b) Towards an early software estimation using log-linear regression and a multilayer perceptron model. J Syst Softw 86(1):144–160CrossRef Nassif AB, Ho D, Capretz LF (2013b) Towards an early software estimation using log-linear regression and a multilayer perceptron model. J Syst Softw 86(1):144–160CrossRef
28.
Zurück zum Zitat Popli R, Chauhan N (2014) Cost and effort estimation in agile software development. In: Optimization, reliability, and information technology (ICROIT), 2014 international conference on, IEEE, pp 57–61 Popli R, Chauhan N (2014) Cost and effort estimation in agile software development. In: Optimization, reliability, and information technology (ICROIT), 2014 international conference on, IEEE, pp 57–61
29.
Zurück zum Zitat Raslan AT, Darwish NR, Hefny HA (2015) Towards a fuzzy based framework for effort estimation in agile software development. Int J Comput Sci Inf Secur 13(1):37 Raslan AT, Darwish NR, Hefny HA (2015) Towards a fuzzy based framework for effort estimation in agile software development. Int J Comput Sci Inf Secur 13(1):37
30.
Zurück zum Zitat Satapathy SM, Acharya BP, Rath SK (2014a) Class point approach for software effort estimation using stochastic gradient boosting technique. ACM SIGSOFT Softw Eng Notes 39(3):1–6CrossRef Satapathy SM, Acharya BP, Rath SK (2014a) Class point approach for software effort estimation using stochastic gradient boosting technique. ACM SIGSOFT Softw Eng Notes 39(3):1–6CrossRef
31.
Zurück zum Zitat Satapathy SM, Panda A, Rath SK (2014b) Story point approach based agile software effort estimation using various svr kernel methods. In: The twenty-sixth international conference on software engineering and knowledge engineering, SEKE, pp 304–307 Satapathy SM, Panda A, Rath SK (2014b) Story point approach based agile software effort estimation using various svr kernel methods. In: The twenty-sixth international conference on software engineering and knowledge engineering, SEKE, pp 304–307
32.
Zurück zum Zitat Satapathy SM, Acharya BP, Rath SK (2016) Early stage software effort estimation using random forest technique based on use case points. IET Softw 10(1):10–17CrossRef Satapathy SM, Acharya BP, Rath SK (2016) Early stage software effort estimation using random forest technique based on use case points. IET Softw 10(1):10–17CrossRef
33.
Zurück zum Zitat Schmietendorf A, Kunz M, Dumke R (2008) Effort estimation for agile software development projects. In: 5th Software measurement European Forum, pp 113–123 Schmietendorf A, Kunz M, Dumke R (2008) Effort estimation for agile software development projects. In: 5th Software measurement European Forum, pp 113–123
34.
Zurück zum Zitat Schweighofer T (2016) How is effort estimated in agile software development projects? In: Fifth workshop on software quality analysis, monitoring, improvement, and applications SQAMIA 2016, p 73 Schweighofer T (2016) How is effort estimated in agile software development projects? In: Fifth workshop on software quality analysis, monitoring, improvement, and applications SQAMIA 2016, p 73
35.
Zurück zum Zitat Shepperd M, MacDonell S (2012) Evaluating prediction systems in software project estimation. Inf Softw Technol 54(8):820–827CrossRef Shepperd M, MacDonell S (2012) Evaluating prediction systems in software project estimation. Inf Softw Technol 54(8):820–827CrossRef
36.
Zurück zum Zitat Sobiech F, Eilermann B, Rausch A (2016) Using synergies between user stories in scrum. Lect Notes Softw Eng 4(2):91CrossRef Sobiech F, Eilermann B, Rausch A (2016) Using synergies between user stories in scrum. Lect Notes Softw Eng 4(2):91CrossRef
37.
Zurück zum Zitat Tanveer B (2016) Hybrid effort estimation of changes in agile software development. In: International conference on agile software development. Springer, Berlin, pp 316–320 Tanveer B (2016) Hybrid effort estimation of changes in agile software development. In: International conference on agile software development. Springer, Berlin, pp 316–320
38.
Zurück zum Zitat Trendowicz A, Jeffery R (2014) Software project effort estimation. In: Foundations and best practice guidelines for success, constructive cost model–COCOMO, pp 277–293 Trendowicz A, Jeffery R (2014) Software project effort estimation. In: Foundations and best practice guidelines for success, constructive cost model–COCOMO, pp 277–293
39.
Zurück zum Zitat Ungan E, Cizmeli N, Demirors O (2014) Comparison of functional size based estimation and story points, based on effort estimation effectiveness in scrum projects. In: Software engineering and advanced applications (SEAA), 2014 40th EUROMICRO conference on, IEEE, pp 77–80 Ungan E, Cizmeli N, Demirors O (2014) Comparison of functional size based estimation and story points, based on effort estimation effectiveness in scrum projects. In: Software engineering and advanced applications (SEAA), 2014 40th EUROMICRO conference on, IEEE, pp 77–80
40.
Zurück zum Zitat Usman M, Mendes E, Weidt F, Britto R (2014) Effort estimation in agile software development: A systematic literature review. In: Proceedings of the 10th international conference on predictive models in software engineering, ACM, pp 82–91 Usman M, Mendes E, Weidt F, Britto R (2014) Effort estimation in agile software development: A systematic literature review. In: Proceedings of the 10th international conference on predictive models in software engineering, ACM, pp 82–91
41.
Zurück zum Zitat Usman M, Mendes E, Börstler J (2015) Effort estimation in agile software development: a survey on the state of the practice. In: Proceedings of the 19th international conference on evaluation and assessment in software engineering, ACM, p 12 Usman M, Mendes E, Börstler J (2015) Effort estimation in agile software development: a survey on the state of the practice. In: Proceedings of the 19th international conference on evaluation and assessment in software engineering, ACM, p 12
43.
Zurück zum Zitat Zia ZK, Tipu SK, Zia SK (2012) An effort estimation model for agile software development. Adv Comput Sci Appl 2(1):314–324 Zia ZK, Tipu SK, Zia SK (2012) An effort estimation model for agile software development. Adv Comput Sci Appl 2(1):314–324
Metadaten
Titel
Empirical assessment of machine learning models for agile software development effort estimation using story points
verfasst von
Shashank Mouli Satapathy
Santanu Kumar Rath
Publikationsdatum
13.06.2017
Verlag
Springer London
Erschienen in
Innovations in Systems and Software Engineering / Ausgabe 2-3/2017
Print ISSN: 1614-5046
Elektronische ISSN: 1614-5054
DOI
https://doi.org/10.1007/s11334-017-0288-z

Weitere Artikel der Ausgabe 2-3/2017

Innovations in Systems and Software Engineering 2-3/2017 Zur Ausgabe

Premium Partner