Skip to main content
Erschienen in: Software Quality Journal 3/2013

01.09.2013

Monitoring the software development process using a short-run control chart

verfasst von: Chih-Wei Chang, Lee-Ing Tong

Erschienen in: Software Quality Journal | Ausgabe 3/2013

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Techniques for statistical process control (SPC), such as using a control chart, have recently garnered considerable attention in the software industry. These techniques are applied to manage a project quantitatively and meet established quality and process-performance objectives. Although many studies have demonstrated the benefits of using a control chart to monitor software development processes (SDPs), some controversy exists regarding the suitability of employing conventional control charts to monitor SDPs. One major problem is that conventional control charts require a large amount of data from a homogeneous source of variation when constructing valid control limits. However, a large dataset is typically unavailable for SDPs. Aggregating data from projects with similar attributes to acquire the required number of observations may lead to wide control limits due to mixed multiple common causes when applying a conventional control chart. To overcome these problems, this study utilizes a Q chart for short-run manufacturing processes as an alternative technique for monitoring SDPs. The Q chart, which has early detection capability, real-time charting, and fixed control limits, allows software practitioners to monitor process performance using a small amount of data in early SDP stages. To assess the performance of the Q chart for monitoring SDPs, three examples are utilized to demonstrate Q chart effectiveness. Some recommendations for practical use of Q charts for SDPs are provided.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Literatur
Zurück zum Zitat Alemi, F. (2004). Tukey’s control chart. Quality Management in Healthcare, 13(4), 216. Alemi, F. (2004). Tukey’s control chart. Quality Management in Healthcare, 13(4), 216.
Zurück zum Zitat Baldassarre, T., Boffoli, N., Caivano, D., & Visaggio, G. (2004). Managing software process improvement (SPI) through statistical process control (SPC). In Proceedings of the 5th International Conference on Product Focused Software Process Improvement. Kansai Science City, Japan. Baldassarre, T., Boffoli, N., Caivano, D., & Visaggio, G. (2004). Managing software process improvement (SPI) through statistical process control (SPC). In Proceedings of the 5th International Conference on Product Focused Software Process Improvement. Kansai Science City, Japan.
Zurück zum Zitat Baldassarre, T., Caivano, D., Kitchenham, B., & Visaggio, G. (2007). Systematic review of statistical process control: An experience report. In Proceedings of the 11th International Conference on Evaluation and Assessment in Software Engineering (EASE). Keele, UK. Baldassarre, T., Caivano, D., Kitchenham, B., & Visaggio, G. (2007). Systematic review of statistical process control: An experience report. In Proceedings of the 11th International Conference on Evaluation and Assessment in Software Engineering (EASE). Keele, UK.
Zurück zum Zitat Barnard, J., & Price, A. (1994). Managing code inspection information. IEEE Software, 11(2), 59–69.CrossRef Barnard, J., & Price, A. (1994). Managing code inspection information. IEEE Software, 11(2), 59–69.CrossRef
Zurück zum Zitat Bothe, D. R. (1989). A powerful new control chart for job shops. In Proceedings of the 43rd Annual Quality Congress Transaction. Toronto, Ontario, Canada. Bothe, D. R. (1989). A powerful new control chart for job shops. In Proceedings of the 43rd Annual Quality Congress Transaction. Toronto, Ontario, Canada.
Zurück zum Zitat Caivano, D. (2005). Continuous software process improvement through statistical process control. In Proceedings of the Ninth European Conference on Software Maintenance and Reengineering (CSMR’05). Manchester, UK. Caivano, D. (2005). Continuous software process improvement through statistical process control. In Proceedings of the Ninth European Conference on Software Maintenance and Reengineering (CSMR’05). Manchester, UK.
Zurück zum Zitat Castillo, E. D., & Montgomery, D. C. (1994). Short run statistical process control: Q chart enhancements and alternative methods. Quality and Reliability Engineering International, 10(2), 87–97.CrossRef Castillo, E. D., & Montgomery, D. C. (1994). Short run statistical process control: Q chart enhancements and alternative methods. Quality and Reliability Engineering International, 10(2), 87–97.CrossRef
Zurück zum Zitat Castillo, E. D., Grayson, J. M., Montgomery, D. C., & Runger, G. C. (1996). A review of statistical process control techniques for short run manufacturing systems. Communications in Statistics—Theory and Methods, 25(11), 2723–2737.MATHCrossRef Castillo, E. D., Grayson, J. M., Montgomery, D. C., & Runger, G. C. (1996). A review of statistical process control techniques for short run manufacturing systems. Communications in Statistics—Theory and Methods, 25(11), 2723–2737.MATHCrossRef
Zurück zum Zitat Celano, G., Castagliola, P., Trovato, E., & Fichera, S. (2011). Shewhart and EWMA t control charts for short production runs. Quality and Reliability Engineering International, 27(3), 313–326.CrossRef Celano, G., Castagliola, P., Trovato, E., & Fichera, S. (2011). Shewhart and EWMA t control charts for short production runs. Quality and Reliability Engineering International, 27(3), 313–326.CrossRef
Zurück zum Zitat Chang, C.-P., & Chu, C.-P. (2008). Improvement of causal analysis using multivariate statistical process control. Software Quality Journal, 16(3), 377.CrossRef Chang, C.-P., & Chu, C.-P. (2008). Improvement of causal analysis using multivariate statistical process control. Software Quality Journal, 16(3), 377.CrossRef
Zurück zum Zitat Cullen, C. C., & Bothe, D. R. (1989). SPC for short production runs. Dayton, OH: In Proceedings of the National Aerospace and Electronic Conference. Cullen, C. C., & Bothe, D. R. (1989). SPC for short production runs. Dayton, OH: In Proceedings of the National Aerospace and Electronic Conference.
Zurück zum Zitat Diane, M., & Stephen, H. K. (2007). Practical statistical process control for software metrics. Software Quality Professional, 9(4), 15. Diane, M., & Stephen, H. K. (2007). Practical statistical process control for software metrics. Software Quality Professional, 9(4), 15.
Zurück zum Zitat Fagan, M. E. (1999). Design and code inspections to reduce errors in program development. IBM Systems Journal, 38(2.3), 258-287. Fagan, M. E. (1999). Design and code inspections to reduce errors in program development. IBM Systems Journal, 38(2.3), 258-287.
Zurück zum Zitat Florac, W. A., & Carleton, A. D. (1999). Measuring the software process: statistical process control for software process improvement: Addison-Wesley. Florac, W. A., & Carleton, A. D. (1999). Measuring the software process: statistical process control for software process improvement: Addison-Wesley.
Zurück zum Zitat Garjani, M., Noorossana, R., & Saghaei, A. (2010). A neural network-based control scheme for monitoring start-up processes and short runs. International Journal of Advanced Manufacturing Technology, 51(9–12), 1023–1032.CrossRef Garjani, M., Noorossana, R., & Saghaei, A. (2010). A neural network-based control scheme for monitoring start-up processes and short runs. International Journal of Advanced Manufacturing Technology, 51(9–12), 1023–1032.CrossRef
Zurück zum Zitat Jacob, A. L., & Pillai, S. K. (2003). Statistical process control to improve coding and code review. IEEE Software, 20(3), 50.CrossRef Jacob, A. L., & Pillai, S. K. (2003). Statistical process control to improve coding and code review. IEEE Software, 20(3), 50.CrossRef
Zurück zum Zitat Jalote, P., & Saxena, A. (2002). Optimum control limits for employing statistical process control in software process. IEEE Transactions on Software Engineering, 28(12), 1126–1134.CrossRef Jalote, P., & Saxena, A. (2002). Optimum control limits for employing statistical process control in software process. IEEE Transactions on Software Engineering, 28(12), 1126–1134.CrossRef
Zurück zum Zitat Komuro, M. (2006). Experiences of applying SPC techniques to software development processes. In Proceedings of the 28th international conference on Software engineering. Shanghai, China. Komuro, M. (2006). Experiences of applying SPC techniques to software development processes. In Proceedings of the 28th international conference on Software engineering. Shanghai, China.
Zurück zum Zitat Kulpa, M. K., & Johnson, K. A. (2008). Interpreting the CMMI: A process improvement approach. Boca Raton: CRC Press. Kulpa, M. K., & Johnson, K. A. (2008). Interpreting the CMMI: A process improvement approach. Boca Raton: CRC Press.
Zurück zum Zitat Leu, S.-S., & Lin, Y.-C. (2008). Project performance evaluation based on statistical process control techniques. Journal of Construction Engineering & Management, 134(10), 813–819.CrossRef Leu, S.-S., & Lin, Y.-C. (2008). Project performance evaluation based on statistical process control techniques. Journal of Construction Engineering & Management, 134(10), 813–819.CrossRef
Zurück zum Zitat Lipke, W. (2002). Statistical process control of project performance. CrossTalk, The Journal of Defense Software Engineering, 15(3), 15–18. Lipke, W. (2002). Statistical process control of project performance. CrossTalk, The Journal of Defense Software Engineering, 15(3), 15–18.
Zurück zum Zitat Lipke, W., & Vaughn, J. (2000). Statistical process control meets earned value. CrossTalk, The Journal of Defense Software Engineering, 13(6), 16–20. Lipke, W., & Vaughn, J. (2000). Statistical process control meets earned value. CrossTalk, The Journal of Defense Software Engineering, 13(6), 16–20.
Zurück zum Zitat Manlove, D., & Kan, S. H. (2007). Practical statistical process control for software metrics. Software Quality Professional, 9(4), 15. Manlove, D., & Kan, S. H. (2007). Practical statistical process control for software metrics. Software Quality Professional, 9(4), 15.
Zurück zum Zitat Montgomery, D. C. (2009). Introduction to statistical quality control. Hoboken, N.J.: John Wiley. Montgomery, D. C. (2009). Introduction to statistical quality control. Hoboken, N.J.: John Wiley.
Zurück zum Zitat Quesenberry, C. P. (1991a). SPC Q charts for a binomial parameter p: Short or long runs. Journal of Quality Technology, 23(3), 239–246. Quesenberry, C. P. (1991a). SPC Q charts for a binomial parameter p: Short or long runs. Journal of Quality Technology, 23(3), 239–246.
Zurück zum Zitat Quesenberry, C. P. (1991b). SPC Q charts for a Poisson parameter lambda: Short or long runs. Journal of Quality Technology, 23(4), 296–303.MathSciNet Quesenberry, C. P. (1991b). SPC Q charts for a Poisson parameter lambda: Short or long runs. Journal of Quality Technology, 23(4), 296–303.MathSciNet
Zurück zum Zitat Quesenberry, C. P. (1991c). SPC Q charts for start-up processes and short or long runs. Journal of Quality Technology, 23(3), 213–224. Quesenberry, C. P. (1991c). SPC Q charts for start-up processes and short or long runs. Journal of Quality Technology, 23(3), 213–224.
Zurück zum Zitat Quesenberry, C. P. (1993). The effect of sample size on estimated limits for Xbar and X control charts. Journal of Quality Technology, 25(4), 237–247. Quesenberry, C. P. (1993). The effect of sample size on estimated limits for Xbar and X control charts. Journal of Quality Technology, 25(4), 237–247.
Zurück zum Zitat Raczynski, B., & Curtis, B. (2008). Software data violate SPC’s underlying assumptions. IEEE Software, 25(3), 48–50.CrossRef Raczynski, B., & Curtis, B. (2008). Software data violate SPC’s underlying assumptions. IEEE Software, 25(3), 48–50.CrossRef
Zurück zum Zitat Radice, R. (1998). Statistical process control for software projects. In Proceedings of the 10th Software Engineering Process Group Conference. Chicago, Illinois, USA. Radice, R. (1998). Statistical process control for software projects. In Proceedings of the 10th Software Engineering Process Group Conference. Chicago, Illinois, USA.
Zurück zum Zitat Sargut, K. U., & Demirörs, O. (2006). Utilization of statistical process control (SPC) in emergent software organizations: Pitfalls and suggestions. Software Quality Journal, 14(2), 135.CrossRef Sargut, K. U., & Demirörs, O. (2006). Utilization of statistical process control (SPC) in emergent software organizations: Pitfalls and suggestions. Software Quality Journal, 14(2), 135.CrossRef
Zurück zum Zitat Shewhart, W. A. (1926). Quality control charts. Bell System Technical Journal, 5, 593–603. Shewhart, W. A. (1926). Quality control charts. Bell System Technical Journal, 5, 593–603.
Zurück zum Zitat Tarhan, A., & Demirörs, O. (2006). Investigating suitability of software process and metrics for statistical process control. In I. Richardson, P. Runeson, & R. Messnarz (Eds.), Software Process Improvement (Vol. 4257, pp. 88-99, Lecture Notes in Computer Science): Springer Berlin/Heidelberg. Tarhan, A., & Demirörs, O. (2006). Investigating suitability of software process and metrics for statistical process control. In I. Richardson, P. Runeson, & R. Messnarz (Eds.), Software Process Improvement (Vol. 4257, pp. 88-99, Lecture Notes in Computer Science): Springer Berlin/Heidelberg.
Zurück zum Zitat CMMI Product Team (2010). CMMI® for Development, Version 1.3. Software Engineering Institute, Carnegie Mellon University. CMMI Product Team (2010). CMMI® for Development, Version 1.3. Software Engineering Institute, Carnegie Mellon University.
Zurück zum Zitat Torng, C. C., & Lee, P. H. (2008). ARL performance of the Tukey’s control chart. Communications in Statistics-Simulation and Computation, 37(9), 1904–1913.MathSciNetMATHCrossRef Torng, C. C., & Lee, P. H. (2008). ARL performance of the Tukey’s control chart. Communications in Statistics-Simulation and Computation, 37(9), 1904–1913.MathSciNetMATHCrossRef
Zurück zum Zitat Torng, C. C., Liao, H. N., Lee, P. H., & Wu, J. C. (2009). Performance evaluation of a Tukey’s control chart in monitoring gamma distribution and short run processes. Hong Kong: In Proceedings of the International MultiConference of Engineers and Computer Scientists. Torng, C. C., Liao, H. N., Lee, P. H., & Wu, J. C. (2009). Performance evaluation of a Tukey’s control chart in monitoring gamma distribution and short run processes. Hong Kong: In Proceedings of the International MultiConference of Engineers and Computer Scientists.
Zurück zum Zitat Tsai, T. R., Wu, S. J., & Lin, H. C. (2004). An alternative control chart approach based on small number of subgroups. International Journal of Information and Management Sciences, 15(4), 61–73.MathSciNetMATH Tsai, T. R., Wu, S. J., & Lin, H. C. (2004). An alternative control chart approach based on small number of subgroups. International Journal of Information and Management Sciences, 15(4), 61–73.MathSciNetMATH
Zurück zum Zitat Tukey, J. W. (1977). Exploratory data analysis. Reading, Mass: Addison-Wesley Pub. Co.MATH Tukey, J. W. (1977). Exploratory data analysis. Reading, Mass: Addison-Wesley Pub. Co.MATH
Zurück zum Zitat Wang, Q., Jiang, N., Gou, L., Che, M. R., & Zhang, R. H. (2006). Practical experiences of cost/schedule measure through earned value management and statistical process control. In Software Process Change (Vol. 3966, pp. 348–354, Lecture Notes in Computer Science). Wang, Q., Jiang, N., Gou, L., Che, M. R., & Zhang, R. H. (2006). Practical experiences of cost/schedule measure through earned value management and statistical process control. In Software Process Change (Vol. 3966, pp. 348–354, Lecture Notes in Computer Science).
Zurück zum Zitat Weller, E. (2000). Practical applications of statistical process control. IEEE Software, 17(3), 48–55.CrossRef Weller, E. (2000). Practical applications of statistical process control. IEEE Software, 17(3), 48–55.CrossRef
Zurück zum Zitat Weller, E., & Card, D. (2008). Applying SPC to software development where and why. IEEE Software, 25(3), 48–48, 50. Weller, E., & Card, D. (2008). Applying SPC to software development where and why. IEEE Software, 25(3), 48–48, 50.
Zurück zum Zitat Zantek, P. F., & Nestler, S. T. (2009). Performance and properties of Q-statistic monitoring schemes. Naval Research Logistics, 56(3), 279–292.MathSciNetMATHCrossRef Zantek, P. F., & Nestler, S. T. (2009). Performance and properties of Q-statistic monitoring schemes. Naval Research Logistics, 56(3), 279–292.MathSciNetMATHCrossRef
Zurück zum Zitat Zhang, L., Chen, G., & Castagliola, P. (2009). On t and EWMA t charts for monitoring changes in the process mean. Quality and Reliability Engineering International, 25(8), 933–945.CrossRef Zhang, L., Chen, G., & Castagliola, P. (2009). On t and EWMA t charts for monitoring changes in the process mean. Quality and Reliability Engineering International, 25(8), 933–945.CrossRef
Metadaten
Titel
Monitoring the software development process using a short-run control chart
verfasst von
Chih-Wei Chang
Lee-Ing Tong
Publikationsdatum
01.09.2013
Verlag
Springer US
Erschienen in
Software Quality Journal / Ausgabe 3/2013
Print ISSN: 0963-9314
Elektronische ISSN: 1573-1367
DOI
https://doi.org/10.1007/s11219-012-9182-y

Weitere Artikel der Ausgabe 3/2013

Software Quality Journal 3/2013 Zur Ausgabe

EditorialNotes

In this issue

Premium Partner