Nachiappan Nagappan
Brendan Murphy
ABSTRACT
Often software systems are developed by organizations consisting of many teams of individuals working together. Brooks states in the Mythical Man Month book that product quality is strongly affected by organization structure. Unfortunately there has been little empirical evidence to date to substantiate this assertion. In this paper we present a metric scheme to quantify organizational complexity, in relation to the product development process to identify if the metrics impact failure-proneness. In our case study, the organizational metrics when applied to data from Windows Vista were statistically significant predictors of failure-proneness. The precision and recall measures for identifying failure-prone binaries, using the organizational metrics, was significantly higher than using traditional metrics like churn, complexity, coverage, dependencies, and pre-release bug measures that have been used to date to predict failure-proneness. Our results provide empirical evidence that the organizational metrics are related to, and are effective predictors of failure-proneness.
- V. Basili, Briand, L., Melo, W., "A Validation of Object Oriented Design Metrics as Quality Indicators", IEEE Transactions on Software Engineering, 22(10), pp. 751 -- 761, 1996. Google Scholar
Digital Library
- V. Basili, G. Caldiera, and D. H. Rombach, "The Goal Question Metric Paradigm," in Encyclopedia of Software Engineering, Vol. 2: John Wiley and Sons, Inc., pp. 528--532, 1994.Google Scholar
- V. Basili, Shull, F., Lanubile, F., "Building Knowledge through Families of Experiments", IEEE Transactions on Software Engineering, 25(4), pp.456--473, 1999. Google ScholarDigital Library
- S. Biyani, Santhanam, P., "Exploring defect data from development and customer usage on software modules over multiple releases", Proceedings of International Symposium on Software Reliability Engineering, pp. 316--320, 1998. Google ScholarDigital Library
- L. C. Briand, Wuest, J., Ikonomovski, S., Lounis, H., "Investigating quality factors in object-oriented designs: an industrial case study", Proceedings of International Conference on Software Engineering, pp. 345--354, 1999. Google ScholarDigital Library
- F. P. Brooks, The Mythical Man-Month, Anniversary Edition: Addison-Wesley Publishing Company, 1995. Google ScholarDigital Library
- S. R. Chidamber, Kemerer, C.F., "A Metrics Suite for Object Oriented Design", IEEE Transactions on Software Engineering, 20(6), pp. 476--493, 1994. Google ScholarDigital Library
- M. E. Conway, "How Do Committees Invent?" Datamation, 14(4), pp. 28--31, 1968.Google Scholar
- T. DeMarco and T. Lister, Peopleware. New York: Dorset House Publishers, 1977.Google Scholar
- G. Denaro, Pezze., M, "An empirical evaluation of fault-proneness models", Proceedings of International Conference on Software Engineering, pp. 241--251, 2002. Google ScholarDigital Library
- P. Frankl, Weiss, S., "An Experimental Comparison of the Effectiveness of Branch Testing and Data Flow Testing", IEEE Transactions in Software Engineering, 19(8), pp. 774 -- 787, 1993. Google ScholarDigital Library
- T. L. Graves, Karr, A.F., Marron, J.S., Siy, H., "Predicting Fault Incidence Using Software Change History", IEEE Transactions in Software Engineering, 26(7), pp. 653 -- 661, 2000. Google ScholarDigital Library
- J. D. Herbsleb, Grinter, R. E., "Splitting the Organization and Integrating the Code: Conway's Law Revisited", Proceedings of International Conference on Software Engineering, pp. 85--95, 1999. Google ScholarDigital Library
- J. D. Herbsleb, Grinter, R. E., "Architectures, coordination, and distance: Conway's Law and beyond", IEEE Software, 16(5), pp. 63--70, 1999. Google ScholarDigital Library
- J. D. Herbsleb, Mockus, A., "Formulation and preliminary test of an empirical theory of coordination in software engineering", Proceedings of European Software Engineering Conference/Foundations in Software Engineering, pp. 138--147, 2003. Google ScholarDigital Library
- M. Hutchins, Foster, H., Goradia, T., Ostrand, T., "Experiments of the effectiveness of dataflow- and control flow-based test adequacy criteria", Proceedings of International Conference on Software Engineering, pp. 191--200, 1994. Google ScholarDigital Library
- E. J. Jackson, A User's Guide to Principal Components: John Wiley & Sons, Inc., 1991.Google Scholar
- T. M. Khoshgoftaar, Allen, E.B., Goel, N., Nandi, A., McMullan, J., "Detection of Software Modules with high Debug Code Churn in a very large Legacy System", Proceedings of International Symposium on Software Reliability Engineering, pp. 364--371, 1996. Google ScholarDigital Library
- T. M. Khoshgoftaar, Szabo, R.M., "Improving Code Churn Predictions During the System Test and Maintenance Phases", Proceedings of IEEE International Conference on Software Maintenance, pp. 58--67, 1994. Google ScholarDigital Library
- D. G. Kleinbaum, Kupper, L.L., Muller, K.E., Applied Regression Analysis and Other Multivariable Methods. Boston: PWS-KENT Publishing Company, 1987. Google ScholarDigital Library
- T. J. McCabe, "A Complexity Measure", IEEE Transactions on Software Engineering, 2(4), pp. 308--320, 1976. Google ScholarDigital Library
- A. Mockus, Fielding, R.T., Herbsleb, J., "Two case studies of open source software development: Apache and Mozilla", ACM Transactions on Software Engineering and Methodology, 11(3), pp. 309 -- 346, 2002. Google ScholarDigital Library
- A. Mockus, Zhang, P., Li, P., "Drivers for customer perceived software quality", Proceedings of International Conference on Software Engineering, pp. 225--233, 2005. Google ScholarDigital Library
- N. Nagappan, Ball, T., "Using Software Dependencies and Churn Metrics to Predict Field Failures: An Empirical Case Study", Proceedings of International Symposium on Empirical Software Engineering, pp. 364--373, 2007. Google ScholarDigital Library
- N. Nagappan, Ball, T., "Use of Relative Code Churn Measures to Predict System Defect Density", Proceedings of International Conference on Software Engineering, pp. 284--292, 2005. Google ScholarDigital Library
- N. Nagappan, Ball, T., Murphy, B., "Using Historical In-Process and Product Metrics for Early Estimation of Software Failures", Proceedings of International Symposium on Software Reliability Engineering, pp. 62--74, 2006. Google ScholarDigital Library
- N. Nagappan, Ball, T., Zeller, A., "Mining metrics to predict component failures", Proceedings of International Conference on Software Engineering, pp. 452--461, 2006. Google ScholarDigital Library
- N. Nagappan, Murphy, B., Basili, V., "The Influence of Organizational Structure On Software Quality: An Empirical Case Study," Microsoft Research Technical Report (http://research.microsoft.com), MSR-TR-2008-11, 2008.Google Scholar
- L. J. Osterweil, "Software Processes Are Software Too", Proceedings of International Conference on Software Engineering, pp. 2--13, 1987. Google ScholarDigital Library
- T. Ostrand, Weyuker, E., Bell, R.M., "Predicting the location and number of faults in large software systems", IEEE Transactions in Software Engineering, 31(4), pp. 340 -- 355, 2005. Google ScholarDigital Library
- T. J. Ostrand, Weyuker, E.J, Bell, R.M., "Where the Bugs Are", Proceedings of the 2004 ACM SIGSOFT International Symposium on Software Testing and Analysis, pp. 86--96, 2004. Google ScholarDigital Library
- D. Parnas, "On the Criteria to be Used in Decomposing Systems into Modules", Communications of the ACM, 15(2), pp. 1053--1058, 1972. Google ScholarDigital Library
- D. E. Perry, Staudenmayer, N. A., Votta, L., "People, Organizations, and Process Improvement", IEEE Software, 11(4), pp. 36--65, 1994. Google ScholarDigital Library
- A. Pogdurski, Clarke, L.A., "A Formal Model of Program Dependences and its Implications for Software Testing, Debugging, and Maintenance", IEEE Transactions in Software Engineering, 16(9), pp. 965--979, 1990. Google ScholarDigital Library
- A. Schröter, T. Zimmermann, and A. Zeller, "Predicting Component Failures at Design Time," Proceedings of International Symposium on Empirical Software Engineering, pp. 18--27, 2006. Google ScholarDigital Library
- H. Zhang, Zhang, X., "Comments on "Data Mining Static Code Attributes to Learn Defect Predictors"", IEEE Transactions in Software Engineering, 33(9), pp. 635--636, 2007. Google ScholarDigital Library
- T. Zimmermann, Weißgerber, P., Diehl, S., Zeller, A., "Mining Version Histories to Guide Software Changes", IEEE Transactions in Software Engineering, 31(6), pp. 429--445, 2005. Google ScholarDigital Library
Index Terms
- The influence of organizational structure on software quality: an empirical case study
Recommendations
Theoretical Analysis on Relation between Innovation and Organizational Structure
ICEE '12: Proceedings of the 2012 3rd International Conference on E-Business and E-Government - Volume 05Organizational structure is an important factor affecting innovation. Current studies on relation between innovation and organizational structure can been summarized as two kinds of theories: the theory on organization mode of innovation that focuses on ...
The Organizational Design of High-Tech Entrepreneurial Ventures
The majority of the theoretical and empirical work in the field of organizational design has focused on large established companies, disregarding entrepreneurial ventures, although the organization of these firms is of paramount importance to their ...
Organizational Structure and Firm Innovation in a Retail Chain
Two organizational structures for a retail chain are examined for their effect on the rate of firm innovation. A centralized organization is defined as one in which store practices are mandated from corporate headquarters (HQ) and this results in HQ being ...
Comments