Alessandro Murgia
ABSTRACT
We studied data mining from CVS repositories of two large OO projects, Eclipse and Netbeans, focusing on "fixing-issue" commits.
We highlight common characteristics of issue reporting, and problems related to the identification of these messages, and compare static traditional approaches, like Knowledge Engineering, to dynamic approaches based on Machine Learning techniques. We compare for the first time performances of Machine Learning (ML) techniques to automatic classify "fixing-issues" among message commits. Our study calculates precision and recall of different Machine Learning Classifiers for the correct classification of issue-reporting commits. Our results show that some ML classifiers can correctly classify up to 99.9% of such commits.
- D. Cubranić and G. C. Murphy, "Hipikat: Recommending pertinent software development artifacts". In Proc. Conference on Software Engineering, pages 408--418, 2003. Google Scholar
Digital Library
- M. Fischer, M. Pinzger, and H. Gall, "Analyzing and relating bug report data for feature tracking". In Proc. Working Conference on Reverse Engineering, 2003. Google ScholarDigital Library
- M. Fischer, M. Pinzger, and H. Gall, "Populating a release history database from version control and bug tracking systems". In Proc. International Conference on Software Maintenance, 2003. Google ScholarDigital Library
- J. Śliwerski, T. Zimmermann, and A. Zeller, "When do changes induce fixes?". In Proc. International Workshop on Mining Software Repositories, 2005. Google ScholarDigital Library
- T. Zimmermann, R. Premraj, and A. Zeller, "Predicting defects for eclipse". In Proc. of the International Workshop on Predictor Models in Software Engineering, 2007. Google ScholarDigital Library
- D. J. Newman, S. Hettich, C. L. Blake, and C. J. Merz, "UCI Repository of Machine Learning Databases", http://www.ics.uci.edu/mlearn/MLRepository.html, 1988.Google Scholar
- D. Lewis, Y. Yang, T. Rose, and F. Li, "RCV1: A New Benchmark Collection for Text Categorization Research", J. Machine Learning Research, vol. 5, pp. 361--397, 2004. Google ScholarDigital Library
- V. Basili, G. Caldiera, and D. H. Rombach., "The Goal Question Metric Paradigm Encyclopedia of Software Engineering", John Wiley and Sons, 1994.Google Scholar
- S. Kim, K. Pan, and E. Whitehead Jr., "Memories of bug fixes". In Proc. of the ACM SIGSOFT international symposium on Foundations of software engineering, 2006. Google ScholarDigital Library
- G. Antoniol, K. Ayari, M. Di Penta, F. Khomh and Y. Guéhéneuc, "Is it a bug or an enhancement? A text-based approach to classify change requests". In Proc. Conference of the Center for Advanced Studies on Collaborative Research, pages 304--318, 2008. Google ScholarDigital Library
- S. Kim, E. J. Whitehead Jr., Yi Zhang, "Classifying Software Changes: Clean or Buggy?". IEEE Trans. Software Eng., VOL. 34, NO. 2, APRIL 2008 Google ScholarDigital Library
- E. Aplaydin. "Introduction to Machine Learning". MIT Press, 2004. Google ScholarDigital Library
- T. Mitchell. "Machine Learning". MIT Press, 1997. Google ScholarDigital Library
- I. Witten and E. Frank. "Data Mining Practical Machine Learning Tools and Techniques". Elsevier, 2005. Google ScholarDigital Library
- N. Landwehr, M. Hall, and E. Frank. Logistic model trees. "Machine Learning", 59(1--2):161--205, 2005. Google ScholarDigital Library
- T. Joachims, "Text Categorization with Support Vector Machines: Learning with Many Relevant Features". In Proc. 10th European Conference Machine Learning, pp. 137--142, 1998. Google ScholarDigital Library
- F. Sebastiani, "Machine Learning in Automated Text Categorization", ACM Computing Surveys, vol. 34, no. 1, pp. 1--47, 2002. Google ScholarDigital Library
- S. E. Robertson C. J. van Rijsbergen and M. F. Porter, "New models in probabilistic information retrieval". London: British Library, Research and Development Report, no. 5587, 1980.Google Scholar
- M. Stone. "Cross-validatory choice and assesment of statistical predictions (with discussion)". Journal of the Royal Statistical Society B, 36:111--147, 1974.Google Scholar
- K. Ayari, P. Meshkinfam, G. Antoniol and M. Di Penta. "Threats on building models from cvs and bugzilla repositories: the mozilla case study". In Proc. Conference of the center for advanced studies on collaborative research, 2007. Google ScholarDigital Library
- C. Bird, A. Bachmann, E. Aune, J. Duffy, A. Bernstein, V. Filkov, and P. Devanbu. "Fair and Balanced? Bias in bug-fix Datasets". In Proc. Meeting of the European software engineering conference and the ACM SIGSOFT symposium on The foundations of software engineering, 2009. Google ScholarDigital Library
- R. K. Yin. "Case Study Research: Design and Methods - Third Edition". SAGE Publications, 2002.Google Scholar
- J. Dougherty, R. Kohavi, and M. Sahami. "Supervised and unsupervised discretization of continuous features". In Proc. of Twelfth International Conference on Machine Learning, 1995.Google ScholarDigital Library
Index Terms
- A machine learning approach for text categorization of fixing-issue commits on CVS
Recommendations
Machine learning in automated text categorization
The automated categorization (or classification) of texts into predefined categories has witnessed a booming interest in the last 10 years, due to the increased availability of documents in digital form and the ensuing need to organize them. In the ...
Machine Learning: The State of the Art
The two fundamental problems in machine learning (ML) are statistical analysis and algorithm design. The former tells us the principles of the mathematical models that we establish from the observation data. The latter defines the conditions on which ...
Machine learning paradigms for utility-based data mining
UBDM '05: Proceedings of the 1st international workshop on Utility-based data miningIn this talk, I will describe a number of machine learning paradigms that are relevant to utility-based data mining, and review some key techniques and results in each.
Comments