ABSTRACT
The use of relevant metrics of software systems could improve various software engineering tasks, but identifying relationships among metrics is not simple and can be very time consuming. Recommender systems can help with this decision-making process; many applications have utilized these systems to improve the performance of their applications. To investigate the potential benefits of recommender systems in regression testing, we implemented an item-based collaborative filtering recommender system that uses user interaction data and application change history information to develop a test case prioritization technique. To evaluate our approach, we performed an empirical study using three web applications with multiple versions and compared four control techniques. Our results indicate that our recommender system can help improve the effectiveness of test prioritization.
- hhttp://www.nopcommerce.com/. {Accessed: Jan. 26, 2017}.Google Scholar
- http://www.coevery.com/. {Accessed: Jan. 26, 2017}.Google Scholar
- J. Anderson, H. Do, and S. Salem. Customized regression testing using telemetry usage patterns. In Software Maintenance and Evolution (ICSME), 2016 IEEE International Conference on. IEEE, 2016.Google ScholarCross Ref
- J. Anvik, L. Hiew, and G. C. Murphy. Who should fix this bug?. In Proceedings of the 28th international conference on Software engineering, pages 361--370. IEEE-ACM, 2006. Google ScholarDigital Library
- Shawn A. Bohner. Extending software change impact analysis into cots components. In Proceedings of the 27th Annual NASA Goddard Software Engineering Workshop, page 175. IEEE-ACM, 2002. Google ScholarDigital Library
- P. A. Brooks and A. M. Memon. Automated gui testing guided by usage profiles. In. In Proceedings of the twenty-second IEEE/ACM international conference on Automated software engineering, pages 333--342. IEEE-ACM, 2007. Google ScholarDigital Library
- C. Catal and D. Mishra. Test case prioritization: A systematic mapping study. Software Quality Journal, 21:445--478, 2013. Google ScholarDigital Library
- A. Danylenko and W. Lowe. Context-aware recommender systems for nonfunctional requirements. In Proceedings of the Third International Workshop on Recommendation Systems for Software Engineering, pages 80--84. IEEE-ACM, 2012. Google ScholarDigital Library
- S. Elbaum, A. G. Malishevsky, and G. Rothermel. Test case prioritization: A family of empirical studies. IEEE Transactions on Software Engineering, 28(2):159--182, February 2002. Google ScholarDigital Library
- P. Frankl and E. Weyuker. Testing software to detect and reduce risk. In Journal of Systems and Software, 2000. Google ScholarDigital Library
- G. and A. Tuzhilin. Toward the next generation of recommender systems a survey of the state of the art and possible extensions. IEEE Transactions on knowledge and Data Engineering, 17(6):734--749, 2005. Google ScholarDigital Library
- M. Gethers, B. Dit, H. Kagdi, and D. Poshyvanyk. Integrated impact analysis for managing software changes. In Proceedings of the 34th International Conference on Software Engineering, pages 430--440. IEEE-ACM, 2012. Google ScholarDigital Library
- E. Giger, M. D'Amborce, M. Pinzger, and H. Gall. Method-level bug prediction. In ESEM, 2012. Google ScholarDigital Library
- C. Hettiarachchi, H. Do, and B. Choi. Effective regression testing using requirements and risks. In Eighth International Conference on Software Security and Reliability, pages 157--166. IEEE, 2014. Google ScholarDigital Library
- Y. Jiang, B. Cuki, T Menzies, and N Bartlow. Comparing design and code metrics for software quality prediction. In Proceedings of the 4th international workshop on Predictor models in software engineering, pages 11--18. ACM, 2008. Google ScholarDigital Library
- J. Kim and A. Porter. A history-based test prioritization technique for regression testing in resource constrained environments. In Proceedings of the International Conference on Software Engineering, May 2002. Google ScholarDigital Library
- T. Lee, J. Nam, D. Han, S. Kim, and H. Peter. Micro interaction metrics for defect prediction. In ESEC/FSE '11 Proceedings of the 19th ACM SIGSOFT symposium and the 13th European conference on Foundations of software engineering, pages 311--321. IEEE-ACM, 2011. Google ScholarDigital Library
- R. Moser, W. Pedrycz, and G. Succi. A comparative analysis of the efficiency of change metrics and static code attributes for defect prediction. In ICSE '08 Proceedings of the 30th international conference on Software engineering, pages 181--190. IEEE-ACM, 2008. Google ScholarDigital Library
- N. Murakami, H. Masuhara, and T. Aotani. Code recommendation based on a degree-of-interest model. In Proceedings of the 4th International Workshop on Recommendation Systems for Software Engineering, pages 28--29. IEEE-ACM, 2014. Google ScholarDigital Library
- N. Nagappan and T. Ball. Use of relative code churn measures to predict system defect density. In ICSE '05 Proceedings of the 27th international conference on Software engineering, pages 284--292. IEEE-ACM, 2005. Google ScholarDigital Library
- X. Qu, M.B. Cohen, and G. Rothermel. Configuration-aware regression testing: an empirical study of sampling and prioritization. In International Symposium on Software Testing and Analysis (ISSTA), pages 75--85. IEEE-ACM, 2008. Google ScholarDigital Library
- M. P. Robillard, W. Maalej, R. J. Walker, and T. Zimmermann. Recommendation Systems in Software Engineering. Springer, 2014. Google ScholarCross Ref
- G. Rothermel, R. Untch, C. Chu,, and M. J. Harrold. Test case prioritization: An empirical study. In Proceedings of the IEEE International Conference on Software Maintenance, pages 179--188. IEEE-ACM, 1999. Google ScholarDigital Library
- G. Rothermel, R. Untch, C. Chu, and M. J. Harrold. Prioritizing test cases for regression testing. IEEE Transactions on Software Engineering, 27(10):929--948, October 2001. Google ScholarDigital Library
- S Sampath, R. C. Bryce, G. Viswanath, V. Kandimalla, and A. G. Koru. Prioritizing user-session-based test cases for web applications testing. In ICST '08 Proceedings of the 2008 International Conference on Software Testing, Verification, and Validation, pages 141--150. IEEE-ACM, 2008. Google ScholarDigital Library
- B. Sarwar, G. Karypis, J. Konstan, and J. Riedl. Item-based collaborative filtering recommendation algorithms. In Proceedings of the 10th international conference on World Wide Web, pages 285--295. IEEE-ACM, 2001. Google ScholarDigital Library
- E. Shihab, A. E. Hassan, B. Adams, and Z. M. Jiang. An industrial study on the risk of software changes. In FSE '12 Proceedings of the ACM SIGSOFT 20th International Symposium on the Foundations of Software Engineering, page 62. ACM, 2012. Google ScholarDigital Library
- S. Yoo and M. Harman. Regression testing minimization, selection and prioritization: a survey. Software Testing, Verification and Reliability, 22(2):67--120, 2012. Google ScholarCross Ref
- A collaborative filtering recommender system for test case prioritization in web applications
Recommendations
Combined Source Code Approach for Test Case Prioritization
ICISS '18: Proceedings of the 1st International Conference on Information Science and SystemsRegression testing is an activity in the software testing process to ensure the software is validated and verified after modification occurred on software. It is costly process procedure which has been expected to reach half cost of the software ...
An Improved Metric for Test Case Prioritization
WISA '11: Proceedings of the 2011 Eighth Web Information Systems and Applications ConferenceTest case prioritization is an effective and practical technique of regression testing. To illustrate its effectiveness, many test metrics were proposed. In this paper, the physical meanings of these metrics were explained and their limitations were ...
Collaborative Filtering for Recommender Systems
CBD '14: Proceedings of the 2014 Second International Conference on Advanced Cloud and Big DataCollaborative filtering (CF) predicts user preferences in item selection based on the known user ratings of items. As one of the most common approach to recommender systems, CF has been proved to be effective for solving the information overload ...
Comments