skip to main content
10.1145/3167132.3167299acmconferencesArticle/Chapter ViewAbstractPublication PagessacConference Proceedingsconference-collections
research-article

A collaborative filtering recommender system for test case prioritization in web applications

Published:09 April 2018Publication History

ABSTRACT

The use of relevant metrics of software systems could improve various software engineering tasks, but identifying relationships among metrics is not simple and can be very time consuming. Recommender systems can help with this decision-making process; many applications have utilized these systems to improve the performance of their applications. To investigate the potential benefits of recommender systems in regression testing, we implemented an item-based collaborative filtering recommender system that uses user interaction data and application change history information to develop a test case prioritization technique. To evaluate our approach, we performed an empirical study using three web applications with multiple versions and compared four control techniques. Our results indicate that our recommender system can help improve the effectiveness of test prioritization.

References

  1. hhttp://www.nopcommerce.com/. {Accessed: Jan. 26, 2017}.Google ScholarGoogle Scholar
  2. http://www.coevery.com/. {Accessed: Jan. 26, 2017}.Google ScholarGoogle Scholar
  3. J. Anderson, H. Do, and S. Salem. Customized regression testing using telemetry usage patterns. In Software Maintenance and Evolution (ICSME), 2016 IEEE International Conference on. IEEE, 2016.Google ScholarGoogle ScholarCross RefCross Ref
  4. J. Anvik, L. Hiew, and G. C. Murphy. Who should fix this bug?. In Proceedings of the 28th international conference on Software engineering, pages 361--370. IEEE-ACM, 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Shawn A. Bohner. Extending software change impact analysis into cots components. In Proceedings of the 27th Annual NASA Goddard Software Engineering Workshop, page 175. IEEE-ACM, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. P. A. Brooks and A. M. Memon. Automated gui testing guided by usage profiles. In. In Proceedings of the twenty-second IEEE/ACM international conference on Automated software engineering, pages 333--342. IEEE-ACM, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. C. Catal and D. Mishra. Test case prioritization: A systematic mapping study. Software Quality Journal, 21:445--478, 2013. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. A. Danylenko and W. Lowe. Context-aware recommender systems for nonfunctional requirements. In Proceedings of the Third International Workshop on Recommendation Systems for Software Engineering, pages 80--84. IEEE-ACM, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. S. Elbaum, A. G. Malishevsky, and G. Rothermel. Test case prioritization: A family of empirical studies. IEEE Transactions on Software Engineering, 28(2):159--182, February 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. P. Frankl and E. Weyuker. Testing software to detect and reduce risk. In Journal of Systems and Software, 2000. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. G. and A. Tuzhilin. Toward the next generation of recommender systems a survey of the state of the art and possible extensions. IEEE Transactions on knowledge and Data Engineering, 17(6):734--749, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. M. Gethers, B. Dit, H. Kagdi, and D. Poshyvanyk. Integrated impact analysis for managing software changes. In Proceedings of the 34th International Conference on Software Engineering, pages 430--440. IEEE-ACM, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. E. Giger, M. D'Amborce, M. Pinzger, and H. Gall. Method-level bug prediction. In ESEM, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. C. Hettiarachchi, H. Do, and B. Choi. Effective regression testing using requirements and risks. In Eighth International Conference on Software Security and Reliability, pages 157--166. IEEE, 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Y. Jiang, B. Cuki, T Menzies, and N Bartlow. Comparing design and code metrics for software quality prediction. In Proceedings of the 4th international workshop on Predictor models in software engineering, pages 11--18. ACM, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. J. Kim and A. Porter. A history-based test prioritization technique for regression testing in resource constrained environments. In Proceedings of the International Conference on Software Engineering, May 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. T. Lee, J. Nam, D. Han, S. Kim, and H. Peter. Micro interaction metrics for defect prediction. In ESEC/FSE '11 Proceedings of the 19th ACM SIGSOFT symposium and the 13th European conference on Foundations of software engineering, pages 311--321. IEEE-ACM, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. R. Moser, W. Pedrycz, and G. Succi. A comparative analysis of the efficiency of change metrics and static code attributes for defect prediction. In ICSE '08 Proceedings of the 30th international conference on Software engineering, pages 181--190. IEEE-ACM, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. N. Murakami, H. Masuhara, and T. Aotani. Code recommendation based on a degree-of-interest model. In Proceedings of the 4th International Workshop on Recommendation Systems for Software Engineering, pages 28--29. IEEE-ACM, 2014. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. N. Nagappan and T. Ball. Use of relative code churn measures to predict system defect density. In ICSE '05 Proceedings of the 27th international conference on Software engineering, pages 284--292. IEEE-ACM, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. X. Qu, M.B. Cohen, and G. Rothermel. Configuration-aware regression testing: an empirical study of sampling and prioritization. In International Symposium on Software Testing and Analysis (ISSTA), pages 75--85. IEEE-ACM, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. M. P. Robillard, W. Maalej, R. J. Walker, and T. Zimmermann. Recommendation Systems in Software Engineering. Springer, 2014. Google ScholarGoogle ScholarCross RefCross Ref
  23. G. Rothermel, R. Untch, C. Chu,, and M. J. Harrold. Test case prioritization: An empirical study. In Proceedings of the IEEE International Conference on Software Maintenance, pages 179--188. IEEE-ACM, 1999. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. G. Rothermel, R. Untch, C. Chu, and M. J. Harrold. Prioritizing test cases for regression testing. IEEE Transactions on Software Engineering, 27(10):929--948, October 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. S Sampath, R. C. Bryce, G. Viswanath, V. Kandimalla, and A. G. Koru. Prioritizing user-session-based test cases for web applications testing. In ICST '08 Proceedings of the 2008 International Conference on Software Testing, Verification, and Validation, pages 141--150. IEEE-ACM, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. B. Sarwar, G. Karypis, J. Konstan, and J. Riedl. Item-based collaborative filtering recommendation algorithms. In Proceedings of the 10th international conference on World Wide Web, pages 285--295. IEEE-ACM, 2001. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. E. Shihab, A. E. Hassan, B. Adams, and Z. M. Jiang. An industrial study on the risk of software changes. In FSE '12 Proceedings of the ACM SIGSOFT 20th International Symposium on the Foundations of Software Engineering, page 62. ACM, 2012. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. S. Yoo and M. Harman. Regression testing minimization, selection and prioritization: a survey. Software Testing, Verification and Reliability, 22(2):67--120, 2012. Google ScholarGoogle ScholarCross RefCross Ref
  1. A collaborative filtering recommender system for test case prioritization in web applications

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in
    • Published in

      cover image ACM Conferences
      SAC '18: Proceedings of the 33rd Annual ACM Symposium on Applied Computing
      April 2018
      2327 pages
      ISBN:9781450351911
      DOI:10.1145/3167132

      Copyright © 2018 ACM

      Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 9 April 2018

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article

      Acceptance Rates

      Overall Acceptance Rate1,650of6,669submissions,25%

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader