skip to main content
10.1145/3131151.3131157acmotherconferencesArticle/Chapter ViewAbstractPublication PagessbesConference Proceedingsconference-collections
research-article

What are Software Engineers asking about Android Testing on Stack Overflow?

Authors Info & Claims
Published:20 September 2017Publication History

ABSTRACT

Software testing represents an important activity to achieve quality during mobile application development. The constant evolution of mobile applications in previous years relating to size and complexity entails the need to improve testing techniques and tools. In this context, developers/testers often resort to specialized communities or Question & Answer repositories to clarity doubts regarding testing in a practical and efficient way. Thus, these repositories become a popular source of data to understand the current context of software testing practices. In this paper, we present a study using the Stack Overflow repository for analyzing and clustering the main topics on Android testing. We employed the LDA algorithm to summarize the mobile testing related questions. Our findings show that topics such as testing tools, functional testing, and unit testing are often discussed when compared to other topics. We also analyzed the evolution of the interest of Android testing tools. Results show that developers are more interested in Appium, Espresso, Monkey, and Robotium tools.

References

  1. M. Nagappan and E. Shihab. 2016. Future Trends in Software Engineering Research for Mobile Apps. IEEE 23rd International Conference on Software Analysis, Evolution, and Reengineering (SANER), 21--32.Google ScholarGoogle Scholar
  2. A. I. Wasserman and Fosser. 2010. Software Engineering Issues for Mobile Application Development. In FoSER '10 Proceedings of the FSE/SDP workshop on Future of software engineering research, 397--400. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. D. Amalfitano, A. R. Fasolino, P. Tramontana, and B. Robbins. 2013. Testing Android Mobile Applications: Challenges, Strategies, and Approaches. Elsevier Inc., Vol. 89.Google ScholarGoogle Scholar
  4. C. Kaner, 2002. Lesson Learned in Software Testing. New York: John Wiley & Sons, Inc. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. B. Jiang, X. Long, and X. Gao. 2007. MobileTest: A tool supporting automatic black box test for software on smart mobile devices. In Proceedings of the AST International Workshop on Automation of Software Test, 1--6. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. S. She, S. Sivapalan, and I. Warren. 2009. Hermes: A Tool for Testing Mobile Device Applications. In Proceedings of the Australian Software Engineering Conference, 121--130. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. M. Akour, B. Falah, and A. A. Al-zyoud, S. Bouriat, K. Alemerien. 2016. Mobile Software Testing: Thoughts, Strategies, Challenges, and Experimental Study. In International Journal of Advanced Computer Science and Applications (IJACSA), Vol. 7, No. 6.Google ScholarGoogle Scholar
  8. H. Muccini, A. di Francesco, and P. Esposito. 2012. Software testing of mobile applications: Challenges and future research directions. In 7th Int. Work. Autom. Softw. Test (AST 2012), 29--35. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. I. K. Villanes Rojas, S. Meireles, and A. C. Dias-neto. 2016. Cloud-Based Mobile App Testing Framework: Architecture, Implementation and Execution. In SAST Proceedings of the 1st Brazilian Symposium on Systematic and Automated Software Testing, Article 10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. C. Stanley and M. Byrne. 2011. Predicting Tags for StackOverflow Posts. In The 12th International Conference on Cognitive Modelling (ICCM 2013) 414--419.Google ScholarGoogle Scholar
  11. S. Beyer and M. Pinzger. 2015. Synonym Suggestion for Tags on Stack Overflow. In IEEE Int. Conf. Progr. Compr., 94--103. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. A. Barua, S. W. Thomas, A. E. Hassan. 2014. What are developers talking about? An analysis of topics and trends in Stack Overflow. In Empirical Software Engineering, Vol. 19. 619--654. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. K. Bajaj, K. Pattabiraman, and A. Mesbah. 2014. Mining questions asked by web developers. In Proceedings of the 11th Working Conference on Mining Software Repositories - MSR 2014, 112--121. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. F. Calefato, F. Lanubile, M. C. Marasciulo, and N. Novielli. 2015. Mining successful answers in stack overflow. In IEEE International Working Conference on Mining Software Repositories, (Augus 2015), 430--433. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. S. Beyer and M. Pinzger. 2016. Grouping Android Tag Synonyms on Stack Overflow. In Proceedings of the 13th International Conference on Mining Software Repositories, 430--440. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. J. A. Hartigan and M. A. Wong. 1979. Algorithm AS 136: A k-means clustering algorithm. In Journal of the Royal Statistical Society. Series C (Applied Statistics) 28.1, 100--108.Google ScholarGoogle ScholarCross RefCross Ref
  17. David M. Blei, Andrew Y. Ng, Michael I. Jordan. 2003. Latent Dirichlet Allocation. In Journal of Machine Learning Research, Vol. 3, 993--1022. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. C. Rosen and E. Shihab. 2016. What are mobile developers asking about? A large scale study using stack overflow. In Empirical Software Engineering, Vol. 21, No. 3. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. P. S. Kochhar. 2016. Mining Testing Questions on Stack Overflow. In Proceedings of the 5th International Workshop on Software Mining, 32--38. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. S. W. Thomas. 2011. Mining software repositories using topic models. In Proceedings of the 33rd International Conference on Software Engineering, 1138--1139. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. P. J. Rousseeuw. 1987. Silhouettes: a Graphical Aid to the Interpretation and Validation of Cluster Analysis. In Computational and Applied Mathematics 20, 53--65. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. R. C. De Amorim and C. Hennig. 2015. Recovering the number of clusters in data sets with noise features using feature rescaling factors. In Inf. Sci. (Ny)., Vol. 324, 126--145. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. B. Kirubakaran and V. Karthikeyani. 2013. Mobile application testing - Challenges and solution approach through automation. In 2013 International Conference on Pattern Recognition, Informatics and Mobile Engineering, 79--84.Google ScholarGoogle Scholar
  24. D. Franke and C. Weise. 2011. Providing a Software Quality Framework for Testing of Mobile Applications. In IEEE Fourth International Conference on Software Testing, Verification and Validation (ICST), 431--434. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. J. Gao, X. Bai, W.-T. Tsai, and T. Uehara. 2014. Mobile Application Testing: A Tutorial. In Computer (Long. Beach. Calif)., Vol. 47, No. 2, 46--55. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. P. Singh Kochhar, F. Thung, N. Nagappan, T. Zimmermann, and D. Lo. 2015. Understanding the Test Automation Culture of App Developers. In IEEE International Conference on Software Testing, Verification and Validation, (April 2015), 13--17.Google ScholarGoogle Scholar
  27. M. E. Joorabchi, A. Mesbah, and P. Kruchten. 2013. Real Challenges in Mobile App Development. In IEEE International Symposium on Empirical Software Engineering and Measurement, 15--24.Google ScholarGoogle Scholar

Index Terms

  1. What are Software Engineers asking about Android Testing on Stack Overflow?

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in
      • Published in

        cover image ACM Other conferences
        SBES '17: Proceedings of the XXXI Brazilian Symposium on Software Engineering
        September 2017
        409 pages
        ISBN:9781450353267
        DOI:10.1145/3131151

        Copyright © 2017 ACM

        Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 20 September 2017

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Research
        • Refereed limited

        Acceptance Rates

        SBES '17 Paper Acceptance Rate42of134submissions,31%Overall Acceptance Rate147of427submissions,34%

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader