ABSTRACT
Software testing represents an important activity to achieve quality during mobile application development. The constant evolution of mobile applications in previous years relating to size and complexity entails the need to improve testing techniques and tools. In this context, developers/testers often resort to specialized communities or Question & Answer repositories to clarity doubts regarding testing in a practical and efficient way. Thus, these repositories become a popular source of data to understand the current context of software testing practices. In this paper, we present a study using the Stack Overflow repository for analyzing and clustering the main topics on Android testing. We employed the LDA algorithm to summarize the mobile testing related questions. Our findings show that topics such as testing tools, functional testing, and unit testing are often discussed when compared to other topics. We also analyzed the evolution of the interest of Android testing tools. Results show that developers are more interested in Appium, Espresso, Monkey, and Robotium tools.
- M. Nagappan and E. Shihab. 2016. Future Trends in Software Engineering Research for Mobile Apps. IEEE 23rd International Conference on Software Analysis, Evolution, and Reengineering (SANER), 21--32.Google Scholar
- A. I. Wasserman and Fosser. 2010. Software Engineering Issues for Mobile Application Development. In FoSER '10 Proceedings of the FSE/SDP workshop on Future of software engineering research, 397--400. Google ScholarDigital Library
- D. Amalfitano, A. R. Fasolino, P. Tramontana, and B. Robbins. 2013. Testing Android Mobile Applications: Challenges, Strategies, and Approaches. Elsevier Inc., Vol. 89.Google Scholar
- C. Kaner, 2002. Lesson Learned in Software Testing. New York: John Wiley & Sons, Inc. Google ScholarDigital Library
- B. Jiang, X. Long, and X. Gao. 2007. MobileTest: A tool supporting automatic black box test for software on smart mobile devices. In Proceedings of the AST International Workshop on Automation of Software Test, 1--6. Google ScholarDigital Library
- S. She, S. Sivapalan, and I. Warren. 2009. Hermes: A Tool for Testing Mobile Device Applications. In Proceedings of the Australian Software Engineering Conference, 121--130. Google ScholarDigital Library
- M. Akour, B. Falah, and A. A. Al-zyoud, S. Bouriat, K. Alemerien. 2016. Mobile Software Testing: Thoughts, Strategies, Challenges, and Experimental Study. In International Journal of Advanced Computer Science and Applications (IJACSA), Vol. 7, No. 6.Google Scholar
- H. Muccini, A. di Francesco, and P. Esposito. 2012. Software testing of mobile applications: Challenges and future research directions. In 7th Int. Work. Autom. Softw. Test (AST 2012), 29--35. Google ScholarDigital Library
- I. K. Villanes Rojas, S. Meireles, and A. C. Dias-neto. 2016. Cloud-Based Mobile App Testing Framework: Architecture, Implementation and Execution. In SAST Proceedings of the 1st Brazilian Symposium on Systematic and Automated Software Testing, Article 10. Google ScholarDigital Library
- C. Stanley and M. Byrne. 2011. Predicting Tags for StackOverflow Posts. In The 12th International Conference on Cognitive Modelling (ICCM 2013) 414--419.Google Scholar
- S. Beyer and M. Pinzger. 2015. Synonym Suggestion for Tags on Stack Overflow. In IEEE Int. Conf. Progr. Compr., 94--103. Google ScholarDigital Library
- A. Barua, S. W. Thomas, A. E. Hassan. 2014. What are developers talking about? An analysis of topics and trends in Stack Overflow. In Empirical Software Engineering, Vol. 19. 619--654. Google ScholarDigital Library
- K. Bajaj, K. Pattabiraman, and A. Mesbah. 2014. Mining questions asked by web developers. In Proceedings of the 11th Working Conference on Mining Software Repositories - MSR 2014, 112--121. Google ScholarDigital Library
- F. Calefato, F. Lanubile, M. C. Marasciulo, and N. Novielli. 2015. Mining successful answers in stack overflow. In IEEE International Working Conference on Mining Software Repositories, (Augus 2015), 430--433. Google ScholarDigital Library
- S. Beyer and M. Pinzger. 2016. Grouping Android Tag Synonyms on Stack Overflow. In Proceedings of the 13th International Conference on Mining Software Repositories, 430--440. Google ScholarDigital Library
- J. A. Hartigan and M. A. Wong. 1979. Algorithm AS 136: A k-means clustering algorithm. In Journal of the Royal Statistical Society. Series C (Applied Statistics) 28.1, 100--108.Google ScholarCross Ref
- David M. Blei, Andrew Y. Ng, Michael I. Jordan. 2003. Latent Dirichlet Allocation. In Journal of Machine Learning Research, Vol. 3, 993--1022. Google ScholarDigital Library
- C. Rosen and E. Shihab. 2016. What are mobile developers asking about? A large scale study using stack overflow. In Empirical Software Engineering, Vol. 21, No. 3. Google ScholarDigital Library
- P. S. Kochhar. 2016. Mining Testing Questions on Stack Overflow. In Proceedings of the 5th International Workshop on Software Mining, 32--38. Google ScholarDigital Library
- S. W. Thomas. 2011. Mining software repositories using topic models. In Proceedings of the 33rd International Conference on Software Engineering, 1138--1139. Google ScholarDigital Library
- P. J. Rousseeuw. 1987. Silhouettes: a Graphical Aid to the Interpretation and Validation of Cluster Analysis. In Computational and Applied Mathematics 20, 53--65. Google ScholarDigital Library
- R. C. De Amorim and C. Hennig. 2015. Recovering the number of clusters in data sets with noise features using feature rescaling factors. In Inf. Sci. (Ny)., Vol. 324, 126--145. Google ScholarDigital Library
- B. Kirubakaran and V. Karthikeyani. 2013. Mobile application testing - Challenges and solution approach through automation. In 2013 International Conference on Pattern Recognition, Informatics and Mobile Engineering, 79--84.Google Scholar
- D. Franke and C. Weise. 2011. Providing a Software Quality Framework for Testing of Mobile Applications. In IEEE Fourth International Conference on Software Testing, Verification and Validation (ICST), 431--434. Google ScholarDigital Library
- J. Gao, X. Bai, W.-T. Tsai, and T. Uehara. 2014. Mobile Application Testing: A Tutorial. In Computer (Long. Beach. Calif)., Vol. 47, No. 2, 46--55. Google ScholarDigital Library
- P. Singh Kochhar, F. Thung, N. Nagappan, T. Zimmermann, and D. Lo. 2015. Understanding the Test Automation Culture of App Developers. In IEEE International Conference on Software Testing, Verification and Validation, (April 2015), 13--17.Google Scholar
- M. E. Joorabchi, A. Mesbah, and P. Kruchten. 2013. Real Challenges in Mobile App Development. In IEEE International Symposium on Empirical Software Engineering and Measurement, 15--24.Google Scholar
Index Terms
- What are Software Engineers asking about Android Testing on Stack Overflow?
Recommendations
Mining testing questions on stack overflow
SoftwareMining 2016: Proceedings of the 5th International Workshop on Software MiningDuring software maintenance, testing is a crucial activity to ensure the quality of code as it evolves over time. With the increasing size and complexity of software, adequate software testing has become increasingly important. Developers often ask ...
Configurations in Android testing: they matter
A-Mobile 2018: Proceedings of the 1st International Workshop on Advances in Mobile App AnalysisAndroid has rocketed to the top of the mobile market thanks in large part to its open source model. Vendors use Android for their devices for free, and companies make customizations to suit their needs. This has resulted in a myriad of configurations ...
Sentiment overflow in the testing stack: Analyzing software testing posts on Stack Overflow
AbstractSoftware testing is an integral part of modern software engineering practice. Past research has not only underlined its significance, but also revealed its multi-faceted nature. The practice of software testing and its adoption is ...
Highlights- We combine NLP tools and STGT to investigate the sentiment in 200 testing posts.
Comments