Skip to main content

2018 | OriginalPaper | Buchkapitel

Text Semantics and Layout Defects Detection in Android Apps Using Dynamic Execution and Screenshot Analysis

verfasst von : Šarūnas Packevičius, Dominykas Barisas, Andrej Ušaniov, Evaldas Guogis, Eduardas Bareiša

Erschienen in: Information and Software Technologies

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

The paper presents classification of the text defects. It provides a list of user interface text defects and the method based on static/dynamic code analysis for detecting defects in Android applications. This paper proposes a list of static analysis rules for detecting every defect and the tool model implementing those rules. The method and the tool are based on the application of multiple Android application emulators, execution of the application through certain execution paths on multiple hardware and software configurations while taking application screen-shots. The defects are identified by running analysis rules on each taken screen-shot and searching for defect patterns. The results are presented by testing sample Android application.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Packevičius, Š., Ušaniov, A., Stanskis, Š., Bareiša, E.: The testing method based on image analysis for automated detection of UI defects intended for mobile applications. In: Dregvaite, G., Damasevicius, R. (eds.) ICIST 2015. CCIS, vol. 538, pp. 560–576. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24770-0_48CrossRef Packevičius, Š., Ušaniov, A., Stanskis, Š., Bareiša, E.: The testing method based on image analysis for automated detection of UI defects intended for mobile applications. In: Dregvaite, G., Damasevicius, R. (eds.) ICIST 2015. CCIS, vol. 538, pp. 560–576. Springer, Cham (2015). https://​doi.​org/​10.​1007/​978-3-319-24770-0_​48CrossRef
2.
Zurück zum Zitat Rasool, G., Arshad, Z.: A review of code smell mining techniques. J. Softw. Evol. Process 27(11), 867–895 (2015)CrossRef Rasool, G., Arshad, Z.: A review of code smell mining techniques. J. Softw. Evol. Process 27(11), 867–895 (2015)CrossRef
3.
Zurück zum Zitat Lelli, V., Blouin, A., Baudry, B.: Classifying and qualifying GUI defects. In: 2015 IEEE 8th International Conference on Software Testing, Verification and Validation (ICST) (2015) Lelli, V., Blouin, A., Baudry, B.: Classifying and qualifying GUI defects. In: 2015 IEEE 8th International Conference on Software Testing, Verification and Validation (ICST) (2015)
4.
Zurück zum Zitat Moran, K., et al.: Automated reporting of GUI design violations for mobile apps. In: 40th International Conference on Software Engineering (ICSE 2018) (2018) Moran, K., et al.: Automated reporting of GUI design violations for mobile apps. In: 40th International Conference on Software Engineering (ICSE 2018) (2018)
5.
Zurück zum Zitat Chang, T.-H., Yeh, T., Miller, R.C.: GUI testing using computer vision. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1535–1544. ACM, Atlanta (2010) Chang, T.-H., Yeh, T., Miller, R.C.: GUI testing using computer vision. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1535–1544. ACM, Atlanta (2010)
6.
Zurück zum Zitat Yeh, T., Chang, T.-H., Miller, R.C.: Sikuli: using GUI screenshots for search and automation. In: Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology, pp. 183–192. ACM, Victoria (2009) Yeh, T., Chang, T.-H., Miller, R.C.: Sikuli: using GUI screenshots for search and automation. In: Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology, pp. 183–192. ACM, Victoria (2009)
7.
Zurück zum Zitat Baek, Y.-M., Bae, D.-H.: Automated model-based Android GUI testing using multi-level GUI comparison criteria. In: Proceedings of the 31st IEEE/ACM International Conference on Automated Software Engineering, pp. 238–249. ACM, Singapore (2016) Baek, Y.-M., Bae, D.-H.: Automated model-based Android GUI testing using multi-level GUI comparison criteria. In: Proceedings of the 31st IEEE/ACM International Conference on Automated Software Engineering, pp. 238–249. ACM, Singapore (2016)
8.
Zurück zum Zitat Chillarege, R., et al.: Orthogonal defect classification-a concept for in-process measurements. IEEE Trans. Softw. Eng. 18(11), 943–956 (1992)CrossRef Chillarege, R., et al.: Orthogonal defect classification-a concept for in-process measurements. IEEE Trans. Softw. Eng. 18(11), 943–956 (1992)CrossRef
9.
Zurück zum Zitat IEEE Standard Classification for Software Anomalies: IEEE Std 1044-2009 (Revision of IEEE Std 1044-1993), pp. 1–23 (2010) IEEE Standard Classification for Software Anomalies: IEEE Std 1044-2009 (Revision of IEEE Std 1044-1993), pp. 1–23 (2010)
10.
Zurück zum Zitat Beizer, B.: Software Testing Techniques, 2nd edn. Van Nostrand Reinhold Electrical/Computer Science and Engineering Series. Van Nostrand Reinhold. New York (1990). xviii, 290 p. Beizer, B.: Software Testing Techniques, 2nd edn. Van Nostrand Reinhold Electrical/Computer Science and Engineering Series. Van Nostrand Reinhold. New York (1990). xviii, 290 p.
11.
Zurück zum Zitat Johnson, J.: GUI Bloopers 2.0: Common User Interface Design Don’ts and Dos. Morgan Kaufmann Publishers Inc., San Francisco (2007). 424 p. Johnson, J.: GUI Bloopers 2.0: Common User Interface Design Don’ts and Dos. Morgan Kaufmann Publishers Inc., San Francisco (2007). 424 p.
12.
Zurück zum Zitat Li, Y., et al.: DroidBot: a lightweight UI-guided test input generator for Android. In: Proceedings of the 39th International Conference on Software Engineering Companion, pp. 23–26. IEEE Press, Buenos Aires (2017) Li, Y., et al.: DroidBot: a lightweight UI-guided test input generator for Android. In: Proceedings of the 39th International Conference on Software Engineering Companion, pp. 23–26. IEEE Press, Buenos Aires (2017)
13.
Zurück zum Zitat Kay, A.: Tesseract: an open-source optical character recognition engine. Linux J. 2007(159), 2 (2007) Kay, A.: Tesseract: an open-source optical character recognition engine. Linux J. 2007(159), 2 (2007)
14.
Zurück zum Zitat Gunning, R.: The fog index after twenty years. J. Bus. Commun. 6(2), 3–13 (1969)CrossRef Gunning, R.: The fog index after twenty years. J. Bus. Commun. 6(2), 3–13 (1969)CrossRef
15.
Zurück zum Zitat Mailloux, S.L., et al.: How reliable is computerized assessment of readability? Comput. Nurs. 13(5), 221–225 (1995) Mailloux, S.L., et al.: How reliable is computerized assessment of readability? Comput. Nurs. 13(5), 221–225 (1995)
16.
Zurück zum Zitat Roman-Rangel, E., Marchand-Maillet, S.: Automatic removal of visual stop-words. In: Proceedings of the 22nd ACM International Conference on Multimedia, pp. 1145–1148. ACM, Orlando (2014) Roman-Rangel, E., Marchand-Maillet, S.: Automatic removal of visual stop-words. In: Proceedings of the 22nd ACM International Conference on Multimedia, pp. 1145–1148. ACM, Orlando (2014)
17.
Zurück zum Zitat Chen, Y., et al.: Detecting offensive language in social media to protect adolescent online safety. In: 2012 International Conference on Privacy, Security, Risk and Trust and 2012 International Conference on Social Computing (2012) Chen, Y., et al.: Detecting offensive language in social media to protect adolescent online safety. In: 2012 International Conference on Privacy, Security, Risk and Trust and 2012 International Conference on Social Computing (2012)
18.
Zurück zum Zitat Anderka, M., Stein, B., Lipka, N.: Detection of text quality flaws as a one-class classification problem. In: Proceedings of the 20th ACM International Conference on Information and Knowledge Management, pp. 2313–2316. ACM, Glasgow (2011) Anderka, M., Stein, B., Lipka, N.: Detection of text quality flaws as a one-class classification problem. In: Proceedings of the 20th ACM International Conference on Information and Knowledge Management, pp. 2313–2316. ACM, Glasgow (2011)
19.
Zurück zum Zitat Shneiderman, B.: Designing computer system messages. Commun. ACM 25(9), 610–611 (1982)CrossRef Shneiderman, B.: Designing computer system messages. Commun. ACM 25(9), 610–611 (1982)CrossRef
20.
Zurück zum Zitat Choi, W., Necula, G., Sen, K.: Guided GUI testing of android apps with minimal restart and approximate learning. SIGPLAN Not. 48(10), 623–640 (2013)CrossRef Choi, W., Necula, G., Sen, K.: Guided GUI testing of android apps with minimal restart and approximate learning. SIGPLAN Not. 48(10), 623–640 (2013)CrossRef
21.
Zurück zum Zitat Ganov, S.R., et al.: Test generation for graphical user interfaces based on symbolic execution. In Proceedings of the 3rd International Workshop on Automation of Software Test, pp. 33–40. ACM, Leipzig (2008) Ganov, S.R., et al.: Test generation for graphical user interfaces based on symbolic execution. In Proceedings of the 3rd International Workshop on Automation of Software Test, pp. 33–40. ACM, Leipzig (2008)
22.
Zurück zum Zitat Machiry, A., Tahiliani, R., Naik, M.: Dynodroid: an input generation system for Android apps. In: Proceedings of the 2013 9th Joint Meeting on Foundations of Software Engineering, pp. 224–234. ACM, Saint Petersburg (2013) Machiry, A., Tahiliani, R., Naik, M.: Dynodroid: an input generation system for Android apps. In: Proceedings of the 2013 9th Joint Meeting on Foundations of Software Engineering, pp. 224–234. ACM, Saint Petersburg (2013)
23.
Zurück zum Zitat Amalfitano, D., et al.: Using GUI ripping for automated testing of Android applications. In: Proceedings of the 27th IEEE/ACM International Conference on Automated Software Engineering. ACM (2012) Amalfitano, D., et al.: Using GUI ripping for automated testing of Android applications. In: Proceedings of the 27th IEEE/ACM International Conference on Automated Software Engineering. ACM (2012)
24.
Zurück zum Zitat Memon, A., Nagarajan, A., Xie, Q.: Automating regression testing for evolving GUI software. J. Softw. Maintenance Evol. Res. Pract. 17(1), 27–64 (2005)CrossRef Memon, A., Nagarajan, A., Xie, Q.: Automating regression testing for evolving GUI software. J. Softw. Maintenance Evol. Res. Pract. 17(1), 27–64 (2005)CrossRef
25.
Zurück zum Zitat Memon, A., Banerjee, I., Nagarajan, A.: GUI ripping: reverse engineering of graphical user interfaces for testing. In: 2013 20th Working Conference on Reverse Engineering (WCRE). IEEE Computer Society (2003) Memon, A., Banerjee, I., Nagarajan, A.: GUI ripping: reverse engineering of graphical user interfaces for testing. In: 2013 20th Working Conference on Reverse Engineering (WCRE). IEEE Computer Society (2003)
26.
Zurück zum Zitat Xun, Y., Memon, A.M.: Generating event sequence-based test cases using GUI runtime state feedback. IEEE Trans. Softw. Eng. 36(1), 81–95 (2010)CrossRef Xun, Y., Memon, A.M.: Generating event sequence-based test cases using GUI runtime state feedback. IEEE Trans. Softw. Eng. 36(1), 81–95 (2010)CrossRef
27.
Zurück zum Zitat Su, T., et al.: Guided, stochastic model-based GUI testing of Android apps. In: Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering, pp. 245–256. ACM, Paderborn (2017) Su, T., et al.: Guided, stochastic model-based GUI testing of Android apps. In: Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering, pp. 245–256. ACM, Paderborn (2017)
28.
Zurück zum Zitat Miguel, J.L.S., Takada, S.: Generating test cases for Android applications through GUI modeling, usage modeling, and change analysis. In: Proceedings of the Eighth International C* Conference on Computer Science and Software Engineering, pp. 146–147. ACM, Yokohama (2008) Miguel, J.L.S., Takada, S.: Generating test cases for Android applications through GUI modeling, usage modeling, and change analysis. In: Proceedings of the Eighth International C* Conference on Computer Science and Software Engineering, pp. 146–147. ACM, Yokohama (2008)
29.
Zurück zum Zitat Su, T.: FSMdroid: guided GUI testing of android apps. In: Proceedings of the 38th International Conference on Software Engineering Companion, pp. 689–691. ACM, Austin (2016) Su, T.: FSMdroid: guided GUI testing of android apps. In: Proceedings of the 38th International Conference on Software Engineering Companion, pp. 689–691. ACM, Austin (2016)
30.
Zurück zum Zitat Zeng, X., et al.: Automated test input generation for Android: are we really there yet in an industrial case? In: Proceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering, pp. 987–992. ACM, Seattle (2016) Zeng, X., et al.: Automated test input generation for Android: are we really there yet in an industrial case? In: Proceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering, pp. 987–992. ACM, Seattle (2016)
31.
Zurück zum Zitat Baride, S., Dutta, K.: A cloud based software testing paradigm for mobile applications. SIGSOFT Softw. Eng. Notes 36(3), 1–4 (2011)CrossRef Baride, S., Dutta, K.: A cloud based software testing paradigm for mobile applications. SIGSOFT Softw. Eng. Notes 36(3), 1–4 (2011)CrossRef
32.
Zurück zum Zitat Starov, O., Vilkomir, S., Kharchenko, V.: Cloud testing for mobile software systems-concept and prototyping. In: ICSOFT (2013) Starov, O., Vilkomir, S., Kharchenko, V.: Cloud testing for mobile software systems-concept and prototyping. In: ICSOFT (2013)
33.
Zurück zum Zitat Chiatti, A., et al.: Text extraction from smartphone screenshots to archive in situ media behavior. In: Proceedings of the Knowledge Capture Conference, pp. 1–4. ACM, Austin (2017) Chiatti, A., et al.: Text extraction from smartphone screenshots to archive in situ media behavior. In: Proceedings of the Knowledge Capture Conference, pp. 1–4. ACM, Austin (2017)
Metadaten
Titel
Text Semantics and Layout Defects Detection in Android Apps Using Dynamic Execution and Screenshot Analysis
verfasst von
Šarūnas Packevičius
Dominykas Barisas
Andrej Ušaniov
Evaldas Guogis
Eduardas Bareiša
Copyright-Jahr
2018
DOI
https://doi.org/10.1007/978-3-319-99972-2_22