Top

Soft Computing

Published in:

08-10-2019 | Methodologies and Application

Assessing the quality of mobile graphical user interfaces using multi-objective optimization

Authors: Makram Soui, Mabrouka Chouchane, Mohamed Wiem Mkaouer, Marouane Kessentini, Khaled Ghedira

Published in: Soft Computing | Issue 10/2020

Activate our intelligent search to find suitable subject content or patents.

search-config

AI-assisted search

Off

Abstract

Aesthetic defects are a violation of quality attributes that are symptoms of bad interface design programming decisions. They lead to deteriorating the perceived usability of mobile user interfaces and negatively impact the User’s eXperience (UX) with the mobile app. Most existing studies relied on a subjective evaluation of aesthetic defects depending on end-users feedback, which makes the manual evaluation of mobile user interfaces human-centric, time-consuming, and error-prone. Therefore, recent studies have dedicated their effort to focus on the definition of mathematical formulas that each targets a specific structural quality of the interface. As the UX is tightly dependent on the user profile, the combination and calibration of quality attributes, formulas, and user’s characteristics, when defining a defect, are not straightforward. In this context, we propose a fully automated framework which combines literature quality attributes with the user’s profile to identify aesthetic defects of MUI. More precisely, we consider the mobile user interface evaluation as a multi-objective optimization problem where the goal is to maximize the number of detected violations while minimizing the detection complexity of detection rules and enhancing the interfaces overall quality in means of guidance and coherence coverage. We conducted a comparative study of several evolutionary algorithms in terms of accurately identifying aesthetic defects. We reported their performance in solving the proposed search-based multi-objective optimization problem. The results confirm the efficiency of the indicator-based evolutionary algorithm in terms of assessing the developers in detecting typical defects and also in generating the most accurate detection rules.

previous article Selfish herd optimization algorithm based on chaotic strategy for adaptive IIR system identification problem

next article Implementation of fuzzy-based integrated framework for sesame seed separator development

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

über 102.000 Bücher
über 537 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Finance + Banking
Management + Führung
Marketing + Vertrieb
Maschinenbau + Werkstoffe
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 340 Zeitschriften

aus folgenden Fachgebieten:

Bauwesen + Immobilien
Business IT + Informatik
Finance + Banking
Management + Führung
Marketing + Vertrieb
Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

inform now

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

über 67.000 Bücher
über 390 Zeitschriften

aus folgenden Fachgebieten:

Automobil + Motoren
Bauwesen + Immobilien
Business IT + Informatik
Elektrotechnik + Elektronik
Energie + Nachhaltigkeit
Maschinenbau + Werkstoffe

Jetzt Wissensvorsprung sichern!

inform now

Abrahão S, Iborra E, Vanderdonckt J (2008) Usability evaluation of user interfaces generated with a model-driven architecture tool. In: Maturing usability. Springer, London, pp 3–32

Abualigah LMQ (2019) Feature selection and enhanced Krill Herd algorithm for text document clustering. Springer, Berlin

Abualigah LMQ, Hanandeh ES (2015) Applying genetic algorithms to information retrieval using vector space model. Int J Comput Sci Eng Appl 5(1):19

Abualigah LM, Khader AT (2017) Unsupervised text feature selection technique based on hybrid particle swarm optimization algorithm with genetic operators for the text clustering. J Supercomput 73(11):4773–4795

Abualigah LM, Khader AT, Hanandeh ES (2018a) Hybrid clustering analysis using improved Krill Herd algorithm. Appl Intell 48(11):4047–4071

Abualigah LM, Khader AT, Hanandeh ES (2018b) A new feature selection method to improve the document clustering using particle swarm optimization algorithm. J Comput Sci 25:456–466

Akiki PA, Bandara AK, Yu Y (2014) Adaptive model-driven user interface development systems. ACM Comput Surv 47(1):9

Alemerien KA (2014) Metrics and tools to guide design of graphical user interfaces. Ph.D. thesis, North Dakota State University

Alemerien K, Magel K (2015) Slc: a visual cohesion metric to predict the usability of graphical user interfaces. In: Proceedings of the 30th annual ACM symposium on applied computing. ACM, pp 1526–1533

Alnanih R, Ormandjieva O, Radhakrishnan T (2013) A new quality-in-use model for mobile user interfaces. In: 2013 Joint conference of the 23rd international workshop on software measurement and the 2013 eighth international conference on software process and product measurement (IWSM-MENSURA). IEEE, pp 165–170

Aquino N, Vanderdonckt J, Condori-Fernández N, Dieste Ó, Pastor Ó (2010) Usability evaluation of multi-device/platform user interfaces generated by model-driven engineering. In: Proceedings of the 2010 ACM-IEEE international symposium on empirical software engineering and measurement. ACM, p 30

Arabshian K, Schulzrinne H (2006) Distributed context-aware agent architecture for global service discovery. In: The second international workshop on semantic web technology for ubiquitous and mobile applications (SWUMA’06)

Arqub OA, Abo-Hammour Z (2014) Numerical solution of systems of second-order boundary value problems using continuous genetic algorithm. Inf Sci 279:396–415MathSciNetMATH

Arqub OA, Mohammed AS, Momani S, Hayat T (2016) Numerical solutions of fuzzy differential equations using reproducing Kernel Hilbert space method. Soft Comput 20(8):3283–3302MATH

Arqub OA, Al-Smadi M, Momani S, Hayat T (2017) Application of reproducing kernel algorithm for solving second-order, two-point fuzzy boundary value problems. Soft Comput 21(23):7191–7206MATH

Baldwin T, Chai J (2012) Towards online adaptation and personalization of key-target resizing for mobile devices. In: Proceedings of the 2012 ACM international conference on intelligent user interfaces. ACM, pp 11–20

Bao T, Cao H, Chen E, Tian J, Xiong H (2012) An unsupervised approach to modeling personalized contexts of mobile users. Knowl Inf Syst 31(2):345–370

Bastien JC, Scapin DL (1993) Ergonomic criteria for the evaluation of human–computer interfaces. Ph.D. thesis, Inria

Bertini E, Gabrielli S, Kimani S (2006) Appropriating and assessing heuristics for mobile computing. In: Proceedings of the working conference on advanced visual interfaces. ACM, pp 119–126

Bhandari U, Neben T, Chang K, Chua WY (2017) Effects of interface design factors on affective responses and quality evaluations in mobile applications. Comput Hum Behav 72:525–534

Biel B, Grill T, Gruhn V (2010) Exploring the benefits of the combination of a software architecture analysis and a usability evaluation of a mobile application. J Syst Softw 83(11):2031–2044

Brusilovsky P, Chavan G, Farzan R (2004) Social adaptive navigation support for open corpus electronic textbooks. In: International conference on adaptive hypermedia and adaptive web-based systems. Springer, Berlin, pp 24–33

Cámara J, de Lemos R, Laranjeiro N, Ventura R, Vieira M (2014) Testing the robustness of controllers for self-adaptive systems. J Braz Comput Soc 20(1):1

Coherent labs (2019). https://coherent-labs.com/

Constantine LL (1996) Visual coherence and usability: a cohesion metric for assessing the quality of dialogue and screen designs. In: Proceedings of the sixth Australian conference on computer–human interaction. IEEE, pp 115–121

DeJong M, Schellens PJ (1997) Reader-focused text evaluation: an overview of goals and methods. J Bus Tech Commun 11(4):402–432

Dey AK, Abowd GD (2000) Cybreminder: a context-aware system for supporting reminders. In: International symposium on handheld and ubiquitous computing. Springer, pp 172–186

Ehmke C, Wilson S (2007) Identifying web usability problems from eye-tracking data. In: Proceedings of the 21st British HCI group annual conference on people and computers: HCI... but not as we know it, vol 1. British Computer Society, pp 119–128

Erfani M, Zandi M, Rilling J, Keivanloo I (2016) Context-awareness in the software domain-a semantic web enabled modeling approach. J Syst Softw 121:345–357

Expriment (2016). https://github.com/mkaouer/PLAIN

Følstad A, Hornbæk K (2010) Work-domain knowledge in usability evaluation: experiences with cooperative usability testing. J Syst Softw 83(11):2019–2030

Geem ZW, Kim JH (2018) Application of computational intelligence techniques to an environmental flow formula. Int J Fuzzy Logic Intell Syst 18(4):237–244

Gena C (2005) Methods and techniques for the evaluation of user-adaptive systems. Knowl Eng Rev 20(1):1–37

Gena C, Weibelzahl S (2007) Usability engineering for the adaptive web, the adaptive web: methods and strategies of web personalization

Ghiani G, Polet J, Antila V, Mäntyjärvi J (2015) Evaluating context-aware user interface migration in multi-device environments. J Ambient Intell Hum Comput 6(2):259–277

González S, Montero F, González P (2012) Balores: a suite of principles and metrics for graphical user interface evaluation. In: Proceedings of the 13th international conference on Interacción Persona-Ordenador. ACM, p 9

Hariri B, Shirmohammadi S, Pakravan MR (2008) A distributed interest management scheme for massively multi-user virtual environments. In: IEEE conference on virtual environments, human–computer interfaces and measurement systems, 2008 (VECIMS 2008). IEEE, pp 111–115

Hariri B, Shirmohammadi S, Pakravan MR, Alavi MH (2009) An adaptive latency mitigation scheme for massively multiuser virtual environments. J Netw Comput Appl 32(5):1049–1063

Harrison R, Flood D, Duce D (2013) Usability of mobile applications: literature review and rationale for a new usability model. J Interact Sci 1(1):1

Hartmann K, Götzelmann T, Ali K, Strothotte T (2005) Metrics for functional and aesthetic label layouts. In: International symposium on smart graphics. Springer, Berlin, pp 115–126

Hellmann TD, Maurer F (2011) Rule-based exploratory testing of graphical user interfaces. In: 2011 Agile conference. IEEE, pp 107–116

Hobbs J, Pan F (2006) Time ontology in owl. ontology engineering patterns task force of the semantic web best practices and deployment working group. World Wide Web Consortium (W3C) notes

Huart J, Kolski C, Bastien C (2008) L’évaluation de documents multimédias, état de l’art. Objectiver l’humain 1:211–250

Hubert M, Vandervieren E (2008) An adjusted boxplot for skewed distributions. Comput Stat Data Anal 52(12):5186–5201MathSciNetMATH

Hwang W, Salvendy G (2010) Number of people required for usability evaluation: the \(10\pm 2\) rule. Commun ACM 53(5):130–133

Ines G, Makram S, Mabrouka C, Mourad A (2017) Evaluation of mobile interfaces as an optimization problem. Procedia Comput Sci 112:235–248

Iso (2018). https://www.iso.org/obp/ui/#iso:std:iso:9241:-11:ed-2:v1:en

Kang HG, Seong PH (1998) An information theory-based approach for quantitative evaluation of user interface complexity. IEEE Trans Nucl Sci 45(6):3165–3174

Kascak LR, Rébola CB, Sanford JA (2014) Integrating universal design (UD) principles and mobile design guidelines to improve design of mobile health applications for older adults. In: 2014 IEEE international conference on healthcare informatics (ICHI). IEEE, pp 343–348

Kjeldskov J, Stage J (2004) New techniques for usability evaluation of mobile systems. Int J Hum–Comput Stud 60(5–6):599–620

Kobsa A (2007) Privacy-enhanced personalization. Commun ACM 50(8):24–33

Korpipaa P, Mantyjarvi J, Kela J, Keranen H, Malm EJ (2003) Managing context information in mobile devices. IEEE Pervasive Comput 2(3):42–51

Lee H, Choi YS, Kim YJ (2011) An adaptive user interface based on spatiotemporal structure learning. IEEE Commun Mag 49(6):118–124

Lelli V, Blouin A, Baudry B (2015) Classifying and qualifying gui defects. In: 2015 IEEE 8th international conference on software testing, verification and validation (ICST). IEEE, pp 1–10

Lin X, Li S, Xu J, Shi W, Gao Q (2005) An efficient context modeling and reasoning system in pervasive environment: using absolute and relative context filtering technology. In: International conference on web-age information management. Springer, Berlin, pp 357–367

Liu BF, Chou SC, Lin YT, Lin JY (2011) Toward easy delivery of device-oriented adaptive user interface on mobile devices. In: 2011 5th International conference on new trends in information science and service science (NISS), vol 1. IEEE, pp 80–85

Magoulas GD, Chen SY, Papanikolaou KA (2003) Integrating layered and heuristic evaluation for adaptive learning environments. In: Proceedings of the second workshop on empirical evaluation of adaptive systems, held at the 9th international conference on user modeling UM2003, Pittsburgh, pp 5–14

Marinescu R (2004) Detection strategies: metrics-based rules for detecting design flaws. In: Proceedings of the 20th IEEE international conference on software maintenance, 2004. IEEE, pp 350–359

Masra SMW, Goh K, Muhammad MS, Djojodibroto RD, Sapawi R, Kipli K, Shahrom NS (2017) Graphical user interface (GUI) of digital index evaluation system for finger clubbing identification. Sci Res J 14(2):99–112

Miyoshi T, Murata A (2001) Input device using eye tracker in human–computer interaction. In: Proceedings of the 10th IEEE international workshop on robot and human interactive communication. IEEE, pp 580–585

Moorthy AK, Bovik AC (2011) Blind image quality assessment: from natural scene statistics to perceptual quality. IEEE Trans Image Process 20(12):3350–3364MathSciNetMATH

Moran K, Bernal-Cárdenas C, Curcio M, Bonett R, Poshyvanyk D (2018) Machine learning-based prototyping of graphical user interfaces for mobile apps. arXiv preprint arXiv:1802.02312

Moumane K, Idri A, Abran A (2016) Usability evaluation of mobile applications using iso 9241 and iso 25062 standards. SpringerPlus 5(1):548

Myers AC (1995) Bidirectional object layout for separate compilation. ACM SIGPLAN Not 30(10):124–139

Neil T (2014) Mobile design pattern gallery: UI patterns for smartphone apps. O’Reilly Media Inc, Sebastopol

Ngo D, Teo L, Byrne J (2000) Formalising guidelines for the design of screen layouts. Displays 21(1):3–15

O’Malley C, Vavoula G, Glew J, Taylor J, Sharples M, Lefrere P, Lonsdale P, Naismith L, Waycott J (2005) Guidelines for learning/teaching/tutoring in a mobile environment

Paramythis A, Weibelzahl S, Masthoff J (2010) Layered evaluation of interactive adaptive systems: framework and formative methods. User Model User Adapt Interact 20(5):383–453

Park D, Lee JH, Kim S (2011) Investigating the affective quality of interactivity by motion feedback in mobile touchscreen user interfaces. Int J Hum–Comput Stud 69(12):839–853

Park J, Han SH, Kim HK, Cho Y, Park W (2013) Developing elements of user experience for mobile phones and services: survey, interview, and observation approaches. Hum Factors Ergon Manuf Serv Ind 23(4):279–293

Parra-Arnau J, Rebollo-Monedero D, Forné J (2014) Measuring the privacy of user profiles in personalized information systems. Fut Gener Comput Syst 33:53–63

Parush A, Nadir R, Shtub A (1998) Evaluating the layout of graphical user interface screens: validation of a numerical computerized model. Int J Hum–Comput Interact 10(4):343–360

Paterno F (2012) Model-based design and evaluation of interactive applications. Springer, BerlinMATH

Pombinho P, Carmo MB, Afonso AP (2015) Adaptive mobile visualization—the chameleon framework. Comput Sci Inf Syst 12(2):445–464

Preuveneers D, Van den Bergh J, Wagelaar D, Georges A, Rigole P, Clerckx T, Berbers Y, Coninx K, Jonckers V, De Bosschere K (2004) Towards an extensible context ontology for ambient intelligence. In: European symposium on ambient intelligence. Springer, Berlin, pp 148–159

Reitter D, Panttaja EM, Cummins F (2004) UI on the fly: generating a multimodal user interface. In: Proceedings of HLT-NAACL 2004: short papers. Association for Computational Linguistics, pp 45–48

Riegler A, Holzmann C (2018) Measuring visual user interface complexity of mobile applications with metrics. Interact Comput 30(3):207–223

Rousseau B, Browne P, Malone P, Ó Foghlú M (2004) The 19th Annual ACM Symposium on Applied Computing Nicosia, Cyprus, March 14–17, 2004

Ruzic L, Lee ST, Liu YE, Sanford JA (2016) Development of universal design mobile interface guidelines (UDMIG) for aging population. In: International conference on universal access in human–computer interaction. Springer, Berlin, pp 98–108

Schmidt A, Beigl M, Gellersen HW (1999) There is more to context than location. Comput Graph 23(6):893–901

Schmidt B, Galar D, Wang L (2016) Context awareness in predictive maintenance. In: Current trends in reliability, availability, maintainability and safety. Springer, Cham, pp 197–211

Sears A (1993) Layout appropriateness: a metric for evaluating user interface widget layout. IEEE Trans Softw Eng 19(7):707–719

Shitkova M, Holler J, Heide T, Clever N, Becker J (2015) Towards usability guidelines for mobile websites and applications. In: Wirtschaftsinformatik, pp 1603–1617

Shneiderman B, Plaisant C (1994) The future of graphic user interfaces: personal role managers. In: BCS HCI, pp 3–8

Shoaib M, Shah A, Majeed F (2011) Software design quality metrics for web based applications. Pak J Sci 63(1):20–26

Soui M, Abed M, Kolski C, Ghèdira K (2012) Evaluation by simulation to optimise information systems’ personalisation quality in logistics. Int J Prod Res 50(13):3579–3593

Soui M, Chouchane M, Gasmi I, Mkaouer MW (2017) Plain: plugin for predicting the usability of mobile user interface. In: VISIGRAPP (1: GRAPP), pp 127–136

Stephanidis C, Paramythis A, Sfyrakis M (1999) Evaluating adaptable and adaptive user interfaces: lessons learned from the development of the avanti web browser. In: 5th ERCIM workshop on“ User Interfaces for All”, pp 22.1–22.6

Su’a T, Licorish SA, Savarimuthu BTR, Langlotz T (2017) Quickreview: a novel data-driven mobile user interface for reporting problematic app features. In: Proceedings of the 22nd international conference on intelligent user interfaces. ACM, pp 517–522

Taconet C, Kazi-Aoul Z (2008) Context-awareness and model driven engineering: illustration by an e-commerce application scenario. In: Third international conference on digital information management, 2008 (ICDIM 2008). IEEE, pp 864–869

Terdjimi M, Médini L, Mrissa M (2016) Towards a meta-model for context in the web of things. In: Karlsruhe service summit workshop

Thalmann S (2014) Adaptation criteria for the personalised delivery of learning materials: a multi-stage empirical investigation. Australas J Educ Technol 30(1):45–60

Thevenin D, Coutaz J (1999) Plasticity of user interfaces: framework and research agenda. Interact 99:110–117

Van Velsen L, Van Der Geest T, Klaassen R, Steehouder M (2008) User-centered evaluation of adaptive and adaptable systems: a literature review. Knowl Eng Rev 23(3):261–281

Vanderdonckt J, Gillo X (1994) Visual techniques for traditional and multimedia layouts. In: Proceedings of the workshop on advanced visual interfaces. ACM, pp 95–104

von Wangenheim CG, Porto JVA, Hauck JC, Borgatto AF (2018) Do we agree on user interface aesthetics of android apps? arXiv preprint arXiv:1812.09049

Vos TE, Kruse PM, Condori-Fernández N, Bauersfeld S, Wegener J (2015) Testar: tool support for test automation at the user interface level. Int J Inf Syst Model Des 6(3):46–83

Walker T (2012) State of the us internet in q1 2012. ComScore Inc. State of the Internet: US Quarter One

Wang XH, Zhang DQ, Gu T, Pung HK (2004) Ontology based context modeling and reasoning using owl. In: Proceedings of the second IEEE annual conference on pervasive computing and communications workshops, 2004. IEEE, pp 18–22

Wei\(\beta \)enberg N, Voisard A, Gartmann R (2004) Using ontologies in personalized mobile applications. In: Proceedings of the 12th annual ACM international workshop on Geographic information systems. ACM, pp 2–11

Xing J, Manning CA (2005) Complexity and automation displays of air traffic control: literature review and analysis. Tech. rep, Federal Aviation Administration Oklahoma City Ok Civil Aeromedical Inst

Xu Y, Ratcliff J, Scovell J, Speiginer G, Azuma R (2015) Real-time guidance camera interface to enhance photo aesthetic quality. In: Proceedings of the 33rd annual ACM conference on human factors in computing systems. ACM, pp 1183–1186

Ye X, Bunescu R, Liu C (2016) Mapping bug reports to relevant files: a ranking model, a fine-grained benchmark, and feature evaluation. IEEE Trans Softw Eng 42(4):379–402

Zen M, Vanderdonckt J (2014) Towards an evaluation of graphical user interfaces aesthetics based on metrics. In: 2014 IEEE eighth international conference on research challenges in information science (RCIS). IEEE, pp 1–12

Title: Assessing the quality of mobile graphical user interfaces using multi-objective optimization
Authors: Makram Soui
Mabrouka Chouchane
Mohamed Wiem Mkaouer
Marouane Kessentini
Khaled Ghedira
Publication date: 08-10-2019
Publisher: Springer Berlin Heidelberg
Published in: Soft Computing / Issue 10/2020
Print ISSN: 1432-7643
Electronic ISSN: 1433-7479
DOI: https://doi.org/10.1007/s00500-019-04391-8

Springer Professional

Abstract

Please log in to get access to your license.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Springer Professional "Wirtschaft"

Springer Professional "Technik"

Other articles of this Issue 10/2020

Solution of heterogeneous multi-attribute case-based decision making problems by using method based on TODIM

Grid-based dynamic robust multi-objective brain storm optimization algorithm

Multiplicative derivations and d-filters of commutative residuated lattices

Aggregation of pragmatic operators to support probabilistic linguistic multi-criteria group decision-making problems

Indeterminate Likert scale: feedback based on neutrosophy, its distance measures and clustering algorithm

Estimation of number of foreign visitors with ANFIS by using ABC algorithm

Premium Partner