Skip to main content

2017 | OriginalPaper | Buchkapitel

Usability Evaluation of Domain-Specific Languages: A Systematic Literature Review

verfasst von : Ildevana Poltronieri Rodrigues, Márcia de Borba Campos, Avelino F. Zorzo

Erschienen in: Human-Computer Interaction. User Interface Design, Development and Multimodality

Verlag: Springer International Publishing

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Software developers have always been concerned with the quality of the products they produce. Although software engineers use new methods to evaluate the quality of their software, there are still some concerns in several of the methods they use when developing software, for example, when using Domain-Specific Languages (DSLs). One of the main goals of DSLs is to ease the work of developers in different areas. However, to achieve this goal it is necessary to provide an evaluation of the usability of such languages. Although it is possible to find some experiments to evaluate such languages, usually this experiments are subjective and do not use techniques from the Human-Computer Interaction (HCI) area. Therefore, this paper presents a Systematic Literature Review (SLR) in which a discussion on the usability of DSLs is presented. This paper also presents a mapping to show how usability has been assessed by researchers in their work.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Literatur
1.
Zurück zum Zitat Albuquerque, D., Cafeo, B., Garcia, A., Barbosa, S., Abrahão, S., Ribeiro, A.: Quantifying usability of domain-specific languages: An empirical study on software maintenance. J. Syst. Softw. 101, 245–259 (2015)CrossRef Albuquerque, D., Cafeo, B., Garcia, A., Barbosa, S., Abrahão, S., Ribeiro, A.: Quantifying usability of domain-specific languages: An empirical study on software maintenance. J. Syst. Softw. 101, 245–259 (2015)CrossRef
2.
Zurück zum Zitat Barisic, A., Amaral, V., Goulão, M.: Usability evaluation of domain-specific languages. In: Quality of Information and Communications Technology, pp. 342–347 (2012) Barisic, A., Amaral, V., Goulão, M.: Usability evaluation of domain-specific languages. In: Quality of Information and Communications Technology, pp. 342–347 (2012)
3.
Zurück zum Zitat Barisic, A., Amaral, V., Goulão, M., Aguiar, A.: Introducing usability concerns early in the DSL development cycle: Flowsl experience report. In: MODELS, pp. 8–17 (2014) Barisic, A., Amaral, V., Goulão, M., Aguiar, A.: Introducing usability concerns early in the DSL development cycle: Flowsl experience report. In: MODELS, pp. 8–17 (2014)
4.
Zurück zum Zitat Barisic, A., Amaral, V., Goulão, M., Barroca, B.: Quality in use of domain-specific languages: a case study. In: 3rd ACM SIGPLAN Workshop on Evaluation and Usability of Programming Languages and Tools, pp. 65–72 (2011) Barisic, A., Amaral, V., Goulão, M., Barroca, B.: Quality in use of domain-specific languages: a case study. In: 3rd ACM SIGPLAN Workshop on Evaluation and Usability of Programming Languages and Tools, pp. 65–72 (2011)
5.
Zurück zum Zitat Barisic, A., Amaral, V., Goulão, M., Barroca, B.: Evaluating the usability of domain specific languages. In: Formal and Practical Aspects of Domain-Specific Languages: Recent Developments (2012) Barisic, A., Amaral, V., Goulão, M., Barroca, B.: Evaluating the usability of domain specific languages. In: Formal and Practical Aspects of Domain-Specific Languages: Recent Developments (2012)
6.
Zurück zum Zitat Bernardino, M., Rodrigues, E., Zorzo, A.F.: Performance testing modeling: an empirical evaluation of DSL and UML-based approaches. In: 31st ACM Symposium on Applied Computing, pp. 1–6 (2016) Bernardino, M., Rodrigues, E., Zorzo, A.F.: Performance testing modeling: an empirical evaluation of DSL and UML-based approaches. In: 31st ACM Symposium on Applied Computing, pp. 1–6 (2016)
7.
Zurück zum Zitat Bernardino, M., Zorzo, A.F., Rodrigues, E.: Canopus: a domain-specific language for modeling performance testing. In: 9th International Conference on Software Testing, Verification and Validation, pp. 1–8 (2016) Bernardino, M., Zorzo, A.F., Rodrigues, E.: Canopus: a domain-specific language for modeling performance testing. In: 9th International Conference on Software Testing, Verification and Validation, pp. 1–8 (2016)
8.
Zurück zum Zitat Bernardino, M., Zorzo, A.F., Rodrigues, E., de Oliveira, F.M., Saad, R.: A domain specific language for modeling performance testing: requirements analysis and design decisions. In: 9th International Conference on Software Engineering Advances, pp. 609–614 (2014) Bernardino, M., Zorzo, A.F., Rodrigues, E., de Oliveira, F.M., Saad, R.: A domain specific language for modeling performance testing: requirements analysis and design decisions. In: 9th International Conference on Software Engineering Advances, pp. 609–614 (2014)
9.
Zurück zum Zitat Conrado, D.B.F.: Abordagem para criação de linguagem específica de domínio para robótica móvel. Dissertação de Mestrado – Universidade Federal de São Carlos (2012) Conrado, D.B.F.: Abordagem para criação de linguagem específica de domínio para robótica móvel. Dissertação de Mestrado – Universidade Federal de São Carlos (2012)
10.
Zurück zum Zitat Cuenca, F., Bergh, J.V.D., Luyten, K., Coninx, K.: A user study for comparing the programming efficiency of modifying executable multimodal interaction descriptions: a domain-specific language versus equivalent event-callback code. In: 6th Workshop on Evaluation and Usability of Programming Languages and Tools, pp. 31–38 (2015) Cuenca, F., Bergh, J.V.D., Luyten, K., Coninx, K.: A user study for comparing the programming efficiency of modifying executable multimodal interaction descriptions: a domain-specific language versus equivalent event-callback code. In: 6th Workshop on Evaluation and Usability of Programming Languages and Tools, pp. 31–38 (2015)
11.
Zurück zum Zitat Dobbe, J.: A domain-specific language for computer games. Master thesis - Delft University of Technology, Netherlands (2007) Dobbe, J.: A domain-specific language for computer games. Master thesis - Delft University of Technology, Netherlands (2007)
12.
Zurück zum Zitat Ewais, A.B., De Troyer, O.: A usability evaluation of graphical modelling languages for authoring adaptive 3d virtual learning environments. In: 6th International Conference on Computer Supported Education (CSEDU), pp. 459–466 (2014) Ewais, A.B., De Troyer, O.: A usability evaluation of graphical modelling languages for authoring adaptive 3d virtual learning environments. In: 6th International Conference on Computer Supported Education (CSEDU), pp. 459–466 (2014)
13.
Zurück zum Zitat Fowler, M.: Domain Specific Languages. Addison-Wesley Professional, Boston (2010) Fowler, M.: Domain Specific Languages. Addison-Wesley Professional, Boston (2010)
14.
Zurück zum Zitat Furtado, A.W.B., Santos, A.L.M.: Using domain-specific modeling towards computer games development industrialization. In: 6th OOPSLA Workshop on Domain-specific Modeling (DSM) (2006) Furtado, A.W.B., Santos, A.L.M.: Using domain-specific modeling towards computer games development industrialization. In: 6th OOPSLA Workshop on Domain-specific Modeling (DSM) (2006)
15.
Zurück zum Zitat Gibbs, I., Dascalu, S., Harris, F.C.: A separation-based UI architecture with a DSL for role specialization. J. Syst. Softw. 101, 69–85 (2015)CrossRef Gibbs, I., Dascalu, S., Harris, F.C.: A separation-based UI architecture with a DSL for role specialization. J. Syst. Softw. 101, 69–85 (2015)CrossRef
16.
Zurück zum Zitat Kabac, M., Volanschi, N., Consel, C.: An evaluation of the DiaSuite toolset by professional developers: Learning cost and usability. In: 6th Workshop on Evaluation and Usability of Programming Languages and Tools, pp. 9–16 (2015) Kabac, M., Volanschi, N., Consel, C.: An evaluation of the DiaSuite toolset by professional developers: Learning cost and usability. In: 6th Workshop on Evaluation and Usability of Programming Languages and Tools, pp. 9–16 (2015)
17.
Zurück zum Zitat Kelly, S., Tolvanen, J.-P.: Domain-Specific Modeling: Enabling Full Code Generation. Wiley-Interscience: IEEE Computer Society, Hoboken (2008)CrossRef Kelly, S., Tolvanen, J.-P.: Domain-Specific Modeling: Enabling Full Code Generation. Wiley-Interscience: IEEE Computer Society, Hoboken (2008)CrossRef
18.
Zurück zum Zitat Kitchenham, B., Charters, S.: Guidelines for performing systematic literature reviews in software engineering, ver. 2.3. Technical report, Evidence-Based Software Engineering (EBSE) (2007) Kitchenham, B., Charters, S.: Guidelines for performing systematic literature reviews in software engineering, ver. 2.3. Technical report, Evidence-Based Software Engineering (EBSE) (2007)
19.
Zurück zum Zitat Meier, J.: Performance Testing Guidance for Web Applications: Patterns & Practices. Microsoft Press, Redmond (2007) Meier, J.: Performance Testing Guidance for Web Applications: Patterns & Practices. Microsoft Press, Redmond (2007)
20.
Zurück zum Zitat Mernik, M., Heering, J., Sloane, A.M.: When and how to develop domain-specific languages. ACM Comput. Surv. 37–4, 316–344 (2005)CrossRef Mernik, M., Heering, J., Sloane, A.M.: When and how to develop domain-specific languages. ACM Comput. Surv. 37–4, 316–344 (2005)CrossRef
21.
Zurück zum Zitat Mernik, M., Porubän, J., Kollár, J., Sabo, M.: Abstraction of computer language patterns: the inference of textual notation for a DSL. In: Formal and Practical Aspects of Domain-Specific Languages: Recent Developments. Information Science Reference (2012) Mernik, M., Porubän, J., Kollár, J., Sabo, M.: Abstraction of computer language patterns: the inference of textual notation for a DSL. In: Formal and Practical Aspects of Domain-Specific Languages: Recent Developments. Information Science Reference (2012)
22.
Zurück zum Zitat Nielsen, J., Molich, R.: Heuristic evaluation of user interfaces. In: SIGCHI Conference on Human Factors in Computing Systems, pp. 249–256 (1990) Nielsen, J., Molich, R.: Heuristic evaluation of user interfaces. In: SIGCHI Conference on Human Factors in Computing Systems, pp. 249–256 (1990)
23.
Zurück zum Zitat Nordmann, A., Hochgeschwender, N., Wrede, S.: A survey on domain-specific languages in robotics. In: International Conference on Simulation, Modeling, and Programming for Autonomous Robots, pp. 195–206 (2014) Nordmann, A., Hochgeschwender, N., Wrede, S.: A survey on domain-specific languages in robotics. In: International Conference on Simulation, Modeling, and Programming for Autonomous Robots, pp. 195–206 (2014)
24.
Zurück zum Zitat Prates, R.O., Barbosa, S.D.J.: Avaliação de interfaces de usuário–conceitos e métodos. Jornada de Atualização em Informática do Congresso da Sociedade Brasileira de Computação, Capítulo, vol. 6 (2003) Prates, R.O., Barbosa, S.D.J.: Avaliação de interfaces de usuário–conceitos e métodos. Jornada de Atualização em Informática do Congresso da Sociedade Brasileira de Computação, Capítulo, vol. 6 (2003)
25.
Zurück zum Zitat Pressman, R.: Software Engineering: A Practitioner’s Approach, vol. 7. Palgrave Macmillan, New York (2005). Capítulo 1–2MATH Pressman, R.: Software Engineering: A Practitioner’s Approach, vol. 7. Palgrave Macmillan, New York (2005). Capítulo 1–2MATH
26.
Zurück zum Zitat Rogers, Y., Sharp, H., Preece, J.: Interaction Design. Wiley, New York (2002) Rogers, Y., Sharp, H., Preece, J.: Interaction Design. Wiley, New York (2002)
27.
Zurück zum Zitat Rouly, J.M., Orbeck, J.D., Syriani, E.: Usability and suitability survey of features in visual ides for non-programmers. In: 5th Workshop on Evaluation and Usability of Programming Languages and Tools, pp. 31–42 (2014) Rouly, J.M., Orbeck, J.D., Syriani, E.: Usability and suitability survey of features in visual ides for non-programmers. In: 5th Workshop on Evaluation and Usability of Programming Languages and Tools, pp. 31–42 (2014)
28.
Zurück zum Zitat Hewett, T.T., Baecker, R., Card, S., Carey, T., Gasen, J., Mantei, M., Perlman, G., Strong, G., Verplank, W.: ACM SIGCHI Curricula for Human-Computer Interaction. Technical report. ACM (1992) Hewett, T.T., Baecker, R., Card, S., Carey, T., Gasen, J., Mantei, M., Perlman, G., Strong, G., Verplank, W.: ACM SIGCHI Curricula for Human-Computer Interaction. Technical report. ACM (1992)
29.
Zurück zum Zitat Sinha, A.C., Smidts, C.: An experimental evaluation of a higher-ordered typed-functional specification-based test-generation technique. Empirical Softw. Eng. 11–2, 173–202 (2006)CrossRef Sinha, A.C., Smidts, C.: An experimental evaluation of a higher-ordered typed-functional specification-based test-generation technique. Empirical Softw. Eng. 11–2, 173–202 (2006)CrossRef
30.
Zurück zum Zitat Shneiderman, B.: Designing the User Interface: Strategies for Effective Human-Computer Interaction. Addison-Wesley Longman Publishing Co., Boston (1997) Shneiderman, B.: Designing the User Interface: Strategies for Effective Human-Computer Interaction. Addison-Wesley Longman Publishing Co., Boston (1997)
31.
Zurück zum Zitat Teruel, M.A., Navarro, E., López-Jaquero, V., Montero, F., González, P.: A CSCW requirements engineering case tool: development and usability evaluation. Inf. Softw. Technol. 56–8, 922–949 (2014)CrossRef Teruel, M.A., Navarro, E., López-Jaquero, V., Montero, F., González, P.: A CSCW requirements engineering case tool: development and usability evaluation. Inf. Softw. Technol. 56–8, 922–949 (2014)CrossRef
32.
Zurück zum Zitat Walter, R., Masuch, M.: How to integrate domain-specific languages into the game development process. In: 8th International Conference on Advances in Computer Entertainment Technology, pp. 1–8 (2011). Article No. 42 Walter, R., Masuch, M.: How to integrate domain-specific languages into the game development process. In: 8th International Conference on Advances in Computer Entertainment Technology, pp. 1–8 (2011). Article No. 42
33.
Zurück zum Zitat Weber, R., Zhang, Y.: An analytical evaluation of Niam’s grammar for conceptual schema diagrams. Inf. Syst. J. 6–2, 147–170 (1996)CrossRef Weber, R., Zhang, Y.: An analytical evaluation of Niam’s grammar for conceptual schema diagrams. Inf. Syst. J. 6–2, 147–170 (1996)CrossRef
Metadaten
Titel
Usability Evaluation of Domain-Specific Languages: A Systematic Literature Review
verfasst von
Ildevana Poltronieri Rodrigues
Márcia de Borba Campos
Avelino F. Zorzo
Copyright-Jahr
2017
DOI
https://doi.org/10.1007/978-3-319-58071-5_39

Neuer Inhalt