Skip to main content
Erschienen in: Software Quality Journal 1/2011

01.03.2011

Graphical versus textual software measurement modelling: an empirical study

verfasst von: B. Mora, F. García, F. Ruiz, M. Piattini

Erschienen in: Software Quality Journal | Ausgabe 1/2011

Einloggen

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
loading …

Abstract

Model-driven Engineering (MDE) has attained great importance in both the Software Engineering industry and the research community, where it is now widely used to provide a suitable approach with which to improve productivity when developing software artefacts. In this scenario, measurement models (software artefacts) have become a fundamental point in improvement of productivity, where MDE and Software Measurement can reap mutual benefits. MDE principles and techniques can be used in software measurement to build more automatic and generic solutions, and to achieve this, it is fundamental to be able to develop software measurement models. To facilitate this task, a domain-specific language named “Software Measurement Modelling Language” (SMML) has been developed. This paper tackles the question of whether the use of SMML can assist in the definition of software measurement models. An empirical study was conducted, with the aim of verifying whether SMML makes it easier to construct measurement models which are more usable and maintainable as regards textual notation. The results show that models which do not use the language are more difficult—in terms of effort, correctness and efficiency—to understand and modify than those represented with SMML. Additional feedback was also obtained, to verify the suitability of the graphical representation of each symbol (element or relationship) of SMML.

Sie haben noch keine Lizenz? Dann Informieren Sie sich jetzt über unsere Produkte:

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Anhänge
Nur mit Berechtigung zugänglich
Fußnoten
1
In http://​alarcos.​inf-cr.​uclm.​es/​ontologies/​smo/​—The Web Ontology Language (OWL) is a family of knowledge representation languages for authoring ontologies endorsed by the World Wide Web Consortium.
 
4
LabVIEW (short for Laboratory Virtual Instrumentation Engineering Workbench) is a platform and development environment for a visual programming language from National Instruments.
 
5
Simulink is an environment for multidomain simulation and Model-Based Design for dynamic and embedded systems. It provides an interactive graphical environment and a customizable set of block libraries that let you design, simulate, implement, and test a variety of time-varying systems, including communications, controls, signal processing, video processing, and image processing.
 
Literatur
Zurück zum Zitat Ahmad, R. (1999). Visual languages: A new way of programming. Malaysian Journal of Computer Science, 12(1), 76–81. Ahmad, R. (1999). Visual languages: A new way of programming. Malaysian Journal of Computer Science, 12(1), 76–81.
Zurück zum Zitat Arpaia, P., Buzio, M., Fiscarelli, L., Inglese, V., Commara, G. L., & Walckiers, L. (2009). Measurement-domain specific language for magnetic test specifications at CERN. 2009 IEEE instrumentation and measurement technology conference, CERN/TE 2009-002, 1716–1720. Arpaia, P., Buzio, M., Fiscarelli, L., Inglese, V., Commara, G. L., & Walckiers, L. (2009). Measurement-domain specific language for magnetic test specifications at CERN. 2009 IEEE instrumentation and measurement technology conference, CERN/TE 2009-002, 1716–1720.
Zurück zum Zitat Basili, V. R., Shull, F., & Lanubile, F. (1999). Building knowledge through families of experiments. IEEE Transactions on Software Engineering, 25(4), 456–473.CrossRef Basili, V. R., Shull, F., & Lanubile, F. (1999). Building knowledge through families of experiments. IEEE Transactions on Software Engineering, 25(4), 456–473.CrossRef
Zurück zum Zitat Bézivin, J. (2004). In search of a basic principle for model-driven engineering [Special Issue]. Novatica Journal, 5, 21–24. Bézivin, J. (2004). In search of a basic principle for model-driven engineering [Special Issue]. Novatica Journal, 5, 21–24.
Zurück zum Zitat Bézivin, J., Jouault, F., & Touzet, D. (2005). Principles, standards and tools for model engineering. 10th IEEE international conference on engineering of complex computer systems (ICECCS’2005), 28–29. Bézivin, J., Jouault, F., & Touzet, D. (2005). Principles, standards and tools for model engineering. 10th IEEE international conference on engineering of complex computer systems (ICECCS’2005), 28–29.
Zurück zum Zitat Cook, S. (2004). Domain-specific modeling and model driven architecture. In D. S. Frankel & J. Parodi (Eds.), The MDA journal: Model driven architecture straight from the masters (Chap. 5, pp. 1–10). Tampa, FL: Meghan-Kiffer Press. Cook, S. (2004). Domain-specific modeling and model driven architecture. In D. S. Frankel & J. Parodi (Eds.), The MDA journal: Model driven architecture straight from the masters (Chap. 5, pp. 1–10). Tampa, FL: Meghan-Kiffer Press.
Zurück zum Zitat Cunniff, N., & Taylor, R. P. (1987). Graphical vs. textual representation: An empirical study of novices’ program comprehension. Empirical studies of programmers: Second workshop, pp. 114–131. Cunniff, N., & Taylor, R. P. (1987). Graphical vs. textual representation: An empirical study of novices’ program comprehension. Empirical studies of programmers: Second workshop, pp. 114–131.
Zurück zum Zitat Deursen, A. v., Klint, P., & Visser, J. (2000). Domain-specific languages: An annotated bibliography. SIGPLAN Notices, 35(6), 26–36.CrossRef Deursen, A. v., Klint, P., & Visser, J. (2000). Domain-specific languages: An annotated bibliography. SIGPLAN Notices, 35(6), 26–36.CrossRef
Zurück zum Zitat Eysenck, M. W., & Keane, M. T. (2005). Cognitive psychology: A student’s handbook. Mahwah, NJ: Lawrence Erlbaum Associates. Eysenck, M. W., & Keane, M. T. (2005). Cognitive psychology: A student’s handbook. Mahwah, NJ: Lawrence Erlbaum Associates.
Zurück zum Zitat Feilkas, M. (2006). How to represent models, languages and transformations? Proceedings of the 6th OOPSLA workshop on domain-specific modeling (DSM’06), pp. 204–213. Feilkas, M. (2006). How to represent models, languages and transformations? Proceedings of the 6th OOPSLA workshop on domain-specific modeling (DSM’06), pp. 204–213.
Zurück zum Zitat Fenton, N., & Pfleeger, S. L. (1997). Software metrics: A rigorous & practical approach (2nd ed.). Boston, MA: PWS Publishing Company. Fenton, N., & Pfleeger, S. L. (1997). Software metrics: A rigorous & practical approach (2nd ed.). Boston, MA: PWS Publishing Company.
Zurück zum Zitat García, F., Bertoa, M. F., Calero, C., Vallecillo, A., Ruíz, F., Piattini, M., et al. (2006). Towards a consistent terminology for software measurement. Information & Software Technology, 48(8), 631–644.CrossRef García, F., Bertoa, M. F., Calero, C., Vallecillo, A., Ruíz, F., Piattini, M., et al. (2006). Towards a consistent terminology for software measurement. Information & Software Technology, 48(8), 631–644.CrossRef
Zurück zum Zitat García, F., Ruiz, F., Cruz, J., & Piattini, M. (2003). Integrated measurement for the evaluation and improvement of software processes. Proceedings of the 9th European workshop on software process technology (EWSPT’9), Lecture Notes in Computer Science, 2786, pp. 94–111. García, F., Ruiz, F., Cruz, J., & Piattini, M. (2003). Integrated measurement for the evaluation and improvement of software processes. Proceedings of the 9th European workshop on software process technology (EWSPT’9), Lecture Notes in Computer Science, 2786, pp. 94–111.
Zurück zum Zitat García, F., Serrano, M., Cruz-Lemus, J., Ruiz, F., & Piattini, M. (2007). Managing software process measurement: A metamodel-based approach. Information Sciences, 177, 2570–2586.CrossRef García, F., Serrano, M., Cruz-Lemus, J., Ruiz, F., & Piattini, M. (2007). Managing software process measurement: A metamodel-based approach. Information Sciences, 177, 2570–2586.CrossRef
Zurück zum Zitat Genero, M., Moody, D., & Piattini, M. (2005). Assessing the capability of internal metrics as early indicators of maintenance effort through experimentation. Journal of Software Maintenance, 17(3), 225–246.CrossRef Genero, M., Moody, D., & Piattini, M. (2005). Assessing the capability of internal metrics as early indicators of maintenance effort through experimentation. Journal of Software Maintenance, 17(3), 225–246.CrossRef
Zurück zum Zitat Green, T. R. G., Petre, M., & Bellamy, R. K. E. (1991). Comprehensibility of visual and textual programs: A test of superlativism against the match-mismatch conjecture. 4th workshop on empirical studies of programmers, pp. 121–146. Green, T. R. G., Petre, M., & Bellamy, R. K. E. (1991). Comprehensibility of visual and textual programs: A test of superlativism against the match-mismatch conjecture. 4th workshop on empirical studies of programmers, pp. 121–146.
Zurück zum Zitat Guerra, E., Lara, J. d., & Díaz, P. (2008). Visual specification of measurements and redesigns for domain specific visual languages. Journal of Visual Languages and Computing, 19(3), 399–425.CrossRef Guerra, E., Lara, J. d., & Díaz, P. (2008). Visual specification of measurements and redesigns for domain specific visual languages. Journal of Visual Languages and Computing, 19(3), 399–425.CrossRef
Zurück zum Zitat Hull, D., Wolstencroft, K., Stevens, R., Goble, C., Pocock, M., Li, P., & Oin, T. (2006). Taverna: A tool for building and running workflows of services. Nucleic Acids Research, 34(Web Server issue) pp. 729–732. Hull, D., Wolstencroft, K., Stevens, R., Goble, C., Pocock, M., Li, P., & Oin, T. (2006). Taverna: A tool for building and running workflows of services. Nucleic Acids Research, 34(Web Server issue) pp. 729–732.
Zurück zum Zitat ISO/IEC. (2001). ISO/IEC 9126-1: Software engineering-software product quality—Part 1: Quality model. Geneva, Switzerland, International Organization for Standardization. ISO/IEC. (2001). ISO/IEC 9126-1: Software engineering-software product qualityPart 1: Quality model. Geneva, Switzerland, International Organization for Standardization.
Zurück zum Zitat Jedlitschka, A., & Ciolkowski, M. (2005). Reporting guidelines for controlled experiments in software engineering. ACM/IEEE international symposium on empirical software engineering, pp. 95–195. Jedlitschka, A., & Ciolkowski, M. (2005). Reporting guidelines for controlled experiments in software engineering. ACM/IEEE international symposium on empirical software engineering, pp. 95–195.
Zurück zum Zitat Jouault, F., Allilaire, F., Bézivin, J., Kurtev, I., & Valduriez, P. (2006). ATL: A QVT-like transformation language. Companion to the 21th annual ACM SIGPLAN conference on object-oriented programming, systems, languages, and applications, OOPSLA 2006, pp. 719–720. Jouault, F., Allilaire, F., Bézivin, J., Kurtev, I., & Valduriez, P. (2006). ATL: A QVT-like transformation language. Companion to the 21th annual ACM SIGPLAN conference on object-oriented programming, systems, languages, and applications, OOPSLA 2006, pp. 719–720.
Zurück zum Zitat Jouault, F., & Bézivin, J. (2006). KM3: A DSL for metamodel specification. Formal methods for open object-based distributed systems, 8th IFIP WG 6.1 international conference, FMOODS 2006, 4037, pp. 171–185. Jouault, F., & Bézivin, J. (2006). KM3: A DSL for metamodel specification. Formal methods for open object-based distributed systems, 8th IFIP WG 6.1 international conference, FMOODS 2006, 4037, pp. 171–185.
Zurück zum Zitat Juristo, N., & Moreno, A. M. (2001). Basics of software engineering experimentation. Boston, MA: Kluwer Academic Publishers.MATH Juristo, N., & Moreno, A. M. (2001). Basics of software engineering experimentation. Boston, MA: Kluwer Academic Publishers.MATH
Zurück zum Zitat Karsai, G., Krahn, H., Pinkernell, C., Rumpe, B., Schindler, M., & Völkel, S. (2009). Design guidelines for domain specific languages. The 9th OOPSLA workshop on domain-specific modeling, pp. 7–13. Karsai, G., Krahn, H., Pinkernell, C., Rumpe, B., Schindler, M., & Völkel, S. (2009). Design guidelines for domain specific languages. The 9th OOPSLA workshop on domain-specific modeling, pp. 7–13.
Zurück zum Zitat Kelly, S., & Pohjonen, R. (2009). Worst practices for domain-specific modeling. IEEE Software, 26(4), 22–29.CrossRef Kelly, S., & Pohjonen, R. (2009). Worst practices for domain-specific modeling. IEEE Software, 26(4), 22–29.CrossRef
Zurück zum Zitat Kitchenham, B. A., Pfleeger, S. L., Pickard, L. M., Jones, P. W., Hoaglin, D. C., Emam, K. E., et al. (2002). Preliminary guidelines for empirical research in software engineering. IEEE Transactions on Software Engineering, 28(8), 721–734.CrossRef Kitchenham, B. A., Pfleeger, S. L., Pickard, L. M., Jones, P. W., Hoaglin, D. C., Emam, K. E., et al. (2002). Preliminary guidelines for empirical research in software engineering. IEEE Transactions on Software Engineering, 28(8), 721–734.CrossRef
Zurück zum Zitat Kolovos, D. S., Paige, R. F., Kelly, T., & Polack, F. A. C. (2006). Requirements for domain-specific languages. First ECOOP workshop on domain-specific program development (ECOOP’06). Kolovos, D. S., Paige, R. F., Kelly, T., & Polack, F. A. C. (2006). Requirements for domain-specific languages. First ECOOP workshop on domain-specific program development (ECOOP’06).
Zurück zum Zitat Kurtev, I., Bézivin, J., Jouault, F., & Valduriez, P. (2006). Model-based DSL frameworks. OOPSLA Companion 2006, pp. 602–616. Kurtev, I., Bézivin, J., Jouault, F., & Valduriez, P. (2006). Model-based DSL frameworks. OOPSLA Companion 2006, pp. 602–616.
Zurück zum Zitat Mernik, M., Heering, J., & Sloane, A. M. (2005). When and how to develop domain-specific languages. ACM Computing Surveys (CSUR), 37(4), 316–344.CrossRef Mernik, M., Heering, J., & Sloane, A. M. (2005). When and how to develop domain-specific languages. ACM Computing Surveys (CSUR), 37(4), 316–344.CrossRef
Zurück zum Zitat Moher, T. G., Mak, D. C., Blumenthal, B., & Leventahal, L. M. (1993). Comparing the comprehensibility of textual and graphical programs: The case of petri nets. Palo Alto, pp. 137–161. Moher, T. G., Mak, D. C., Blumenthal, B., & Leventahal, L. M. (1993). Comparing the comprehensibility of textual and graphical programs: The case of petri nets. Palo Alto, pp. 137–161.
Zurück zum Zitat Mora, B., García, F., Ruiz, F., & Piattini, M. (2008b). SMML: Software measurement modeling language. The 8th OOPSLA workshop on domain-specific modeling, pp. 52–59. Mora, B., García, F., Ruiz, F., & Piattini, M. (2008b). SMML: Software measurement modeling language. The 8th OOPSLA workshop on domain-specific modeling, pp. 52–59.
Zurück zum Zitat Mora, B., García, F., Ruiz, F., & Piattini, M. (2009). Model-driven software measurement framework: A case study. The 9th international conference on quality software, QSIC 2009, pp. 239–248. Mora, B., García, F., Ruiz, F., & Piattini, M. (2009). Model-driven software measurement framework: A case study. The 9th international conference on quality software, QSIC 2009, pp. 239–248.
Zurück zum Zitat Mora, B., García, F., Ruiz, F., Piattini, M., Boronat, A., Gómez, A., Carsí, J. Á., & Ramos, I. (2008a). Software measurement by using QVT transformation in an MDA context. 10th International conference on enterprise information systems—ICEIS 2008, 1, pp. 117–124. Mora, B., García, F., Ruiz, F., Piattini, M., Boronat, A., Gómez, A., Carsí, J. Á., & Ramos, I. (2008a). Software measurement by using QVT transformation in an MDA context. 10th International conference on enterprise information systems—ICEIS 2008, 1, pp. 117–124.
Zurück zum Zitat Oinn, T., Greenwood, M., Addis, M., Alpdemir, N., Ferris, J., Glover, K., et al. (2006). Taverna: Lessons in creating a workflow environment for the life sciences. Concurrency and Computation: Practice and Experience, 18(10), 1067–1100.CrossRef Oinn, T., Greenwood, M., Addis, M., Alpdemir, N., Ferris, J., Glover, K., et al. (2006). Taverna: Lessons in creating a workflow environment for the life sciences. Concurrency and Computation: Practice and Experience, 18(10), 1067–1100.CrossRef
Zurück zum Zitat OMG. (2003). OCL 2.0—OMG final adopted specification, Object Management Group. OMG. (2003). OCL 2.0OMG final adopted specification, Object Management Group.
Zurück zum Zitat OMG. (2005a). Query/view/transformation (QVT) Standard Specification. OMG. (2005a). Query/view/transformation (QVT) Standard Specification.
Zurück zum Zitat Özgür, T. (2007). Comparison of Microsoft DSL tools and eclipse modeling frameworks for domain-specific modeling in the context of the model driven development. School of Engineering. Ronneby, Sweden, Blekinge Institute of Technology: p. 56. Özgür, T. (2007). Comparison of Microsoft DSL tools and eclipse modeling frameworks for domain-specific modeling in the context of the model driven development. School of Engineering. Ronneby, Sweden, Blekinge Institute of Technology: p. 56.
Zurück zum Zitat Pandey, R. K., & Burnett, M. M. (1993). Is it easier to write matrix manipulation programs visually or textually? An empirical study. IEEE symposium on visual languages, pp. 344–351. Pandey, R. K., & Burnett, M. M. (1993). Is it easier to write matrix manipulation programs visually or textually? An empirical study. IEEE symposium on visual languages, pp. 344–351.
Zurück zum Zitat Patig, S. (2008). A practical guide to testing the understandability of notations. Fifth Asia-Pacific conference on conceptual modelling (APCCM 2008), pp. 49–55. Patig, S. (2008). A practical guide to testing the understandability of notations. Fifth Asia-Pacific conference on conceptual modelling (APCCM 2008), pp. 49–55.
Zurück zum Zitat Pelechano, V., Albert, M., Javier, M., & Carlos, C. (2006). Building tools for model driven development comparing Microsoft DSL tools and eclipse modeling plug-ins. Desarrollo de Software Dirigido por Modelos—DSDM’06. Pelechano, V., Albert, M., Javier, M., & Carlos, C. (2006). Building tools for model driven development comparing Microsoft DSL tools and eclipse modeling plug-ins. Desarrollo de Software Dirigido por Modelos—DSDM’06.
Zurück zum Zitat Shneiderman, B., Mayer, R., McKay, D., & Heller, P. (1977). Experimental investigations of the utility of detailed flowcharts in programming. Communications of the ACM, 20(6), 373–381.CrossRef Shneiderman, B., Mayer, R., McKay, D., & Heller, P. (1977). Experimental investigations of the utility of detailed flowcharts in programming. Communications of the ACM, 20(6), 373–381.CrossRef
Zurück zum Zitat Shull, F., Carver, J. C., Vegas, S., & Juzgado, N. J. (2008). The role of replications in empirical software engineering. Empirical Software Engineering, 13(2), 211–218.CrossRef Shull, F., Carver, J. C., Vegas, S., & Juzgado, N. J. (2008). The role of replications in empirical software engineering. Empirical Software Engineering, 13(2), 211–218.CrossRef
Zurück zum Zitat Völter, M. (2009). MD* Best practices. Journal of Object Technology, 8(6), 79–102.CrossRef Völter, M. (2009). MD* Best practices. Journal of Object Technology, 8(6), 79–102.CrossRef
Zurück zum Zitat Wohlin, C., Runeson, P., Höst, M., Ohlsson, M. C., Regnell, B., & Wesslén, A. (2000). Experimentation in software engineering: An introduction, International Series in Software Engineering. Wohlin, C., Runeson, P., Höst, M., Ohlsson, M. C., Regnell, B., & Wesslén, A. (2000). Experimentation in software engineering: An introduction, International Series in Software Engineering.
Zurück zum Zitat Yoder, M., & Black, B. (2006). A study of graphical vs. textual programming for teaching DSP. American Society for Engineering Education Annual Conference & Exposition. Yoder, M., & Black, B. (2006). A study of graphical vs. textual programming for teaching DSP. American Society for Engineering Education Annual Conference & Exposition.
Zurück zum Zitat Zhao, Y., Hategan, M., Clifford, B., Foster, I., Laszewski, G. V., Raicu, I., et al. (2007). Swift: Fast, reliable, loosely coupled parallel computation. 2007 IEEE Congress on Services, pp. 199–206. Zhao, Y., Hategan, M., Clifford, B., Foster, I., Laszewski, G. V., Raicu, I., et al. (2007). Swift: Fast, reliable, loosely coupled parallel computation. 2007 IEEE Congress on Services, pp. 199–206.
Metadaten
Titel
Graphical versus textual software measurement modelling: an empirical study
verfasst von
B. Mora
F. García
F. Ruiz
M. Piattini
Publikationsdatum
01.03.2011
Verlag
Springer US
Erschienen in
Software Quality Journal / Ausgabe 1/2011
Print ISSN: 0963-9314
Elektronische ISSN: 1573-1367
DOI
https://doi.org/10.1007/s11219-010-9111-x

Weitere Artikel der Ausgabe 1/2011

Software Quality Journal 1/2011 Zur Ausgabe

Premium Partner