Skip to main content
Top
Published in: Information Systems Frontiers 4/2017

06-02-2016

Empirical assessment of the accuracy of an interoperability prediction language

Authors: Johan Ullberg, Pontus Johnson

Published in: Information Systems Frontiers | Issue 4/2017

Log in

Activate our intelligent search to find suitable subject content or patents.

search-config
loading …

Abstract

Interoperability, defined as the satisfaction of a communication need between two or more actors, is an important aspect in many phases of an enterprise’s development. Mastering the field of interoperability is a daunting task so aid in predicting interoperability can be of great benefit. Formalisms capable of such predictions of future information system architectures are however sparse, and when employed, it is essential that the prediction is accurate. In this paper, a previously proposed interoperability modelling and prediction language is subjected to case testing and evaluated toward interoperability predictions made by practitioners and experts in the field. The results show that although there are some areas not currently covered by the framework, in general, it performs better than the intended users, and would thereby provide additional support in various development and design contexts.

Dont have a licence yet? Then find out more about our products and how to get one now:

Springer Professional "Wirtschaft+Technik"

Online-Abonnement

Mit Springer Professional "Wirtschaft+Technik" erhalten Sie Zugriff auf:

  • über 102.000 Bücher
  • über 537 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Maschinenbau + Werkstoffe
  • Versicherung + Risiko

Jetzt Wissensvorsprung sichern!

Springer Professional "Technik"

Online-Abonnement

Mit Springer Professional "Technik" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 390 Zeitschriften

aus folgenden Fachgebieten:

  • Automobil + Motoren
  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Elektrotechnik + Elektronik
  • Energie + Nachhaltigkeit
  • Maschinenbau + Werkstoffe




 

Jetzt Wissensvorsprung sichern!

Springer Professional "Wirtschaft"

Online-Abonnement

Mit Springer Professional "Wirtschaft" erhalten Sie Zugriff auf:

  • über 67.000 Bücher
  • über 340 Zeitschriften

aus folgenden Fachgebieten:

  • Bauwesen + Immobilien
  • Business IT + Informatik
  • Finance + Banking
  • Management + Führung
  • Marketing + Vertrieb
  • Versicherung + Risiko




Jetzt Wissensvorsprung sichern!

Footnotes
1
The course covers the use of architecture models as a means to assess various business and system properties, i.e. the approach used in the framework of this article, see (Ullberg 2009b) for more information.
 
Literature
go back to reference Agarwal, R., Kannan, R., & Tanniru, M. (1993). Formal validation of a knowledge-based system using a variation of the Turing test. Expert Systems with Applications, 6, 2.CrossRef Agarwal, R., Kannan, R., & Tanniru, M. (1993). Formal validation of a knowledge-based system using a variation of the Turing test. Expert Systems with Applications, 6, 2.CrossRef
go back to reference Alberola, J.M., Botti, V., & Such, J.M. (2014). Advances in infrastructures and tools for multiagent systems. Information Systems Frontiers, 16(2). Alberola, J.M., Botti, V., & Such, J.M. (2014). Advances in infrastructures and tools for multiagent systems. Information Systems Frontiers, 16(2).
go back to reference Baddeley, M. C., Curtis, A., & Wood, R. (2004). An introduction to prior information derived from probabilistic judgements: elicitation of knowledge, cognitive bias and herding. Geological Society, London, Special Publications, 239(1), 15–27.CrossRef Baddeley, M. C., Curtis, A., & Wood, R. (2004). An introduction to prior information derived from probabilistic judgements: elicitation of knowledge, cognitive bias and herding. Geological Society, London, Special Publications, 239(1), 15–27.CrossRef
go back to reference Berre, A.J., Elvesaeter, B., Figay, N., Guglielmina, C., Johnsen, S., Karlsen, D., et al. (2007). The ATHENA Interoperability Framework. In Proceedings of Interoperability for Enterprise Software and Applications (I-ESA). Berre, A.J., Elvesaeter, B., Figay, N., Guglielmina, C., Johnsen, S., Karlsen, D., et al. (2007). The ATHENA Interoperability Framework. In Proceedings of Interoperability for Enterprise Software and Applications (I-ESA).
go back to reference Blanc S., Ducq, Y., & Vallespir, B. (2007). A graph based approach for interoperability evaluation. In Interoperability for Enterprise Software and Applications (I-ESA). Blanc S., Ducq, Y., & Vallespir, B. (2007). A graph based approach for interoperability evaluation. In Interoperability for Enterprise Software and Applications (I-ESA).
go back to reference Booch, G., Rumbaugh, J., & Jacobson, I. (2005). Unified modeling language user guide, 2nd ed. Addison-Wesley. Booch, G., Rumbaugh, J., & Jacobson, I. (2005). Unified modeling language user guide, 2nd ed. Addison-Wesley.
go back to reference Chandrasekaran, B. (1983). On evaluating artificial intelligence systems for medical diagnosis. AI Magazine, 4(2), 34. Chandrasekaran, B. (1983). On evaluating artificial intelligence systems for medical diagnosis. AI Magazine, 4(2), 34.
go back to reference Chen, D., & Daclin, N. (2006). Framework for enterprise interoperability. In 2nd International Workshop on Enterprise Integration, Interoperability and Networking (EI2N). Chen, D., & Daclin, N. (2006). Framework for enterprise interoperability. In 2nd International Workshop on Enterprise Integration, Interoperability and Networking (EI2N).
go back to reference Daclin,N.,& Mallek, S. (2014). Capturing and structuring interoperability requirements: a framework for interoperability requirements. In 7th International Conference on Interoperability for Enterprises Systems and Applications (I-ESA 2014). Daclin,N.,& Mallek, S. (2014). Capturing and structuring interoperability requirements: a framework for interoperability requirements. In 7th International Conference on Interoperability for Enterprises Systems and Applications (I-ESA 2014).
go back to reference Department of Defense (DoD). 2004. DoD Architecture Framework, version 1.0. Department of Defense (DoD). 2004. DoD Architecture Framework, version 1.0.
go back to reference GridWise Architecture Council (2008). GridWise Interoperability Context-Setting Framework v1.1. GridWise Architecture Council (2008). GridWise Interoperability Context-Setting Framework v1.1.
go back to reference IDABC (2004). Enterprise and industry DG, European interoperability framework for pan-European egovernment services. version 1.0. Brussels. IDABC (2004). Enterprise and industry DG, European interoperability framework for pan-European egovernment services. version 1.0. Brussels.
go back to reference Johnson, P., Ullberg, J., Buschle, M., Franke, U., & Shahzad, K. (2014). An architecture modeling framework for probabilistic prediction. Information Systems and e-Business Management. doi:10.1007/s10257-014-0241-8. Johnson, P., Ullberg, J., Buschle, M., Franke, U., & Shahzad, K. (2014). An architecture modeling framework for probabilistic prediction. Information Systems and e-Business Management. doi:10.​1007/​s10257-014-0241-8.
go back to reference Kasunic, M., & Anderson, W. (2004). Measuring systems interoperability: Challenges and opportunities. Technical Note, CMU/SEI-2004-TN-003, Pittsburgh: Software Engineering Institute, Carnegie Mellon University. Kasunic, M., & Anderson, W. (2004). Measuring systems interoperability: Challenges and opportunities. Technical Note, CMU/SEI-2004-TN-003, Pittsburgh: Software Engineering Institute, Carnegie Mellon University.
go back to reference Kynn, M. (2008). The ‘heuristics and biases’ bias in expert elicitation. Journal of the Royal Statistical Society: Series A (Statistics in Society), 171(1), 239–264. Kynn, M. (2008). The ‘heuristics and biases’ bias in expert elicitation. Journal of the Royal Statistical Society: Series A (Statistics in Society), 171(1), 239–264.
go back to reference Lankhorst, M. (2013). Enterprise architecture at work (3rd ed.). Berlin: Springer Verlag.CrossRef Lankhorst, M. (2013). Enterprise architecture at work (3rd ed.). Berlin: Springer Verlag.CrossRef
go back to reference Lauras, M., Benaben, F., Truptil, S., & Charles, A. (2015). Event-cloud platform to support decision-making in emergency management. Information Systems Frontiers, 17(4), 857–869.CrossRef Lauras, M., Benaben, F., Truptil, S., & Charles, A. (2015). Event-cloud platform to support decision-making in emergency management. Information Systems Frontiers, 17(4), 857–869.CrossRef
go back to reference Mallek, S., Daclin, N., & Chaprulat, V. (2012). The application of interoperability requirement specification and verification to collaborative processes in industry. Computers in Industry, 63, 642–658.CrossRef Mallek, S., Daclin, N., & Chaprulat, V. (2012). The application of interoperability requirement specification and verification to collaborative processes in industry. Computers in Industry, 63, 642–658.CrossRef
go back to reference Matthes, F., Buckl, S., Leitel, J., & Schweda, C. M. (2008). Enterprise Architecture Management Tool Survey 2008, Technical Report, Chair for informatics 19 (sebis), Technische Universität München. Matthes, F., Buckl, S., Leitel, J., & Schweda, C. M. (2008). Enterprise Architecture Management Tool Survey 2008, Technical Report, Chair for informatics 19 (sebis), Technische Universität München.
go back to reference Meyer, M.A., & Booker, J.M. (2001). Eliciting and analyzing expert judgment: A practical guide. Siam. Meyer, M.A., & Booker, J.M. (2001). Eliciting and analyzing expert judgment: A practical guide. Siam.
go back to reference Ministry of Defence (MOD) (2008). MOD Architecture Framework version 1.2.003, Technical report. Ministry of Defence (MOD) (2008). MOD Architecture Framework version 1.2.003, Technical report.
go back to reference Morgan, M. G., Henrion, M., & Small, M. (1992). Uncertainty: A guide to dealing with uncertainty in quantitative risk and policy analysis. Cambridge University Press. Morgan, M. G., Henrion, M., & Small, M. (1992). Uncertainty: A guide to dealing with uncertainty in quantitative risk and policy analysis. Cambridge University Press.
go back to reference Morris, E., Levine, L., Meyers, C., Place, P., & Plakosh, D. (2004). Systems of systems interoperability: Final Report. Technical Report CMU/SEI-2004-TR-004 Pittsburgh: Software Engineering Institute, Carnegie Mellon University. Morris, E., Levine, L., Meyers, C., Place, P., & Plakosh, D. (2004). Systems of systems interoperability: Final Report. Technical Report CMU/SEI-2004-TR-004 Pittsburgh: Software Engineering Institute, Carnegie Mellon University.
go back to reference O’Keefe, R.M., & O’Leary, D.E. (1993). Expert system verification and validation: a survey and tutorial. Artificial Intelligence Review 7, 3–42. Kluwer Academic Publishers. O’Keefe, R.M., & O’Leary, D.E. (1993). Expert system verification and validation: a survey and tutorial. Artificial Intelligence Review 7, 3–42. Kluwer Academic Publishers.
go back to reference Object Management Group (OMG) (2006). Meta Object Facility (MOF) Core Specification, version 2.0 formal/06-01-01. Object Management Group (OMG) (2006). Meta Object Facility (MOF) Core Specification, version 2.0 formal/06-01-01.
go back to reference Object Management Group (OMG) (2009). OMG Unified Modeling Language (OMG UML), Superstructure Version 2.2. Object Management Group (OMG) (2009). OMG Unified Modeling Language (OMG UML), Superstructure Version 2.2.
go back to reference Object Management Group (OMG) (2010). Object Constraint Language specification, version 2.2 formal/2010-02-01. Object Management Group (OMG) (2010). Object Constraint Language specification, version 2.2 formal/2010-02-01.
go back to reference Ruokolainen, T., Naudet, Y., & Latour, T. (2007). An ontology of interoperability in inter-enterprise communities. In Interoperability for enterprise software and applications (I-ESA). Ruokolainen, T., Naudet, Y., & Latour, T. (2007). An ontology of interoperability in inter-enterprise communities. In Interoperability for enterprise software and applications (I-ESA).
go back to reference Rushby, J. (1988). Quality measures and assurance for AI software. Vol. 4187. National Aeronautics and Space Administration, Scientific and Technical Information Division. Rushby, J. (1988). Quality measures and assurance for AI software. Vol. 4187. National Aeronautics and Space Administration, Scientific and Technical Information Division.
go back to reference Saleem, A., Honeth, N., & Norstrom, L. (2010). A case study of multi-agent interoperability in IEC 61850 environments, in Innovative Smart Grid Technologies Conference Europe (ISGT Europe). Saleem, A., Honeth, N., & Norstrom, L. (2010). A case study of multi-agent interoperability in IEC 61850 environments, in Innovative Smart Grid Technologies Conference Europe (ISGT Europe).
go back to reference Solhström, J. (2013). Investigation of the applicability of the framework IF/ELSE on healthcare situations. MSc thesis, KTH – Royal Institute of technology, Stockholm. Solhström, J. (2013). Investigation of the applicability of the framework IF/ELSE on healthcare situations. MSc thesis, KTH – Royal Institute of technology, Stockholm.
go back to reference Sommestad, T. (2012). A Freamework and theory for cyber security assessments. PhD Thesis, KTH – Royal Institute of Technology, Stockholm. Sommestad, T. (2012). A Freamework and theory for cyber security assessments. PhD Thesis, KTH – Royal Institute of Technology, Stockholm.
go back to reference The Institute of Electrical and Electronics Engineers (1990). Standard Glossary of Software Engineering Terminology, Std 610.12, New York. The Institute of Electrical and Electronics Engineers (1990). Standard Glossary of Software Engineering Terminology, Std 610.12, New York.
go back to reference Tolk, A., & Muguira, J.A. (2003). The Levels of Conceptual Interoperability Model. In The 2003 Fall Simulation Interoperability Workshop. Tolk, A., & Muguira, J.A. (2003). The Levels of Conceptual Interoperability Model. In The 2003 Fall Simulation Interoperability Workshop.
go back to reference Tversky, A., & Kahneman, D. (1974). Judgment under uncertainty: heuristics and biases. Science, 185(4157), 1124–1131.CrossRef Tversky, A., & Kahneman, D. (1974). Judgment under uncertainty: heuristics and biases. Science, 185(4157), 1124–1131.CrossRef
go back to reference Ullberg, J. (2012a). OCL statements for interoperability prediction, Technical report, KTH – Royal Institute of technology TRITA-EE 2012:033. Ullberg, J. (2012a). OCL statements for interoperability prediction, Technical report, KTH – Royal Institute of technology TRITA-EE 2012:033.
go back to reference Ullberg, J. (2012b). Application of a Language for Interoperability Prediction, Technical report, KTH – Royal Institute of technology TRITA-EE 2012:034. Ullberg, J. (2012b). Application of a Language for Interoperability Prediction, Technical report, KTH – Royal Institute of technology TRITA-EE 2012:034.
go back to reference Ullberg, J., Chen, D., & Johnson, P. (2009a). Barriers to enterprise interoperability. In 2nd IFIP WG5.8 Workshop on Enterprise Interoperability (IWEI) pp. 13–29. Ullberg, J., Chen, D., & Johnson, P. (2009a). Barriers to enterprise interoperability. In 2nd IFIP WG5.8 Workshop on Enterprise Interoperability (IWEI) pp. 13–29.
go back to reference Ullberg, J., Johnson, P., & Lagerström, R. (2009b). Education in Enterprise Architecture Analysis – Assessing interoperability of service oriented architectures. In 5th China – Europe International Symposium on Software Industry Oriented Education (CEISIE). Ullberg, J., Johnson, P., & Lagerström, R. (2009b). Education in Enterprise Architecture Analysis – Assessing interoperability of service oriented architectures. In 5th China – Europe International Symposium on Software Industry Oriented Education (CEISIE).
go back to reference Ullberg, J., Franke, U., Buschle, M., & Johnson, P. (2010). A tool for interoperability analysis of enterprise architecture models using P-OCL. In Proceedings of the International conference on Interoperability for Enterprise Software and Applications. Ullberg, J., Franke, U., Buschle, M., & Johnson, P. (2010). A tool for interoperability analysis of enterprise architecture models using P-OCL. In Proceedings of the International conference on Interoperability for Enterprise Software and Applications.
go back to reference Ullberg, J., Johnson, P., & Björkman, G. (2014).“A SCADA-specific interoperability modelling and prediction language” Submitted. Ullberg, J., Johnson, P., & Björkman, G. (2014).“A SCADA-specific interoperability modelling and prediction language” Submitted.
go back to reference Zachman, J.A. (1987). A framework for information systems architecture. IBM Systems Journal, 26 (3). Zachman, J.A. (1987). A framework for information systems architecture. IBM Systems Journal, 26 (3).
Metadata
Title
Empirical assessment of the accuracy of an interoperability prediction language
Authors
Johan Ullberg
Pontus Johnson
Publication date
06-02-2016
Publisher
Springer US
Published in
Information Systems Frontiers / Issue 4/2017
Print ISSN: 1387-3326
Electronic ISSN: 1572-9419
DOI
https://doi.org/10.1007/s10796-016-9630-5

Other articles of this Issue 4/2017

Information Systems Frontiers 4/2017 Go to the issue

Premium Partner