Claus Ballegaard Nielsen
Skip Abstract Section
Abstract
The term “System of Systems” (SoS) has been used since the 1950s to describe systems that are composed of independent constituent systems, which act jointly towards a common goal through the synergism between them. Examples of SoS arise in areas such as power grid technology, transport, production, and military enterprises. SoS engineering is challenged by the independence, heterogeneity, evolution, and emergence properties found in SoS. This article focuses on the role of model-based techniques within the SoS engineering field. A review of existing attempts to define and classify SoS is used to identify several dimensions that characterise SoS applications. The SoS field is exemplified by a series of representative systems selected from the literature on SoS applications. Within the area of model-based techniques the survey specifically reviews the state of the art for SoS modelling, architectural description, simulation, verification, and testing. Finally, the identified dimensions of SoS characteristics are used to identify research challenges and future research areas of model-based SoS engineering.
- Russ Abbott. 2006. Open at the top; open at the bottom; and continually (but slowly) evolving. In 2006 IEEE/SMC International Conference on System of Systems Engineering. IEEE.Google Scholar
Cross Ref
- Russell L. Ackoff. 1971. Towards a system of systems concept. Management Science 17, 11 (July 1971), 661--671.Google ScholarCross Ref
- Datu Buyung Agusdinata and Daniel DeLaurentis. 2008. Specification of system-of-systems for policymaking in the energy sector. Integrated Assessment Journal 8, 2 (2008), 1--24.Google Scholar
- Andrea Arcuri, Muhammad Zohaib Iqbal, and Lionel Briand. 2010. Black-box system testing of real-time embedded systems using random and search-based testing. In 22nd IFIP International Conference on Testing Software and Systems (ICTSS’10). Springer-Verlag, 95--110. Google ScholarDigital Library
- Robert Axelrod. 1997. The Complexity of Cooperation: Agent-Based Models of Competition and Collaboration. Princeton University Press.Google Scholar
- J. Bach and P. Schroeder. 2004. Pairwise testing—A best practice that isn’t. In 22nd Pacific Northwest Software Quality Conference. 180--196.Google Scholar
- Paul Baker, Zhen Ru Dai, Jens Grabowski, Øystein Haugen, Ina Schieferdecker, and Clay Williams. 2008. Model Driven Testing—Using the UML Testing Profile. Springer. Google ScholarDigital Library
- W. C. Baldwin and B. Sauser. 2009. Modeling the characteristics of system of systems. In IEEE International Conference on System of Systems Engineering (SoSE’09). IEEE.Google Scholar
- J. W. Ball, Sr. 1997. Free flight an air traffic management partnership. In 16th Digital Avionics Systems Conference, 1997, AIAA/IEEE, Vol. 2. IEEE, 9--1.Google ScholarCross Ref
- Yaneer Bar-Yam, Mary Ann Allison, Ron Batdorf, Hao Chen, Hoa Generazio, Harcharanjit Singh, and Steve Tucker. 2004. The characteristics and emerging behaviors of system of systems. NECSI: Complex Physical, Biological and Social Systems Project, 1--16.Google Scholar
- Mark A. Bedau. 1997. Weak emergence. In Philosophical Perspectives: Mind, Causation, and World. Vol. 11. Blackwell, 375--399.Google Scholar
- H. Berenji and M. Jamshidi. 2011. Fuzzy reinforcement learning for system of systems (SoS). In 2011 IEEE International Conference on Fuzzy Systems (FUZZ). 1689--1694.Google Scholar
- Brian J. L. Berry. 1964. Cites as systems within system of cites. Papers and Proceedings of the Regional Science Association 13, 1 (Jan. 1964), 149--163.Google ScholarCross Ref
- Antoine Beugnard, Jean-Marc Jezequel, Noel Plouzeau, and Damien Watkins. 1999. Making components contract aware. IEEE Computer (July 1999), 38--45. Google ScholarDigital Library
- Robin Bloomfield and Ilir Gashi. 2008. Evaluating the Resilience and Security of Boundaryless, Evolving Socio-Technical Systems of Systems. Technical Report. Centre for Software Reliability, City University.Google Scholar
- John Boardman and Brian Sauser. 2006. System of systems—The meaning of “of.” In 2006 IEEE/SMC International Conference on System of Systems Engineering. IEEE.Google ScholarCross Ref
- Barry Boehm. 2006. A view of 20th and 21st century software engineering. In 28th International Conference on Software Engineering (ICSE’06). ACM, 12--29. Google ScholarDigital Library
- Kenneth E. Boulding. 1956. General systems theory—The skeleton of science. Management Science 2, 3 (April 1956).Google ScholarDigital Library
- Jörg Brauer, Jan Peleska, and Uwe Schulze. 2012. Efficient and trustworthy tool qualification for model-based testing tools. In Testing Software and Systems (LNCS). Springer, Berlin, 8--23. DOI:http://dx.doi.org/10.1007/978-3-642-34691-0_3Google Scholar
- J. Bryans, J. Fitzgerald, R. Payne, and K. Kristensen. 2014. Maintaining emergence in systems of systems integration: A contractual approach using SysML. In INCOSE International Symposium on System Engineeering. INCOSE.Google Scholar
- Dale S. Caffall and James Bret Michael. 2004. A new paradigm for requirements specification and analysis of system-of-systems. In Radical Innovations of Software and Systems Engineering in the Future, 9th International Workshop, RISSEF 2002 (LNCS), Vol. 2941. Springer, 108--121.Google Scholar
- Radu Calinescu and Marta Z. Kwiatkowska. 2009. Using quantitative analysis to implement autonomic IT systems. In 31st International Conference on Software Engineering (ICSE’09). 100--110. Google ScholarDigital Library
- Radu Calinescu and Marta Z. Kwiatkowska. 2010. Software engineering techniques for the development of Systems of Systems. In Foundations of Computer Software. Future Trends and Techniques for Development, 15th Monterey Workshop 2008 (LNCS), Vol. 6028. Springer, 59--82. Google ScholarDigital Library
- James E. Campbell, Dennis E. Longsine, Donald Shirah, and Dennis J. Anderson. 2005. System of Systems Modeling and Analysis. Technical Report SAND2005-0020. Sandia National Laboratories.Google Scholar
- Pascal Cantot and Dominique Luzeaux. 2009. Simulation et Modélisation des Systèmes de Systèmes: Vers la Maîtrise de la Complexité. Hermes Science Publications.Google Scholar
- Pascal Cantot and Dominique Luzeaux. 2011. Simulation and Modeling of Systems of Systems. Wiley.Google Scholar
- Paul G. Carlock and Robert E. Fenton. 2001. System of systems (SoS) enterprise systems engineering for information-intensive organizations. Systems Engineering 4, 4 (2001), 242--261.Google ScholarCross Ref
- David Carney, David Fasher, and Patrick Place. 2005. Topics in Interoperability: System-of-Systems Evolution. Technical Report CMU/SEI-2005-TN-002. Software Engineering Institute, Carnegie Mellon University.Google Scholar
- Peter Checkland. 1999. Systems Thinking, Systems Practice: Includes a 30-Year Retrospective. Wiley.Google Scholar
- Pin Chen and Jennie Clothier. 2003. Advancing systems engineering for systems-of-systems challenges. Systems Engineering 6, 3 (May 2003), 170--183.Google ScholarCross Ref
- Tsun S. Chow. 1978. Testing software design modeled by finite-state machines. IEEE Transactions on Software Engineering SE-4, 3 (March 1978), 178--186. Google ScholarDigital Library
- H. Q. Nguyen, C. Kaner, and J. Falk. 1999. Testing Computer Software. Wiley. Google ScholarDigital Library
- Dan Cocks. 2006. How should we use the term “System of Systems” and why should we care? In 16th INCOSE International Symposium 2006. INCOSE.Google ScholarCross Ref
- Joey W. Coleman, Anders Kaels Malmos, Peter Gorm Larsen, Jan Peleska, Ralph Hains, Zoe Andrews, Richard Payne, Simon Foster, Alvaro Miyazawa, Cristiano Bertolini, and André Didier. 2012. COMPASS tool vision for a system of systems collaborative development environment. In 7th International Conference on System of System Engineering (SoSE’12). 451--456.Google ScholarCross Ref
- John Colombi, Brannen C. Cohee, and Chuck W. Turner. 2008. Interoperability test and evaluation: A systems of systems field study. The Journal of Defense Software Engineering (Nov. 2008), 10--14.Google Scholar
- S. Cook, E. Lawson, and J. Allison. 1999. Towards a unified systems methodology for Australian defence systems-of-systems. Proceedings of the 9th INCOSE International Symposium (June 1999).Google Scholar
- S. C. Cook. 2001. On the acquisition of systems of systems. 2001 INCOSE International Symposium (July 2001).Google Scholar
- Luís Diogo Couto and Richard Payne. 2013. The COMPASS proof obligation generator: A test case of Overture extensibility. In 11th Overture Workshop.Google Scholar
- W. A. Crossley. 2004. System of systems: An introduction of Purdue University schools of Engineering’s Signature Area. In Engineering Systems Symposium. MIT Engineering Systems Division.Google Scholar
- J. Dahmann. 2014. Systems of systems pain points. In INCOSE International Symposium on Systems Engineering 2014.Google Scholar
- Judith Dahmann and Kristen Baldwin. 2008. Understanding the current state of US defense systems of systems and the implications for systems engineering. In IEEE Systems Conference. IEEE.Google ScholarCross Ref
- Judith S. Dahmann, George Rebovich, Jr., and Jo Ann Lane. 2008. Systems engineering for capabilities. CrossTalk Journal (The Journal of Defense Software Engineering) 21, 11 (Nov. 2008), 4--9.Google Scholar
- K. Daniel, B. Dusza, A. Lewandowski, and C. Wietfeld. 2009. AirShield: A system-of-systems MUAV remote sensing architecture for disaster response. In 2009 3rd Annual IEEE Systems Conference. 196--200.Google Scholar
- Giuseppe DeCandia, Deniz Hastorun, Madan Jampani, Gunavardhan Kakulapati, Avinash Lakshman, Alex Pilchin, Swaminathan Sivasubramanian, Peter Vosshall, and Werner Vogels. 2007. Dynamo: Amazon’s highly available key-value store. In 21st ACM SIGOPS Symposium on Operating Systems Principles (SOSP’07). ACM, 205--220. Google ScholarDigital Library
- Daniel A. DeLaurentis. 2005. Understanding transportation as system-of-systems design problem. In 43rd AIAA Aerospace Sciences Meeting and Exhibit. AIAA.Google ScholarCross Ref
- Daniel A. DeLaurentis and W. A. Crossley. 2005. A taxonomy-based perspective for systems of systems design methods. In IEEE International Conference on Systems, Man and Cybernetics. IEEE, 86--91.Google Scholar
- Department of Defense. 2004. Defense Acquisition Guidebook. https://dag.dau.mil/Pages/Default.aspx.Google Scholar
- G. Despotou, R. Alexander, and M. Hall-May. 2003. Key Concepts and Characteristics of Systems of Systems (SoS). DARP - HIRTS. University of York.Google Scholar
- T. Dillon, V. Potdar, J. Singh, and A. Talevski. 2011. Cyber-physical systems: Providing quality of service (QoS) in a heterogeneous systems-of-systems environment. In 5th IEEE International Conference on Digital Ecosystems and Technologies (DEST’11). 330--335.Google Scholar
- D. Drusinksy and Man-Tak Shing. 2005. Creation and evaluation of formal specifications for system-of-systems development. In IEEE International Conference on Systems, Man and Cybernetics. IEEE, 1864--1869.Google ScholarCross Ref
- Doron Drusinsky. 2003. Monitoring temporal rules combined with time series. In 15th International Conference on Computer Aided Verification (CAV’03) (LNCS), Vol. 2725. Springer, 114--117.Google ScholarCross Ref
- John P. Eddy, Dennis J. Anderson, Craig R. Lawton, and James E. Campbell. 2007. Network and Adaptive System of Systems Modeling and Analysis. Technical Report SAND2007-2788. Sandia National Laboratories.Google Scholar
- H. Eisner, J. Marciniak, and R. McMillan. 1991. Computer-aided system of systems (S2) engineering. In IEEE International Conference on Systems, Man, and Cybernetics, 1991. Vol. 1. 531--537.Google Scholar
- European Commission. 2012. Directions in Systems of Systems Engineering. Technical Report. European Commission, Communications Networks, Content and Technology Directorate—General Unit A3-DG CONNECT.Google Scholar
- David A. Fisher. 2006. An Emergent Perspective on Interoperation in Systems of Systems. Technical Report. CMU/SEI-2006-TR-003. Software Engineering Institute, Carnegie Mellon University.Google Scholar
- John Fitzgerald, Peter Gorm Larsen, and Jim Woodcock. 2012. Modelling and analysis technology for systems of systems engineering: Research challenges. In INCOSE.Google Scholar
- M. T. Gamble and R. F. Gamble. 2008. Reasoning about hybrid system of systems designs. In 7th International Conference on Composition-Based Software Systems (ICCBSS’08). 154--163. Google ScholarDigital Library
- N. D. Geddes, D. M. Smith, and C. S. Lizza. 1998. Fostering collaboration in systems of systems. In 1998 IEEE International Conference on Systems, Man, and Cybernetics, 1998. IEEE, 950--954, Vol. 1.Google Scholar
- Alberto Gonzalez, Eric Piel, Hans-Gerhard Gross, and Maurice Glandrup. 2008. Testing challenges of maritime safety and security systems-of-systems. In Testing: Academic & Industrial Conference——Practice and Research Techniques. IEEE Computer Society, 35--39. Google ScholarDigital Library
- A. Gorod, B. Sauser, and J. Boardman. 2008. System-of-systems engineering management: A review of modern history and a path forward. IEEE Systems Journal 2, 4 (Dec. 2008), 484--499.Google ScholarCross Ref
- Wolfgang Grieskamp. 2010. Microsoft’s protocol documentation program: A success story for model-based testing. In Testing—Practice and Research Techniques, 5th International Academic and Industrial Conference, TAIC PART 2010. (Lecture Notes in Computer Science), Vol. 6303, Leonardo Bottaci and Gordon Fraser (Eds.). Springer, 7. DOI:http://dx.doi.org/10.1007/978-3-642-15585-7_3 Google ScholarDigital Library
- J. O. Gutierrez-Garcia, F. F. Ramos-Corchado, and J.-L. Koning. 2009. Obligations as constrainers, descriptors, and linkers of open system of systems. In IEEE International Conference on System of Systems Engineering (SoSE’09). 1--6.Google Scholar
- Stefan Hallerstede, Finn Overgaard Hansen, Jon Holt, Rasmus Lauritsen, Lasse Lorenzen, and Jan Peleska. 2012. Technical challenges of SoS requirements engineering. In 7th International Conference on System of System Engineering (SoSE’12). IEEE, 573--578.Google ScholarCross Ref
- D. Harel. 1987. StateCharts: A visual formalism for complex systems. Science of Computer Programming 8, 3 (1987), 231--274. Google ScholarDigital Library
- K. Harmon. 2005. The “systems” nature of enterprise architecture. In 2005 IEEE International Conference on Systems, Man and Cybernetics. IEEE, 78--85, Vol. 1.Google ScholarCross Ref
- Klaus Havelund and Grigore Rosu. 2001. Monitoring programs using rewriting. In 16th IEEE International Conference on Automated Software Engineering (ASE’01). 135--143. Google ScholarDigital Library
- Derek K. Hitchins. 2005. Systems methodology. In Conference on Systems Engineering Research.Google Scholar
- C. A. R. Hoare. 1978. Communicating sequential processes. Communations of the ACM 21, 8 (Aug. 1978). Google ScholarDigital Library
- C. A. R. Hoare, Jayadev Misra, Gary T. Leavens, and Natarajan Shankar. 2009. The verified software initiative: A manifesto. ACM Computing Surveys 41, 4, Article 22 (Oct. 2009), 8 pages. Google ScholarDigital Library
- Jon Holt. 2012. Model-based requirements engineering for system of systems. In IEEE 7th International Conference on System of System Engineering (SoSE’12). IEEE.Google ScholarCross Ref
- J. Holt and S. Perry. 2008. SysML for Systems Engineering. IET. Google ScholarDigital Library
- IEC61508-3. 2010. IEC61508-3: Functional safety of electrical/electronic/programmable electronic safety-related systems—Part 3: Software Requirements. International Electrotechnical Commission.Google Scholar
- IEEE1516 2010. IEEE standard for modeling and simulation: High level architecture (HLA)—Framework and rules. IEEE Std 1516-2010 (Revision of IEEE Std 1516-2000) (Aug. 2010), 1--38.Google Scholar
- M. D. Ilić, Le Xie, U. A. Khan, and J. M. F. Moura. 2010. Modeling of future cyber-physical energy systems for distributed sensing and control. IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans 40, 4 (2010), 825--838. Google ScholarDigital Library
- INCOSE. 2011. Systems Engineering Handbook. A Guide for System Life Cycle Processes and Activities, Version 3.2.2. Technical Report INCOSE-TP-2003-002-03.2.2. International Council on Systems Engineering (INCOSE).Google Scholar
- INCOSE. 2015. INCOSE Systems Engineering Handbook: A Guide for System Life Cycle Processes and Activities, Version 3.2.2. (4th ed.). Wiley.Google Scholar
- C. Ingram, R. Payne, S. Perry, J. Holt, F. O. Hansen, and L. D. Couto. 2014. Modelling patterns for systems of systems architectures. In International Systems Conference (SysCon’14). IEEE.Google Scholar
- International Organization for Standardization. 2009. ISO 26262—Road Vehicles—Functional Safety—Part 6: Product Development: Software Level. ICS 43.040.10.Google Scholar
- International Organization for Standardization. 2015. ISO/IEC/IEEE 15288—Systems and Software Eningeering—System Life Cycle Processes.Google Scholar
- M. C. Jackson and P. Keys. 1984. Towards a system of systems methodologies. The Journal of the Operational Research Society 35, 6 (June 1984), 473--486.Google ScholarCross Ref
- Francçois Jacob. 1974. The Logic of Living Systems: A History of Heredity. Allen Lane.Google Scholar
- M. Jamshidi. 2005. System-of-systems engineering—A definition. In International Conference on Systems, Man, and Cybernetics. IEEE.Google Scholar
- M. Jamshidi. 2008. System of systems engineering—New challenges for the 21st century. IEEE Aerospace and Electronic Systems Magazine 23, 5 (May 2008), 4--19.Google ScholarCross Ref
- Xiong Jian, Ge Bing-feng, Zhang Xiao-ke, Yang Ke-wei, and Chen Ying-wu. 2010. Evaluation method of system-of-systems architecture using knowledge-based executable model. In 2010 International Conference on Management Science and Engineering (ICMSE). 141--147.Google ScholarCross Ref
- C. B. Jones. 1983a. Specification and design of (parallel) programs. In IFIP’83. IFIP, North-Holland, 321--332.Google Scholar
- Cliff B. Jones. 1983b. Tentative steps toward a development method for interfering programs. ACM Transactions on Programming Languages and Systems 5, 4 (Oct. 1983), 596--619. Google ScholarDigital Library
- Cem Kaner. 2003. Cem Kaner on scenario testing: The power of “what if...” and nine ways to fuel your imagination. Testing & Quality Engineering Magazine (October 2003).Google Scholar
- N. Karcanias and A. G. Hessami. 2010. Complexity and the notion of system of systems: Part (II): Defining the notion of system of systems. In World Automation Congress (WAC), 2010. 1--7.Google Scholar
- C. B. Keating. 2005. Research foundations for system of systems engineering. In 2005 IEEE International Conference on Systems, Man and Cybernetics. IEEE, 2720--2725.Google ScholarCross Ref
- Charles Keating, Ralph Rogers, Resit Unal, David Dryer, Andres Sousa-Poza, Robert Safford, William Peterson, and Ghaith Rabadi. 2003. System of system engineering. Engineering Management Journal 15, 3 (2003), 36--45.Google ScholarCross Ref
- N. Kilicay-Ergin and C. Dagli. 2008. Executable modeling for system of systems architecting: An artificial life framework. In 2008 2nd Annual IEEE Systems Conference. 1--5.Google Scholar
- Vadim. Kotov. 1997. Systems-of-Systems as Communicating Structures. Technical Report HPL-97-124. Hewlett Packard Computer Systems Laboratory Paper.Google Scholar
- Jeff Kramer. 2007. Is abstraction the key to computing? Communications of the ACM 50, 4 (2007), 37--42. DOI:http://dx.doi.org/10.1145/1232743.1232745 Google ScholarDigital Library
- Anette J. Krygiel. 1999. Behind the Wizard’s Curtain, An Integration Environment for a System of Systems. CCRP publication series. Google ScholarDigital Library
- Jo Ann Lane and Ricardo Valerdi. 2007. Synthesizing SoS concepts for use in cost modeling. Systems Engineering 10, 4 (Dec. 2007), 297--308. Google ScholarDigital Library
- Michael Lees, Brian Logan, and Georgios Theodoropoulos. 2007. Distributed simulation of agent-based systems with HLA. ACM Transactions on Modeling and Computer Simulation 17, 3 (July 2007). Google ScholarDigital Library
- Nancy Leveson. 1995. SAFEWARE: System Safety and Computers. Addison-Wesley. Google ScholarCross Ref
- Qianhui Liang and Stuart H. Rubin. 2009. Randomization for testing systems of systems. In IEEE International Conference on Information Reuse & Integration (IRI’’09). IEEE, 110--114. DOI:http://dx.doi.org/10.1109/IRI.2009.5211597 Google ScholarDigital Library
- Shiyong Liu. 2011. Employing system of systems engineering in China’s emergency management. 2010 4th Annual IEEE Systems Conference 5, 2 (April 2011), 541--546.Google ScholarCross Ref
- R. Lock and I. Sommerville. 2010. Modelling and analysis of socio-technical system of systems. In 15th IEEE International Conference on Engineering of Complex Computer Systems (ICECCS). 224--232. Google ScholarDigital Library
- Helge Löding and Jan Peleska. 2010. Timed Moore automata: Test data generation and model checking. In International Conference on Software Testing, Verification, and Validation (ICST’08). IEEE, 449--458. DOI:http://dx.doi.org/10.1109/ICST.2010.60 Google ScholarDigital Library
- Carsten Lucke, Sascha Krell, and Ulrike Lechner. 2010. Critical issues in enterprise architecting—A literature review. In AMCIS 2010 Proceedings.Google Scholar
- Marie Ludwig, Nicolas Farcet, Jean-Philippe Babau, and Joël Champeau. 2011. Integrating design and runtime variability support into a system ADL. In 7th European Conference on Modelling Foundations and Applications. Springer-Verlag, 270--281. Google ScholarDigital Library
- Stephen J. Lukasik. 1998. Systems, systems of systems, and the education of engineers. In AI EDAM, Vol. 12. Cambridge University, 55--60. Google ScholarDigital Library
- V. Mahulkar, S. McKay, D. E. Adams, and A. R. Chaturvedi. 2009. System-of-systems modeling and simulation of a ship environment with wireless and intelligent maintenance technologies. IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans, 39, 6 (Nov. 2009), 1255--1270. Google ScholarDigital Library
- Mark W. Maier. 1996. Architecting principles for systems-of-systems. In INCOSE 1996 6th Annual International Symposium of the International Council on Systems Engineering. INCOSE.Google ScholarCross Ref
- Mark W. Maier. 1998a. Architecting principles for systems-of-systems. Systems Engineering 1, 4 (1998), 267--284.Google ScholarCross Ref
- Mark W. Maier. 1998b. Architecting principles for systems-of-systems. The Information Architects Cooperative (TIAC) whitepaper, www.infoed.com/Open/PAPERS/systems.htm.Google Scholar
- Mark W. Maier. 2005. Research challenges for systems-of-systems. In 2005 IEEE International Conference onSystems, Man and Cybernetics. IEEE.Google ScholarCross Ref
- Mark W. Maier and Eberhardt Rechtin. 1997. The Art of Systems Architecting. CRC Press LLC. Google ScholarDigital Library
- Oded Maler and Dejan Nickovic. 2004. Monitoring temporal properties of continuous signals. In FORMATS 2004 and FTRTFT 2004 (LNCS), Vol. 3253. Springer, 152--166.Google ScholarCross Ref
- Mo Mansouri, Alex Gorod, Thomas H. Wakeman, and Brian Sauser. 2009. Maritime transportation system of systems management framework: A system of systems engineering approach. International Journal of Ocean Systems Management 1, 2 (2009), 200--226.Google ScholarCross Ref
- William H. J. Manthorpe. 1996. The emerging joint system of systems: A systems engineering challenge and opportunity for APL. John Hopkins APL Technical Digest 17, 3 (1996), 305--310.Google Scholar
- Fredrick Mauss, Juan Valencia, Brian Hatchell, Kurt Silvers, and Shannon Crowell. 2015. System of systems approaches for mobile source transit security. In 15th INCOSE International Symposium (IS’15). INCOSE.Google ScholarCross Ref
- Abe Meilich. 2006. System of systems (SoS) engineering & architecture challenges in a net centric environment. In 2006 IEEE/SMC International Conference on System of Systems Engineering. IEEE.Google ScholarCross Ref
- Bertrand Meyer. 1992. Applying design by contract. IEEE Computer 25, 10 (1992), 40--51. Google ScholarDigital Library
- J. B. Michael, R. Riehle, and Man-Tak Shing. 2009. The verification and validation of software architecture for systems of systems. In IEEE International Conference on System of Systems Engineering (SoSE’09). 1--6.Google Scholar
- Stefan Milius, Jan Peleska, and Martin Sulzmann. 2011. Contract Specification and Domain Specific Modeling Language for GALS Systems An Approach to System Validation. Technical Report. Technische Universität Braunschweig.Google Scholar
- M. Z. Miller, K. Griendling, and D. N. Mavris. 2012. Exploring human factors effects in the smart grid system of systems demand response. In 2012 7th International Conference on System of Systems Engineering. IEEE, 1--6.Google Scholar
- Saurabh Mittal, Bernard Zeigler, José Martin, Ferat Sahin, and Mo Jamshidi. 2009. System of Systems—Innovations for the 21st Century. Wiley. 101--149.Google Scholar
- Heiner Müller-Merbach. 1994. A system of systems approaches. Interfaces 24, 4 (1994), 16--25. Google ScholarDigital Library
- Claus Ballegaard Nielsen and Peter Gorm Larsen. 2012. Extending VDM-RT to enable the formal modelling of system of systems. In IEEE 7th International Conference on System of System Engineering (SoSE’12). IEEE.Google ScholarCross Ref
- Claus Ballegaard Nielsen, Kenneth Lausdahl, and Peter Gorm Larsen. 2012. Combining VDM with executable code. In Abstract State Machines, Alloy, B, VDM, and Z (Lecture Notes in Computer Science), Vol. 7316, John Derrick, John Fitzgerald, Stefania Gnesi, Sarfraz Khurshid, Michael Leuschel, Steve Reeves, and Elvinia Riccobene (Eds.). Springer-Verlag, Berlin, 266--279. http://dx.doi.org/10.1007/978-3-642-30885-7_19 ISBN 978-3-642-30884-0. Google ScholarDigital Library
- Eli M. Noam. 1994. Beyond liberalization: From the network of networks to the system of systems. Telecommunications Policy 18, 4 (May 1994), 286--294.Google ScholarCross Ref
- L. Northrop, P. Feiler, R. P. Gabriel, J. Goodenough, R. Linger, T. Longstaff, R. Kazman, M. Klein, D. Schmidt, K. Sullivan, and K. Wallnau. 2006. Ultra-Large-Scale Systems: The Software Challenge of the Future. Technical Report. Software Engineering Institute, Carnegie Mellon University, Pittsburgh, PA.Google Scholar
- OUSD(AT&L), DoD. 2008. Systems and Software Engineering. Systems Engineering Guide for Systems of Systems. Technical Report Version 1.0. Office of the Deputy Under Secretary of Defense for Acquisition and Technology, Department of Defense.Google Scholar
- A. William A. Owens. 1995. Dominant Battlespace Knowledge. Institute for National Strategic Studies, The Emerging U.S. System-of-Systems.Google Scholar
- Richard Payne, Jeremy Bryans, John Fitzgerald, and Steve Riddle. 2012. Interface specification for system-of-systems architectures. In IEEE 7th International Conference on System of System Engineering, (SoSE’12). IEEE.Google ScholarCross Ref
- Richard J. Payne and John S. Fitzgerald. 2010. Evaluation of Architectural Frameworks Supporting Contract-Based Specification. Technical Report CS-TR-1233. School of Computing Science, Newcastle University.Google Scholar
- R. S. Pei. 2000. Systems of systems integration (SoSI)-a smart way of acquiring army C4I2WS systems. In Summer Computer Simulation Conference.Google Scholar
- Jan Peleska. 2013. Industrial-strength model-based testing—State of the art and current challenges. Electronic Proceedings in Theoretical Computer Science abs/1303.1006, 3--28.Google ScholarCross Ref
- Jan Peleska, Artur Honisch, Florian Lapschies, Helge Löding, Hermann Schmid, Peer Smuda, Elena Vorobev, and Cornelia Zahlten. 2011. A real-world benchmark model for testing concurrent real-time systems in the automotive domain. In International Conference on Testing Software and Systems. (ICTSS’11) (LNCS), Vol. 7019. Springer, 146--161. Google ScholarDigital Library
- M. S. Phadke. 1989. Quality Engineering Using Robust Design. Prentice Hall. Google ScholarDigital Library
- Fiona Polack and Susan Stepney. 2005. Emergent properties do not refine. Electronic Notes in Theoretical Computer Science 137, 2 (2005), 163--181. Google ScholarDigital Library
- Fred R. Ricker and Ravi Kalakota. 1999. Order fulfillment: The hidden key to e-commerce success. Supply Chain Management Review 11, 3 (Fall 1999), 60--70.Google Scholar
- J. Ring and A. M. Madni. 2005. Key challenges and opportunities in “system of systems” engineering. In 2005 IEEE International Conference on Systems, Man and Cybernetics. 973--978.Google Scholar
- A. W. Roscoe. 2010. Understanding Concurrent Systems. Springer. Google ScholarDigital Library
- RTCA SC-205/EUROCAE WG-71. 2011a. Model-Based Development and Verification Supplement to DO-178C and DO-278A. Number RTCA/DO-331. RTCA, Inc., 1140 Connecticut Avenue, N.W., Suite 1020, Washington, D.C. 20036.Google Scholar
- RTCA SC-205/EUROCAE WG-71. 2011b. Software Considerations in Airborne Systems and Equipment Certification. Number RTCA/DO-178C. RTCA, Inc., 1140 Connecticut Avenue, N.W., Suite 1020, Washington, D.C. 20036.Google Scholar
- Andrew P. Sage and Christopher D. Cuppan. 2001. On the systems engineering and management of systems of systems and federations of systems. Information Knowledge Systems Management 2, 4 (Dec. 2001), 325--345. Google ScholarDigital Library
- F. Sahin, M. Jamshidi, and P. Sridhar. 2007. A discrete event XML based simulation framework for system of systems architectures. In IEEE International Conference on System of Systems Engineering (SoSE’07).Google Scholar
- J. W. Sanders and Graeme Smith. 2012. Emergence and refinement. Formal Aspects of Computing 24, 1 (2012), 45--65. Google ScholarCross Ref
- Daniel Schneider and Mario Trapp. 2009. Runtime safety models in open systems of systems. IEEE International Symposium on Dependable, Autonomic and Secure Computing, 455--460. Google ScholarDigital Library
- Scott A. Selberg and Mark A. Austin. 2008. Toward an Evolutionary System of Systems Architecture. Technical Report. Institute for Systems Research. INCOSE.Google Scholar
- Abeer Sharawi, Serge N. Sala-Diakanda, Sergio Quijada, Nabeel Yousef, Luis Rabelo, and Jose Sepulveda. 2006. A distributed simulation approach for modeling and analyzing system of systems. In 2006 Winter Simulation Conference. Google ScholarDigital Library
- Aaron J. Shenhar. 1994. A new systems engineering taxonomy. In 4th Annual International Symposium of The National Council on Systems Engineering, Vol. 2. 261--276.Google Scholar
- Aaron J. Shenhar and Zeev Bonen. 1997. The new taxonomy of systems: Toward an adaptive systems engineering framework. IEEE Transactions on Systems, Man and Cybernetics 27, 2 (1997), 137--145. Google ScholarDigital Library
- Carol A. Sledge. 2006. Army ASSIP Systems-of-Systems Test Metrics Task. Technical Report. CMU/SEI-2006-SR-011. Software Engineering Institute, Carnegie Mellon University.Google Scholar
- Ian Sommerville, Dave Cliff, Radu Calinescu, Justin Keen, Tim Kelly, Marta Kwiatkowska, John McDermid, and Richard Paige. 2012. Large-scale complex IT systems. Communications of the ACM 55, 7 (2012). Google ScholarDigital Library
- Andreas Spillner, Tilo Linz, and Hans Schaefer. 2006. Software Testing Foundations. dpunkt.verlag.Google Scholar
- J. G. Springintveld, F. W. Vaandrager, and P. R. D’Argenio. 2001. Testing timed automata. Theoretical Computer Science 254, 1--2 (March 2001), 225--257. Google ScholarDigital Library
- SysML1.2 2010. OMG Systems Modeling Language (OMG SysMLTM). Technical Report Version 1.2. SysML Modelling team. http://www.sysml.org/docs/specs/OMGSysML-v1.2-10-06-02.pdf.Google Scholar
- Genichi Taguchi. 1987. System of Experimental Design, Volume 1 & 2. UNIPUB/Kraus Intl. Publications.Google Scholar
- K. Tatsumi. 1987. Test case design support system. In International Conference on Quality Control (ICQC). 615--620.Google Scholar
- United States, Congress, Senate, Committee on Armed Services. 1988. Restructuring of the Strategic Defense Initiative (SDI) Program: US Senate. University of Michigan Library.Google Scholar
- Frits Vaandrager. 2012. Active learning of extended finite state machines. In 24th IFIP International Conference on Testing Software and Systems (ICTSS’12) (LNCS). Springer, 5--7.Google ScholarCross Ref
- Ricardo Valerdi, Elliot Axelband, Barry Boehm Thomas Baehren, Dave Dorenbos, Scott Jackson, Azad Madni, Gerald Nadler, Paul Robitaille, and Stan Settles. 2008. A research agenda for systems of systems architecting. International Journal of System of Systems Engineering 1, 1/2 (2008), 171--188.Google ScholarCross Ref
- B. E. White and P. N. Jean. 2011. Case study in system of systems engineering: NASA’s advanced communications technology satellite. In 2011 6th International Conference on System of Systems Engineering (SoSE). 237--244.Google Scholar
- N. Wickramasinghe, S. Chalasani, R. V. Boppana, and A. M. Madni. 2007. Healthcare system of systems. In IEEE International Conference on System of Systems Engineering (SoSE’07). 1--6.Google Scholar
- Jim Woodcock and Ana Cavalcanti. 2002. The semantics of circus. In 2nd International Conference of B and Z Users on Formal Specification and Development in Z and B (ZB’02). Springer-Verlag, 184--203. Google ScholarDigital Library
- Jim Woodcock, Ana Cavalcanti, John Fitzgerald, Peter Larsen, A. Miyazawa, and S. Perry. 2012. Features of CML: A formal modelling language for systems of systems. In 7th International Conference on System of Systems Engineering (SoSE’12). IEEE.Google Scholar
- Jim Woodcock, Peter Gorm Larsen, Juan Bicarregui, and John Fitzgerald. 2009. Formal methods: Practice and experience. ACM Computing Surveys 41, 4 (Oct. 2009), 1--36. DOI:http://dx.doi.org/10.1145/1592434.1592436 Google ScholarDigital Library
- Jim C. P. Woodcock and Ana L. C. Cavalcanti. 2001. A concurrent language for refinement. In 5th Irish Workshop in Formal Methods (IWFM’01) (BCS Electronic Workshops in Computing). Google ScholarDigital Library
- P. Zave. 1993. Feature interactions and formal specifications in telecommunications. Computer 26, 8 (1993), 20--28. DOI:http://dx.doi.org/10.1109/2.223539 Google ScholarDigital Library
Index Terms
- Systems of Systems Engineering: Basic Concepts, Model-Based Techniques, and Research Directions
Recommendations
Process evolution to support system of systems engineering
ULSSIS '08: Proceedings of the 2nd international workshop on Ultra-large-scale software-intensive systemsOne of the current research areas at the University of Southern California (USC) Center for Systems and Software Engineering (CSSE) is the development of large scale, software intensive systems of systems (SoS). These SoS are a type of Ultra-Large-Scale ...
Comments