survey

Systems of Systems Engineering: Basic Concepts, Model-Based Techniques, and Research Directions

Authors:

Claus Ballegaard Nielsen,

Peter Gorm Larsen,

John Fitzgerald,

Jan PeleskaAuthors Info & Claims

ACM Computing Surveys (CSUR), Volume 48, Issue 2

Article No.: 18, Pages 1 - 41

https://doi.org/10.1145/2794381

Published: 24 September 2015 Publication History

Abstract

The term “System of Systems” (SoS) has been used since the 1950s to describe systems that are composed of independent constituent systems, which act jointly towards a common goal through the synergism between them. Examples of SoS arise in areas such as power grid technology, transport, production, and military enterprises. SoS engineering is challenged by the independence, heterogeneity, evolution, and emergence properties found in SoS. This article focuses on the role of model-based techniques within the SoS engineering field. A review of existing attempts to define and classify SoS is used to identify several dimensions that characterise SoS applications. The SoS field is exemplified by a series of representative systems selected from the literature on SoS applications. Within the area of model-based techniques the survey specifically reviews the state of the art for SoS modelling, architectural description, simulation, verification, and testing. Finally, the identified dimensions of SoS characteristics are used to identify research challenges and future research areas of model-based SoS engineering.

References

[1]

Russ Abbott. 2006. Open at the top; open at the bottom; and continually (but slowly) evolving. In 2006 IEEE/SMC International Conference on System of Systems Engineering. IEEE.

[2]

Russell L. Ackoff. 1971. Towards a system of systems concept. Management Science 17, 11 (July 1971), 661--671.

[3]

Datu Buyung Agusdinata and Daniel DeLaurentis. 2008. Specification of system-of-systems for policymaking in the energy sector. Integrated Assessment Journal 8, 2 (2008), 1--24.

[4]

Andrea Arcuri, Muhammad Zohaib Iqbal, and Lionel Briand. 2010. Black-box system testing of real-time embedded systems using random and search-based testing. In 22nd IFIP International Conference on Testing Software and Systems (ICTSS’10). Springer-Verlag, 95--110.

Digital Library

[5]

Robert Axelrod. 1997. The Complexity of Cooperation: Agent-Based Models of Competition and Collaboration. Princeton University Press.

[6]

J. Bach and P. Schroeder. 2004. Pairwise testing—A best practice that isn’t. In 22nd Pacific Northwest Software Quality Conference. 180--196.

[7]

Paul Baker, Zhen Ru Dai, Jens Grabowski, Øystein Haugen, Ina Schieferdecker, and Clay Williams. 2008. Model Driven Testing—Using the UML Testing Profile. Springer.

Digital Library

[8]

W. C. Baldwin and B. Sauser. 2009. Modeling the characteristics of system of systems. In IEEE International Conference on System of Systems Engineering (SoSE’09). IEEE.

[9]

J. W. Ball, Sr. 1997. Free flight an air traffic management partnership. In 16th Digital Avionics Systems Conference, 1997, AIAA/IEEE, Vol. 2. IEEE, 9--1.

[10]

Yaneer Bar-Yam, Mary Ann Allison, Ron Batdorf, Hao Chen, Hoa Generazio, Harcharanjit Singh, and Steve Tucker. 2004. The characteristics and emerging behaviors of system of systems. NECSI: Complex Physical, Biological and Social Systems Project, 1--16.

[11]

Mark A. Bedau. 1997. Weak emergence. In Philosophical Perspectives: Mind, Causation, and World. Vol. 11. Blackwell, 375--399.

[12]

H. Berenji and M. Jamshidi. 2011. Fuzzy reinforcement learning for system of systems (SoS). In 2011 IEEE International Conference on Fuzzy Systems (FUZZ). 1689--1694.

[13]

Brian J. L. Berry. 1964. Cites as systems within system of cites. Papers and Proceedings of the Regional Science Association 13, 1 (Jan. 1964), 149--163.

[14]

Antoine Beugnard, Jean-Marc Jezequel, Noel Plouzeau, and Damien Watkins. 1999. Making components contract aware. IEEE Computer (July 1999), 38--45.

Digital Library

[15]

Robin Bloomfield and Ilir Gashi. 2008. Evaluating the Resilience and Security of Boundaryless, Evolving Socio-Technical Systems of Systems. Technical Report. Centre for Software Reliability, City University.

[16]

John Boardman and Brian Sauser. 2006. System of systems—The meaning of “of.” In 2006 IEEE/SMC International Conference on System of Systems Engineering. IEEE.

[17]

Barry Boehm. 2006. A view of 20th and 21st century software engineering. In 28th International Conference on Software Engineering (ICSE’06). ACM, 12--29.

Digital Library

[18]

Kenneth E. Boulding. 1956. General systems theory—The skeleton of science. Management Science 2, 3 (April 1956).

Digital Library

[19]

Jörg Brauer, Jan Peleska, and Uwe Schulze. 2012. Efficient and trustworthy tool qualification for model-based testing tools. In Testing Software and Systems (LNCS). Springer, Berlin, 8--23.

[20]

J. Bryans, J. Fitzgerald, R. Payne, and K. Kristensen. 2014. Maintaining emergence in systems of systems integration: A contractual approach using SysML. In INCOSE International Symposium on System Engineeering. INCOSE.

[21]

Dale S. Caffall and James Bret Michael. 2004. A new paradigm for requirements specification and analysis of system-of-systems. In Radical Innovations of Software and Systems Engineering in the Future, 9th International Workshop, RISSEF 2002 (LNCS), Vol. 2941. Springer, 108--121.

[22]

Radu Calinescu and Marta Z. Kwiatkowska. 2009. Using quantitative analysis to implement autonomic IT systems. In 31st International Conference on Software Engineering (ICSE’09). 100--110.

Digital Library

[23]

Radu Calinescu and Marta Z. Kwiatkowska. 2010. Software engineering techniques for the development of Systems of Systems. In Foundations of Computer Software. Future Trends and Techniques for Development, 15th Monterey Workshop 2008 (LNCS), Vol. 6028. Springer, 59--82.

Digital Library

[24]

James E. Campbell, Dennis E. Longsine, Donald Shirah, and Dennis J. Anderson. 2005. System of Systems Modeling and Analysis. Technical Report SAND2005-0020. Sandia National Laboratories.

[25]

Pascal Cantot and Dominique Luzeaux. 2009. Simulation et Modélisation des Systèmes de Systèmes: Vers la Maîtrise de la Complexité. Hermes Science Publications.

[26]

Pascal Cantot and Dominique Luzeaux. 2011. Simulation and Modeling of Systems of Systems. Wiley.

[27]

Paul G. Carlock and Robert E. Fenton. 2001. System of systems (SoS) enterprise systems engineering for information-intensive organizations. Systems Engineering 4, 4 (2001), 242--261.

[28]

David Carney, David Fasher, and Patrick Place. 2005. Topics in Interoperability: System-of-Systems Evolution. Technical Report CMU/SEI-2005-TN-002. Software Engineering Institute, Carnegie Mellon University.

[29]

Peter Checkland. 1999. Systems Thinking, Systems Practice: Includes a 30-Year Retrospective. Wiley.

[30]

Pin Chen and Jennie Clothier. 2003. Advancing systems engineering for systems-of-systems challenges. Systems Engineering 6, 3 (May 2003), 170--183.

[31]

Tsun S. Chow. 1978. Testing software design modeled by finite-state machines. IEEE Transactions on Software Engineering SE-4, 3 (March 1978), 178--186.

Digital Library

[32]

H. Q. Nguyen, C. Kaner, and J. Falk. 1999. Testing Computer Software. Wiley.

Digital Library

[33]

Dan Cocks. 2006. How should we use the term “System of Systems” and why should we care? In 16th INCOSE International Symposium 2006. INCOSE.

[34]

Joey W. Coleman, Anders Kaels Malmos, Peter Gorm Larsen, Jan Peleska, Ralph Hains, Zoe Andrews, Richard Payne, Simon Foster, Alvaro Miyazawa, Cristiano Bertolini, and André Didier. 2012. COMPASS tool vision for a system of systems collaborative development environment. In 7th International Conference on System of System Engineering (SoSE’12). 451--456.

[35]

John Colombi, Brannen C. Cohee, and Chuck W. Turner. 2008. Interoperability test and evaluation: A systems of systems field study. The Journal of Defense Software Engineering (Nov. 2008), 10--14.

[36]

S. Cook, E. Lawson, and J. Allison. 1999. Towards a unified systems methodology for Australian defence systems-of-systems. Proceedings of the 9th INCOSE International Symposium (June 1999).

[37]

S. C. Cook. 2001. On the acquisition of systems of systems. 2001 INCOSE International Symposium (July 2001).

[38]

Luís Diogo Couto and Richard Payne. 2013. The COMPASS proof obligation generator: A test case of Overture extensibility. In 11th Overture Workshop.

[39]

W. A. Crossley. 2004. System of systems: An introduction of Purdue University schools of Engineering’s Signature Area. In Engineering Systems Symposium. MIT Engineering Systems Division.

[40]

J. Dahmann. 2014. Systems of systems pain points. In INCOSE International Symposium on Systems Engineering 2014.

[41]

Judith Dahmann and Kristen Baldwin. 2008. Understanding the current state of US defense systems of systems and the implications for systems engineering. In IEEE Systems Conference. IEEE.

[42]

Judith S. Dahmann, George Rebovich, Jr., and Jo Ann Lane. 2008. Systems engineering for capabilities. CrossTalk Journal (The Journal of Defense Software Engineering) 21, 11 (Nov. 2008), 4--9.

[43]

K. Daniel, B. Dusza, A. Lewandowski, and C. Wietfeld. 2009. AirShield: A system-of-systems MUAV remote sensing architecture for disaster response. In 2009 3rd Annual IEEE Systems Conference. 196--200.

[44]

Giuseppe DeCandia, Deniz Hastorun, Madan Jampani, Gunavardhan Kakulapati, Avinash Lakshman, Alex Pilchin, Swaminathan Sivasubramanian, Peter Vosshall, and Werner Vogels. 2007. Dynamo: Amazon’s highly available key-value store. In 21st ACM SIGOPS Symposium on Operating Systems Principles (SOSP’07). ACM, 205--220.

Digital Library

[45]

Daniel A. DeLaurentis. 2005. Understanding transportation as system-of-systems design problem. In 43rd AIAA Aerospace Sciences Meeting and Exhibit. AIAA.

[46]

Daniel A. DeLaurentis and W. A. Crossley. 2005. A taxonomy-based perspective for systems of systems design methods. In IEEE International Conference on Systems, Man and Cybernetics. IEEE, 86--91.

[47]

Department of Defense. 2004. Defense Acquisition Guidebook. https://dag.dau.mil/Pages/Default.aspx.

[48]

G. Despotou, R. Alexander, and M. Hall-May. 2003. Key Concepts and Characteristics of Systems of Systems (SoS). DARP - HIRTS. University of York.

[49]

T. Dillon, V. Potdar, J. Singh, and A. Talevski. 2011. Cyber-physical systems: Providing quality of service (QoS) in a heterogeneous systems-of-systems environment. In 5th IEEE International Conference on Digital Ecosystems and Technologies (DEST’11). 330--335.

[50]

D. Drusinksy and Man-Tak Shing. 2005. Creation and evaluation of formal specifications for system-of-systems development. In IEEE International Conference on Systems, Man and Cybernetics. IEEE, 1864--1869.

[51]

Doron Drusinsky. 2003. Monitoring temporal rules combined with time series. In 15th International Conference on Computer Aided Verification (CAV’03) (LNCS), Vol. 2725. Springer, 114--117.

[52]

John P. Eddy, Dennis J. Anderson, Craig R. Lawton, and James E. Campbell. 2007. Network and Adaptive System of Systems Modeling and Analysis. Technical Report SAND2007-2788. Sandia National Laboratories.

[53]

H. Eisner, J. Marciniak, and R. McMillan. 1991. Computer-aided system of systems (S2) engineering. In IEEE International Conference on Systems, Man, and Cybernetics, 1991. Vol. 1. 531--537.

[54]

European Commission. 2012. Directions in Systems of Systems Engineering. Technical Report. European Commission, Communications Networks, Content and Technology Directorate—General Unit A3-DG CONNECT.

[55]

David A. Fisher. 2006. An Emergent Perspective on Interoperation in Systems of Systems. Technical Report. CMU/SEI-2006-TR-003. Software Engineering Institute, Carnegie Mellon University.

[56]

John Fitzgerald, Peter Gorm Larsen, and Jim Woodcock. 2012. Modelling and analysis technology for systems of systems engineering: Research challenges. In INCOSE.

[57]

M. T. Gamble and R. F. Gamble. 2008. Reasoning about hybrid system of systems designs. In 7th International Conference on Composition-Based Software Systems (ICCBSS’08). 154--163.

Digital Library

[58]

N. D. Geddes, D. M. Smith, and C. S. Lizza. 1998. Fostering collaboration in systems of systems. In 1998 IEEE International Conference on Systems, Man, and Cybernetics, 1998. IEEE, 950--954, Vol. 1.

[59]

Alberto Gonzalez, Eric Piel, Hans-Gerhard Gross, and Maurice Glandrup. 2008. Testing challenges of maritime safety and security systems-of-systems. In Testing: Academic & Industrial Conference——Practice and Research Techniques. IEEE Computer Society, 35--39.

Digital Library

[60]

A. Gorod, B. Sauser, and J. Boardman. 2008. System-of-systems engineering management: A review of modern history and a path forward. IEEE Systems Journal 2, 4 (Dec. 2008), 484--499.

[61]

Wolfgang Grieskamp. 2010. Microsoft’s protocol documentation program: A success story for model-based testing. In Testing—Practice and Research Techniques, 5th International Academic and Industrial Conference, TAIC PART 2010. (Lecture Notes in Computer Science), Vol. 6303, Leonardo Bottaci and Gordon Fraser (Eds.). Springer, 7.

Digital Library

[62]

J. O. Gutierrez-Garcia, F. F. Ramos-Corchado, and J.-L. Koning. 2009. Obligations as constrainers, descriptors, and linkers of open system of systems. In IEEE International Conference on System of Systems Engineering (SoSE’09). 1--6.

[63]

Stefan Hallerstede, Finn Overgaard Hansen, Jon Holt, Rasmus Lauritsen, Lasse Lorenzen, and Jan Peleska. 2012. Technical challenges of SoS requirements engineering. In 7th International Conference on System of System Engineering (SoSE’12). IEEE, 573--578.

[64]

D. Harel. 1987. StateCharts: A visual formalism for complex systems. Science of Computer Programming 8, 3 (1987), 231--274.

Digital Library

[65]

K. Harmon. 2005. The “systems” nature of enterprise architecture. In 2005 IEEE International Conference on Systems, Man and Cybernetics. IEEE, 78--85, Vol. 1.

[66]

Klaus Havelund and Grigore Rosu. 2001. Monitoring programs using rewriting. In 16th IEEE International Conference on Automated Software Engineering (ASE’01). 135--143.

Digital Library

[67]

Derek K. Hitchins. 2005. Systems methodology. In Conference on Systems Engineering Research.

[68]

C. A. R. Hoare. 1978. Communicating sequential processes. Communations of the ACM 21, 8 (Aug. 1978).

Digital Library

[69]

C. A. R. Hoare, Jayadev Misra, Gary T. Leavens, and Natarajan Shankar. 2009. The verified software initiative: A manifesto. ACM Computing Surveys 41, 4, Article 22 (Oct. 2009), 8 pages.

Digital Library

[70]

Jon Holt. 2012. Model-based requirements engineering for system of systems. In IEEE 7th International Conference on System of System Engineering (SoSE’12). IEEE.

[71]

J. Holt and S. Perry. 2008. SysML for Systems Engineering. IET.

Digital Library

[72]

IEC61508-3. 2010. IEC61508-3: Functional safety of electrical/electronic/programmable electronic safety-related systems—Part 3: Software Requirements. International Electrotechnical Commission.

[73]

IEEE1516 2010. IEEE standard for modeling and simulation: High level architecture (HLA)—Framework and rules. IEEE Std 1516-2010 (Revision of IEEE Std 1516-2000) (Aug. 2010), 1--38.

[74]

M. D. Ilić, Le Xie, U. A. Khan, and J. M. F. Moura. 2010. Modeling of future cyber-physical energy systems for distributed sensing and control. IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans 40, 4 (2010), 825--838.

Digital Library

[75]

INCOSE. 2011. Systems Engineering Handbook. A Guide for System Life Cycle Processes and Activities, Version 3.2.2. Technical Report INCOSE-TP-2003-002-03.2.2. International Council on Systems Engineering (INCOSE).

[76]

INCOSE. 2015. INCOSE Systems Engineering Handbook: A Guide for System Life Cycle Processes and Activities, Version 3.2.2. (4th ed.). Wiley.

[77]

C. Ingram, R. Payne, S. Perry, J. Holt, F. O. Hansen, and L. D. Couto. 2014. Modelling patterns for systems of systems architectures. In International Systems Conference (SysCon’14). IEEE.

[78]

International Organization for Standardization. 2009. ISO 26262—Road Vehicles—Functional Safety—Part 6: Product Development: Software Level. ICS 43.040.10.

[79]

International Organization for Standardization. 2015. ISO/IEC/IEEE 15288—Systems and Software Eningeering—System Life Cycle Processes.

[80]

M. C. Jackson and P. Keys. 1984. Towards a system of systems methodologies. The Journal of the Operational Research Society 35, 6 (June 1984), 473--486.

[81]

Francçois Jacob. 1974. The Logic of Living Systems: A History of Heredity. Allen Lane.

[82]

M. Jamshidi. 2005. System-of-systems engineering—A definition. In International Conference on Systems, Man, and Cybernetics. IEEE.

[83]

M. Jamshidi. 2008. System of systems engineering—New challenges for the 21st century. IEEE Aerospace and Electronic Systems Magazine 23, 5 (May 2008), 4--19.

[84]

Xiong Jian, Ge Bing-feng, Zhang Xiao-ke, Yang Ke-wei, and Chen Ying-wu. 2010. Evaluation method of system-of-systems architecture using knowledge-based executable model. In 2010 International Conference on Management Science and Engineering (ICMSE). 141--147.

[85]

C. B. Jones. 1983a. Specification and design of (parallel) programs. In IFIP’83. IFIP, North-Holland, 321--332.

[86]

Cliff B. Jones. 1983b. Tentative steps toward a development method for interfering programs. ACM Transactions on Programming Languages and Systems 5, 4 (Oct. 1983), 596--619.

Digital Library

[87]

Cem Kaner. 2003. Cem Kaner on scenario testing: The power of “what if...” and nine ways to fuel your imagination. Testing & Quality Engineering Magazine (October 2003).

[88]

N. Karcanias and A. G. Hessami. 2010. Complexity and the notion of system of systems: Part (II): Defining the notion of system of systems. In World Automation Congress (WAC), 2010. 1--7.

[89]

C. B. Keating. 2005. Research foundations for system of systems engineering. In 2005 IEEE International Conference on Systems, Man and Cybernetics. IEEE, 2720--2725.

[90]

Charles Keating, Ralph Rogers, Resit Unal, David Dryer, Andres Sousa-Poza, Robert Safford, William Peterson, and Ghaith Rabadi. 2003. System of system engineering. Engineering Management Journal 15, 3 (2003), 36--45.

[91]

N. Kilicay-Ergin and C. Dagli. 2008. Executable modeling for system of systems architecting: An artificial life framework. In 2008 2nd Annual IEEE Systems Conference. 1--5.

[92]

Vadim. Kotov. 1997. Systems-of-Systems as Communicating Structures. Technical Report HPL-97-124. Hewlett Packard Computer Systems Laboratory Paper.

[93]

Jeff Kramer. 2007. Is abstraction the key to computing? Communications of the ACM 50, 4 (2007), 37--42.

Digital Library

[94]

Anette J. Krygiel. 1999. Behind the Wizard’s Curtain, An Integration Environment for a System of Systems. CCRP publication series.

Digital Library

[95]

Jo Ann Lane and Ricardo Valerdi. 2007. Synthesizing SoS concepts for use in cost modeling. Systems Engineering 10, 4 (Dec. 2007), 297--308.

Digital Library

[96]

Michael Lees, Brian Logan, and Georgios Theodoropoulos. 2007. Distributed simulation of agent-based systems with HLA. ACM Transactions on Modeling and Computer Simulation 17, 3 (July 2007).

Digital Library

[97]

Nancy Leveson. 1995. SAFEWARE: System Safety and Computers. Addison-Wesley.

[98]

Qianhui Liang and Stuart H. Rubin. 2009. Randomization for testing systems of systems. In IEEE International Conference on Information Reuse & Integration (IRI’’09). IEEE, 110--114.

Digital Library

[99]

Shiyong Liu. 2011. Employing system of systems engineering in China’s emergency management. 2010 4th Annual IEEE Systems Conference 5, 2 (April 2011), 541--546.

[100]

R. Lock and I. Sommerville. 2010. Modelling and analysis of socio-technical system of systems. In 15th IEEE International Conference on Engineering of Complex Computer Systems (ICECCS). 224--232.

Digital Library

[101]

Helge Löding and Jan Peleska. 2010. Timed Moore automata: Test data generation and model checking. In International Conference on Software Testing, Verification, and Validation (ICST’08). IEEE, 449--458.

Digital Library

[102]

Carsten Lucke, Sascha Krell, and Ulrike Lechner. 2010. Critical issues in enterprise architecting—A literature review. In AMCIS 2010 Proceedings.

[103]

Marie Ludwig, Nicolas Farcet, Jean-Philippe Babau, and Joël Champeau. 2011. Integrating design and runtime variability support into a system ADL. In 7th European Conference on Modelling Foundations and Applications. Springer-Verlag, 270--281.

Digital Library

[104]

Stephen J. Lukasik. 1998. Systems, systems of systems, and the education of engineers. In AI EDAM, Vol. 12. Cambridge University, 55--60.

Digital Library

[105]

V. Mahulkar, S. McKay, D. E. Adams, and A. R. Chaturvedi. 2009. System-of-systems modeling and simulation of a ship environment with wireless and intelligent maintenance technologies. IEEE Transactions on Systems, Man and Cybernetics, Part A: Systems and Humans, 39, 6 (Nov. 2009), 1255--1270.

Digital Library

[106]

Mark W. Maier. 1996. Architecting principles for systems-of-systems. In INCOSE 1996 6th Annual International Symposium of the International Council on Systems Engineering. INCOSE.

[107]

Mark W. Maier. 1998a. Architecting principles for systems-of-systems. Systems Engineering 1, 4 (1998), 267--284.

[108]

Mark W. Maier. 1998b. Architecting principles for systems-of-systems. The Information Architects Cooperative (TIAC) whitepaper, www.infoed.com/Open/PAPERS/systems.htm.

[109]

Mark W. Maier. 2005. Research challenges for systems-of-systems. In 2005 IEEE International Conference onSystems, Man and Cybernetics. IEEE.

[110]

Mark W. Maier and Eberhardt Rechtin. 1997. The Art of Systems Architecting. CRC Press LLC.

Digital Library

[111]

Oded Maler and Dejan Nickovic. 2004. Monitoring temporal properties of continuous signals. In FORMATS 2004 and FTRTFT 2004 (LNCS), Vol. 3253. Springer, 152--166.

[112]

Mo Mansouri, Alex Gorod, Thomas H. Wakeman, and Brian Sauser. 2009. Maritime transportation system of systems management framework: A system of systems engineering approach. International Journal of Ocean Systems Management 1, 2 (2009), 200--226.

[113]

William H. J. Manthorpe. 1996. The emerging joint system of systems: A systems engineering challenge and opportunity for APL. John Hopkins APL Technical Digest 17, 3 (1996), 305--310.

[114]

Fredrick Mauss, Juan Valencia, Brian Hatchell, Kurt Silvers, and Shannon Crowell. 2015. System of systems approaches for mobile source transit security. In 15th INCOSE International Symposium (IS’15). INCOSE.

[115]

Abe Meilich. 2006. System of systems (SoS) engineering & architecture challenges in a net centric environment. In 2006 IEEE/SMC International Conference on System of Systems Engineering. IEEE.

[116]

Bertrand Meyer. 1992. Applying design by contract. IEEE Computer 25, 10 (1992), 40--51.

Digital Library

[117]

J. B. Michael, R. Riehle, and Man-Tak Shing. 2009. The verification and validation of software architecture for systems of systems. In IEEE International Conference on System of Systems Engineering (SoSE’09). 1--6.

[118]

Stefan Milius, Jan Peleska, and Martin Sulzmann. 2011. Contract Specification and Domain Specific Modeling Language for GALS Systems An Approach to System Validation. Technical Report. Technische Universität Braunschweig.

[119]

M. Z. Miller, K. Griendling, and D. N. Mavris. 2012. Exploring human factors effects in the smart grid system of systems demand response. In 2012 7th International Conference on System of Systems Engineering. IEEE, 1--6.

[120]

Saurabh Mittal, Bernard Zeigler, José Martin, Ferat Sahin, and Mo Jamshidi. 2009. System of Systems—Innovations for the 21st Century. Wiley. 101--149.

[121]

Heiner Müller-Merbach. 1994. A system of systems approaches. Interfaces 24, 4 (1994), 16--25.

Digital Library

[122]

Claus Ballegaard Nielsen and Peter Gorm Larsen. 2012. Extending VDM-RT to enable the formal modelling of system of systems. In IEEE 7th International Conference on System of System Engineering (SoSE’12). IEEE.

[123]

Claus Ballegaard Nielsen, Kenneth Lausdahl, and Peter Gorm Larsen. 2012. Combining VDM with executable code. In Abstract State Machines, Alloy, B, VDM, and Z (Lecture Notes in Computer Science), Vol. 7316, John Derrick, John Fitzgerald, Stefania Gnesi, Sarfraz Khurshid, Michael Leuschel, Steve Reeves, and Elvinia Riccobene (Eds.). Springer-Verlag, Berlin, 266--279. http://dx.doi.org/10.1007/978-3-642-30885-7_19 ISBN 978-3-642-30884-0.

Digital Library

[124]

Eli M. Noam. 1994. Beyond liberalization: From the network of networks to the system of systems. Telecommunications Policy 18, 4 (May 1994), 286--294.

[125]

L. Northrop, P. Feiler, R. P. Gabriel, J. Goodenough, R. Linger, T. Longstaff, R. Kazman, M. Klein, D. Schmidt, K. Sullivan, and K. Wallnau. 2006. Ultra-Large-Scale Systems: The Software Challenge of the Future. Technical Report. Software Engineering Institute, Carnegie Mellon University, Pittsburgh, PA.

[126]

OUSD(AT&L), DoD. 2008. Systems and Software Engineering. Systems Engineering Guide for Systems of Systems. Technical Report Version 1.0. Office of the Deputy Under Secretary of Defense for Acquisition and Technology, Department of Defense.

[127]

A. William A. Owens. 1995. Dominant Battlespace Knowledge. Institute for National Strategic Studies, The Emerging U.S. System-of-Systems.

[128]

Richard Payne, Jeremy Bryans, John Fitzgerald, and Steve Riddle. 2012. Interface specification for system-of-systems architectures. In IEEE 7th International Conference on System of System Engineering, (SoSE’12). IEEE.

[129]

Richard J. Payne and John S. Fitzgerald. 2010. Evaluation of Architectural Frameworks Supporting Contract-Based Specification. Technical Report CS-TR-1233. School of Computing Science, Newcastle University.

[130]

R. S. Pei. 2000. Systems of systems integration (SoSI)-a smart way of acquiring army C4I2WS systems. In Summer Computer Simulation Conference.

[131]

Jan Peleska. 2013. Industrial-strength model-based testing—State of the art and current challenges. Electronic Proceedings in Theoretical Computer Science abs/1303.1006, 3--28.

[132]

Jan Peleska, Artur Honisch, Florian Lapschies, Helge Löding, Hermann Schmid, Peer Smuda, Elena Vorobev, and Cornelia Zahlten. 2011. A real-world benchmark model for testing concurrent real-time systems in the automotive domain. In International Conference on Testing Software and Systems. (ICTSS’11) (LNCS), Vol. 7019. Springer, 146--161.

Digital Library

[133]

M. S. Phadke. 1989. Quality Engineering Using Robust Design. Prentice Hall.

Digital Library

[134]

Fiona Polack and Susan Stepney. 2005. Emergent properties do not refine. Electronic Notes in Theoretical Computer Science 137, 2 (2005), 163--181.

Digital Library

[135]

Fred R. Ricker and Ravi Kalakota. 1999. Order fulfillment: The hidden key to e-commerce success. Supply Chain Management Review 11, 3 (Fall 1999), 60--70.

[136]

J. Ring and A. M. Madni. 2005. Key challenges and opportunities in “system of systems” engineering. In 2005 IEEE International Conference on Systems, Man and Cybernetics. 973--978.

[137]

A. W. Roscoe. 2010. Understanding Concurrent Systems. Springer.

Digital Library

[138]

RTCA SC-205/EUROCAE WG-71. 2011a. Model-Based Development and Verification Supplement to DO-178C and DO-278A. Number RTCA/DO-331. RTCA, Inc., 1140 Connecticut Avenue, N.W., Suite 1020, Washington, D.C. 20036.

[139]

RTCA SC-205/EUROCAE WG-71. 2011b. Software Considerations in Airborne Systems and Equipment Certification. Number RTCA/DO-178C. RTCA, Inc., 1140 Connecticut Avenue, N.W., Suite 1020, Washington, D.C. 20036.

[140]

Andrew P. Sage and Christopher D. Cuppan. 2001. On the systems engineering and management of systems of systems and federations of systems. Information Knowledge Systems Management 2, 4 (Dec. 2001), 325--345.

Digital Library

[141]

F. Sahin, M. Jamshidi, and P. Sridhar. 2007. A discrete event XML based simulation framework for system of systems architectures. In IEEE International Conference on System of Systems Engineering (SoSE’07).

[142]

J. W. Sanders and Graeme Smith. 2012. Emergence and refinement. Formal Aspects of Computing 24, 1 (2012), 45--65.

[143]

Daniel Schneider and Mario Trapp. 2009. Runtime safety models in open systems of systems. IEEE International Symposium on Dependable, Autonomic and Secure Computing, 455--460.

Digital Library

[144]

Scott A. Selberg and Mark A. Austin. 2008. Toward an Evolutionary System of Systems Architecture. Technical Report. Institute for Systems Research. INCOSE.

[145]

Abeer Sharawi, Serge N. Sala-Diakanda, Sergio Quijada, Nabeel Yousef, Luis Rabelo, and Jose Sepulveda. 2006. A distributed simulation approach for modeling and analyzing system of systems. In 2006 Winter Simulation Conference.

Digital Library

[146]

Aaron J. Shenhar. 1994. A new systems engineering taxonomy. In 4th Annual International Symposium of The National Council on Systems Engineering, Vol. 2. 261--276.

[147]

Aaron J. Shenhar and Zeev Bonen. 1997. The new taxonomy of systems: Toward an adaptive systems engineering framework. IEEE Transactions on Systems, Man and Cybernetics 27, 2 (1997), 137--145.

Digital Library

[148]

Carol A. Sledge. 2006. Army ASSIP Systems-of-Systems Test Metrics Task. Technical Report. CMU/SEI-2006-SR-011. Software Engineering Institute, Carnegie Mellon University.

[149]

Ian Sommerville, Dave Cliff, Radu Calinescu, Justin Keen, Tim Kelly, Marta Kwiatkowska, John McDermid, and Richard Paige. 2012. Large-scale complex IT systems. Communications of the ACM 55, 7 (2012).

Digital Library

[150]

Andreas Spillner, Tilo Linz, and Hans Schaefer. 2006. Software Testing Foundations. dpunkt.verlag.

[151]

J. G. Springintveld, F. W. Vaandrager, and P. R. D’Argenio. 2001. Testing timed automata. Theoretical Computer Science 254, 1--2 (March 2001), 225--257.

Digital Library

[152]

SysML1.2 2010. OMG Systems Modeling Language (OMG SysML^TM). Technical Report Version 1.2. SysML Modelling team. http://www.sysml.org/docs/specs/OMGSysML-v1.2-10-06-02.pdf.

[153]

Genichi Taguchi. 1987. System of Experimental Design, Volume 1 & 2. UNIPUB/Kraus Intl. Publications.

[154]

K. Tatsumi. 1987. Test case design support system. In International Conference on Quality Control (ICQC). 615--620.

[155]

United States, Congress, Senate, Committee on Armed Services. 1988. Restructuring of the Strategic Defense Initiative (SDI) Program: US Senate. University of Michigan Library.

[156]

Frits Vaandrager. 2012. Active learning of extended finite state machines. In 24th IFIP International Conference on Testing Software and Systems (ICTSS’12) (LNCS). Springer, 5--7.

[157]

Ricardo Valerdi, Elliot Axelband, Barry Boehm Thomas Baehren, Dave Dorenbos, Scott Jackson, Azad Madni, Gerald Nadler, Paul Robitaille, and Stan Settles. 2008. A research agenda for systems of systems architecting. International Journal of System of Systems Engineering 1, 1/2 (2008), 171--188.

[158]

B. E. White and P. N. Jean. 2011. Case study in system of systems engineering: NASA’s advanced communications technology satellite. In 2011 6th International Conference on System of Systems Engineering (SoSE). 237--244.

[159]

N. Wickramasinghe, S. Chalasani, R. V. Boppana, and A. M. Madni. 2007. Healthcare system of systems. In IEEE International Conference on System of Systems Engineering (SoSE’07). 1--6.

[160]

Jim Woodcock and Ana Cavalcanti. 2002. The semantics of circus. In 2nd International Conference of B and Z Users on Formal Specification and Development in Z and B (ZB’02). Springer-Verlag, 184--203.

Digital Library

[161]

Jim Woodcock, Ana Cavalcanti, John Fitzgerald, Peter Larsen, A. Miyazawa, and S. Perry. 2012. Features of CML: A formal modelling language for systems of systems. In 7th International Conference on System of Systems Engineering (SoSE’12). IEEE.

[162]

Jim Woodcock, Peter Gorm Larsen, Juan Bicarregui, and John Fitzgerald. 2009. Formal methods: Practice and experience. ACM Computing Surveys 41, 4 (Oct. 2009), 1--36.

Digital Library

[163]

Jim C. P. Woodcock and Ana L. C. Cavalcanti. 2001. A concurrent language for refinement. In 5th Irish Workshop in Formal Methods (IWFM’01) (BCS Electronic Workshops in Computing).

Digital Library

[164]

P. Zave. 1993. Feature interactions and formal specifications in telecommunications. Computer 26, 8 (1993), 20--28.

Digital Library

Cited By

Valle PTonon VGarcés LRezende SNakagawa E(2025)TASIS: A typology of architectural strategies for interoperability in software-intensive systemsComputer Standards & Interfaces10.1016/j.csi.2024.10387491(103874)Online publication date: Jan-2025
https://doi.org/10.1016/j.csi.2024.103874
Tymchuk VTrysnyuk V(2024)The systematic review of variety of military, weapon, combat and warfare system-of-systems wuth their new classification and ontology depiction for further concept and design development for the Armed Forces of UkraineМіжнародний науковий журнал «Military Science»10.62524/msj.2024.2.1.092:1(102-116)Online publication date: 3-Apr-2024
https://doi.org/10.62524/msj.2024.2.1.09
Kunc M(2024)The Systems Thinking Approach to Strategic ManagementSystems10.3390/systems1206021312:6(213)Online publication date: 15-Jun-2024
https://doi.org/10.3390/systems12060213
Show More Cited By

Index Terms

Systems of Systems Engineering: Basic Concepts, Model-Based Techniques, and Research Directions

Recommendations

The Theory of Engineering Drawing
The Theory of Engineering Drawing
Process evolution to support system of systems engineering
ULSSIS '08: Proceedings of the 2nd international workshop on Ultra-large-scale software-intensive systems

One of the current research areas at the University of Southern California (USC) Center for Systems and Software Engineering (CSSE) is the development of large scale, software intensive systems of systems (SoS). These SoS are a type of Ultra-Large-Scale ...

Comments

Information & Contributors

Information

Published In

cover image ACM Computing Surveys

ACM Computing Surveys Volume 48, Issue 2

November 2015

615 pages

ISSN:0360-0300

EISSN:1557-7341

DOI:10.1145/2830539

Editor:
Sartaj Sahni
Department of Computer and Information Science and Engineering/University of Florida/Gainesville, FL

Issue’s Table of Contents

Copyright © 2015 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 24 September 2015

Accepted: 01 June 2015

Revised: 01 January 2015

Received: 01 July 2013

Published in CSUR Volume 48, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Survey

Funding Sources

Seventh Framework Programme

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

310
Total Citations
View Citations
4,980
Total Downloads

Downloads (Last 12 months)727
Downloads (Last 6 weeks)73

Reflects downloads up to 11 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Valle PTonon VGarcés LRezende SNakagawa E(2025)TASIS: A typology of architectural strategies for interoperability in software-intensive systemsComputer Standards & Interfaces10.1016/j.csi.2024.10387491(103874)Online publication date: Jan-2025
https://doi.org/10.1016/j.csi.2024.103874
Tymchuk VTrysnyuk V(2024)The systematic review of variety of military, weapon, combat and warfare system-of-systems wuth their new classification and ontology depiction for further concept and design development for the Armed Forces of UkraineМіжнародний науковий журнал «Military Science»10.62524/msj.2024.2.1.092:1(102-116)Online publication date: 3-Apr-2024
https://doi.org/10.62524/msj.2024.2.1.09
Kunc M(2024)The Systems Thinking Approach to Strategic ManagementSystems10.3390/systems1206021312:6(213)Online publication date: 15-Jun-2024
https://doi.org/10.3390/systems12060213
Liu JLiu JZhang M(2024)Effective Evolutionary Principles for System-of-Systems: Insights from Agent-Based Modeling in Vehicular NetworksSystems10.3390/systems1203009812:3(98)Online publication date: 15-Mar-2024
https://doi.org/10.3390/systems12030098
Mihret ZAxelsson JJee EBae D(2024)Policy-Guided Collaboration for Enhancing System of Systems Goal Achievement2024 IEEE International Systems Conference (SysCon)10.1109/SysCon61195.2024.10553439(1-8)Online publication date: 15-Apr-2024
https://doi.org/10.1109/SysCon61195.2024.10553439
Niemeyer JDormeier CMennenga M(2024)Pattern-based System of Systems Engineering Approach for Resilient and Sustainable Production Networks – A Review and Framework Proposal2024 19th Annual System of Systems Engineering Conference (SoSE)10.1109/SOSE62659.2024.10620963(10-17)Online publication date: 23-Jun-2024
https://doi.org/10.1109/SOSE62659.2024.10620963
Da Silva Mosafi FPires LDuarte JCavalcanti M(2024)Towards a microservices architecture to support communication in C2 applications2024 19th Annual System of Systems Engineering Conference (SoSE)10.1109/SOSE62659.2024.10620941(227-232)Online publication date: 23-Jun-2024
https://doi.org/10.1109/SOSE62659.2024.10620941
Janssen LFey RBesselink Bvan de Wouw N(2024)Modular redesign of mechatronic systems: Formulation of module specifications guaranteeing system dynamics specificationsMechatronics10.1016/j.mechatronics.2024.103236103(103236)Online publication date: Nov-2024
https://doi.org/10.1016/j.mechatronics.2024.103236
Elhabbash AElkhatib YNundloll VSanz Marco VBlair G(2024)Principled and automated system of systems composition using an ontological architectureFuture Generation Computer Systems10.1016/j.future.2024.03.034157:C(499-515)Online publication date: 18-Jul-2024
https://dl.acm.org/doi/10.1016/j.future.2024.03.034
Hornos MQuinde M(2024)Development methodologies for IoT-based systems: challenges and research directionsJournal of Reliable Intelligent Environments10.1007/s40860-024-00229-9Online publication date: 9-Aug-2024
https://doi.org/10.1007/s40860-024-00229-9
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents