Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

Architecting systems of systems: : A tertiary study

Published: 01 February 2020 Publication History

Highlights

This is the first tertiary study in SoS architecting.
The study shows a state of disconnectedness in the field.
Some SoS architecting activities are underrepresented in the literature.
The same holds for many quality attributes.
Too many related terms and a wide open definition of SoS inhibit focused research.

Abstract

Context: The term System of Systems (SoS) has increasingly been used in a wide variety of domains to describe those systems composed of independent constituent systems that collaborate towards a mission that they could not accomplish on their own. There is a significant volume of research by the software architecture community that aims to overcome the challenges involved in architecting SoS, as evidenced by the number of secondary studies in the field published so far. However, the boundaries of such research do not seem to be well defined, at least partially, due to the emergence of SoS-adjacent areas of interest like the Internet of Things.Objective: This paper aims to investigate the current state of research on SoS architecting by synthesizing the demographic data, assessing the quality and the coverage of architecting activities and software quality attributes by the research, and distilling a concept map that reflects a community-wide understanding of the concept of SoS. Method: We conduct what is, to the best of our understanding, the first tertiary study on SoS architecting. Such tertiary study was based on five research questions, and was performed by following the guidelines of Kitchenham et al. In all, 19 secondary studies were evaluated, which is comparable to other tertiary studies. Results: The study illustrates a state of disconnection in the research community, with research gaps in the coverage of particular phases and quality attributes. Furthermore, a more effective approach in classifying systems as SoS is required, as the means of resolving conceptual and terminological overlaps with the related domains. Conclusions: Despite the amount of research in the area of SoS architecting, more coordinated and systematic targeted efforts are required in order to address the identified issues with the current state of research.

References

[1]
M.W. Maier, Architecting principles for systems-of-systems, Syst. Eng.: J.Int. Council Syst. Eng. 1 (4) (1998) 267–284.
[2]
S.Y. Diallo, C.J. Lynch, R. Gore, J.J. Padilla, Emergent behavior identification within an agent-based model of the ballistic missile defense system using statistical debugging, J. Defense Model. Simul. 13 (3) (2016) 275–289.
[3]
T. Peugeot, N. Dupin, M.-J. Sembely, C. Dubecq, Mbse, Plm, Mip and Robust Optimization for System of Systems Management, Application to Sccoa French Air Defense Program, Complex Systems Design & Management, Springer, 2017, pp. 29–40.
[4]
A. Alfieri, M. Cantamessa, F. Montagna, The sos approach for lean manufacturing systems, Int. J. Technol. Manage. 57 (1/2/3) (2012) 149–165.
[5]
U. Rauschecker, S.J. Ford, N. Athanssopoulou, Developing a Vision for Multi-site Manufacturing System of Systems, Enabling Manufacturing Competitiveness and Economic Sustainability, Springer, 2014, pp. 79–84.
[6]
D. Ki-Aries, S. Faily, H. Dogan, C. Williams, System of systems characterisation assisting security risk assessment (2018).
[7]
A.M. Zachry, C. Fan, Establishing a framework for disaster management system-of-systems, Systems Conference (SysCon), 2018 Annual IEEE International, IEEE, 2018, pp. 1–7.
[8]
J.-P. Steghöfer, G. Anders, F. Siefert, W. Reif, A system of systems approach to the evolutionary transformation of power management systems., GI-Jahrestagung, 2013, pp. 1500–1515.
[9]
A.J. Lopes, R. Lezama, R. Pineda, Model based systems engineering for smart grids as systems of systems, Procedia Comput Sci 6 (2011) 441–450.
[10]
A. Gorod, S. Merchant, L. Hallo, Toward systemic governance of cancer treatment as a system of systems, 2018 13th Annual Conference on System of Systems Engineering (SoSE), IEEE, 2018, pp. 556–560.
[11]
S. Okami, N. Kohtake, Transitional complexity of health information system of systems: managing by the engineering systems multiple-domain modeling approach, IEEE Syst. J. (2017).
[12]
J. Boardman, B. Sauser, System of systems-the meaning of, System of Systems Engineering, 2006 IEEE/SMC International Conference on, IEEE, 2006, pp. 6–pp.
[13]
A. Ceccarelli, A. Bondavalli, B. Froemel, O. Hoeftberger, H. Kopetz, Basic Concepts on Systems of Systems, Cyber-Physical Systems of Systems, Springer, Cham, 2016, pp. 1–39,.
[14]
M. Gagliardi, W. Wood, J. Klein, J. Morley, A uniform approach for system of systems architecture evaluation, CrossTalk 22 (3–4) (2009) 12–15.
[15]
E.Y. Nakagawa, M. Gonçalves, M. Guessi, L.B. Oliveira, F. Oquendo, The state of the art and future perspectives in systems of systems software architectures, Proceedings of the First International Workshop on Software Engineering for Systems-of-Systems, ACM, 2013, pp. 13–20.
[16]
J. Klein, H. van Vliet, A Systematic Review of System-of-systems Architecture Research, Proceedings of the 9th International ACM Sigsoft Conference on Quality of Software Architectures, QoSA ’13, ACM, New York, NY, USA, 2013, pp. 13–22,.
[17]
P. Gomes, E. Cavalcante, P. Maia, T. Batista, K. Oliveira, A systematic mapping on discovery and composition mechanisms for systems-of-systems, 2015 41st Euromicro Conference on Software Engineering and Advanced Applications, IEEE, 2015, pp. 191–198,.
[18]
V.V. Graciano Neto, M. Guessi, L.B.R. Oliveira, F. Oquendo, E.Y. Nakagawa, Investigating the model-driven development for systems-of-systems, Proceedings of the 2014 European Conference on software architecture workshops, ACM, 2014, p. 22.
[19]
M. Guessi, V.V.G. Neto, T. Bianchi, K.R. Felizardo, F. Oquendo, E.Y. Nakagawa, A systematic literature review on the description of software architectures for systems of systems, Proceedings of the 30th Annual ACM Symposium on Applied Computing, ACM Press, 2015, pp. 1433–1440,.
[20]
V. Barot, M. Henshaw, C. Siemieniuch, H. Dogan, Design of a web-based thesaurus for systems of systems engineering, System of Systems Engineering (SoSE), 2013 8th International Conference on, IEEE, 2013, pp. 7–12.
[21]
M.J. de C Henshaw, Systems of systems, cyber-physical systems, the internet-of-things... whatever next?, Insight 19 (3) (2016) 51–54.
[22]
B. Kitchenham, O.P. Brereton, D. Budgen, M. Turner, J. Bailey, S. Linkman, Systematic literature reviews in software engineering–a systematic literature review, Inf. Softw. Technol. 51 (1) (2009) 7–15.
[23]
B. Kitchenham, Procedures for performing systematic reviews, Keele, UK, Keele University 33 (2004) (2004) 1–26.
[24]
M.U. Khan, S. Sherin, M.Z. Iqbal, R. Zahid, Landscaping systematic mapping studies in software engineering: a tertiary study, J. Syst. Softw. 149 (2019) 396–436.
[25]
D. Budgen, P. Brereton, S. Drummond, N. Williams, Reporting systematic reviews: some lessons from a tertiary study, Inf. Softw. Technol. 95 (2018) 62–74,.
[26]
M. Raatikainen, J. Tiihonen, T. Mnnist, Software product lines and variability modeling: a tertiary study, J. Syst. Softw. 149 (2019) 485–510,.
[27]
K. Curcio, R. Santana, S. Reinehr, A. Malucelli, Usability in agile software development: a tertiary study, Comput. Standards Interf. (2019),.
[28]
L. Villalobos-Arias, C. Quesada-Lpez, A. Martinez, M. Jenkins, A tertiary study on model-based testing areas, tools and challenges: preliminary results, 2018, pp. 15–28.
[29]
N. Rios, M. MendonNeto, R. Spnola, A tertiary study on technical debt: types, management strategies, research trends, and base information for practitioners, Inf. Softw. Technol. 102 (2018) 117–145,.
[30]
B. Kitchenham, S. Charters, Guidelines for performing structural literature reviews in software engineering, Empir. Softw. Eng. Natl. ICT (2007) 45–56.
[31]
B. Kitchenham, R. Pretorius, D. Budgen, O. Pearl Brereton, M. Turner, M. Niazi, S. Linkman, Systematic literature reviews in software engineering – a tertiary study, Inf. Softw. Technol. 52 (8) (2010) 792–805,.
[32]
W. Bandara, E. Furtmueller, E. Gorbacheva, S. Miskon, J. Beekhuyzen, Achieving rigor in literature reviews: insights from qualitative data analysis and tool-support, Commun. Assoc. Inf.Syst. 37 (2015) 154–204.
[33]
H. Zhang, M.A. Babar, P. Tell, Identifying relevant studies in software engineering, Inf. Softw. Technol. 53 (6) (2011) 625–637,.
[34]
C. Hofmeister, P. Kruchten, R.L. Nord, H. Obbink, A. Ran, P. America, A general model of software architecture design derived from five industrial approaches, J. Syst. Softw. 80 (1) (2007) 106–126,.
[35]
A. Tang, P. Avgeriou, A. Jansen, R. Capilla, M.A. Babar, A comparative study of architecture knowledge management tools, J. Syst. Softw. 83 (3) (2010) 352–370.
[36]
N.B. Harrison, P. Avgeriou, Leveraging architecture patterns to satisfy quality attributes, European conference on software architecture, Springer, 2007, pp. 263–270.
[37]
I. Iso, Iec25010: 2011 systems and software engineering–systems and software quality requirements and evaluation (square)–system and software quality models, Int. Org. Standard. 34 (2011) 2910.
[38]
C. Wohlin, Guidelines for snowballing in systematic literature studies and a replication in software engineering, Proceedings of the 18th international conference on evaluation and assessment in software engineering, ACM, 2014, p. 38.
[39]
D.S. Cruzes, T. Dybå, Research synthesis in software engineering: a tertiary study, Inf. Softw. Technol. 53 (5) (2011) 440–455,.
[40]
W. Bandara, S. Miskon, E. Fielt, A systematic, tool-supported method for conducting literature reviews in information systems, Proceedings of the19th European Conference on Information Systems (ECIS 2011), 2011.
[41]
S. Cavanagh, Content analysis: concepts, methods and applications., Nurse Res. 4 (3) (1997) 5–16.
[42]
M.B. Gonçalves, E. Cavalcante, T. Batista, F. Oquendo, E.Y. Nakagawa, Towards a conceptual model for software-intensive system-of-systems, 2014 IEEE International Conference on Systems, Man, and Cybernetics (SMC), IEEE, 2014, pp. 1605–1610.
[43]
M. Dixon-Woods, S. Agarwal, D. Jones, B. Young, A. Sutton, Synthesising qualitative and quantitative evidence: a review of possible methods, J. Health Serv. Res. Policy 10 (1) (2005) 45–53.
[44]
J.D. Novak, Concept mapping: a strategy for organizing knowledge, Learning Sci. Schools: Res. Reform.Pract. (1995) 229–245.
[45]
M.B. Gonçalves, F. Oquendo, E.Y. Nakagawa, A meta-process to construct software architectures for system of systems, Proceedings of the 30th Annual ACM Symposium on Applied Computing, ACM, 2015, pp. 1411–1416.
[46]
C. Yang, P. Liang, P. Avgeriou, A systematic mapping study on the combination of software architecture and agile development, J. Syst. Softw. 111 (2016) 157–184.
[47]
A. Ampatzoglou, S. Bibi, P. Avgeriou, M. Ver-beek, A. Chatzigeorgiou, Identifying, categorizing and mitigating threats to validity in software engineering secondary studies, Inf. Softw. Technol. (2018).
[48]
B.A. Kitchenham, D. Budgen, P. Brereton, Evidence-based Software Engineering and Systematic Reviews, 4, CRC Press, 2015.

Cited By

View all

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Information and Software Technology
Information and Software Technology  Volume 118, Issue C
Feb 2020
129 pages

Publisher

Butterworth-Heinemann

United States

Publication History

Published: 01 February 2020

Author Tags

  1. Systems of Systems
  2. SoS Architecting
  3. Tertiary study
  4. Systematic literature review

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 11 Sep 2024

Other Metrics

Citations

Cited By

View all
  • (2023)A Tertiary Study on Microservices: Research Trends and RecommendationsProgramming and Computing Software10.1134/S036176882308020049:8(796-821)Online publication date: 1-Dec-2023
  • (2023)Continuous deployment in software-intensive system-of-systemsInformation and Software Technology10.1016/j.infsof.2023.107200159:COnline publication date: 1-Jul-2023
  • (2023)Towards an understanding of reliability of software-intensive systems-of-systemsInformation and Software Technology10.1016/j.infsof.2023.107186158:COnline publication date: 1-Jun-2023
  • (2023)Improving hardware/software interface management in systems of systems through documentation as codeEmpirical Software Engineering10.1007/s10664-023-10350-728:4Online publication date: 6-Jul-2023
  • (2022)ESQuMoInternational Journal of Embedded and Real-Time Communication Systems10.4018/IJERTCS.28920113:1(1-18)Online publication date: 14-Jan-2022
  • (2022)How are the interoperability requirements addressed in the Systems-of-Systems context?Proceedings of the XVIII Brazilian Symposium on Information Systems10.1145/3535511.3535524(1-8)Online publication date: 16-May-2022
  • (2022)Software-Based Dialogue Systems: Survey, Taxonomy, and ChallengesACM Computing Surveys10.1145/352745055:5(1-42)Online publication date: 3-Dec-2022
  • (2022)ARC-SoISE: Towards a Reference Architecture for Constituents of Educational Systems-of-Information Systems2022 17th Annual System of Systems Engineering Conference (SOSE)10.1109/SOSE55472.2022.9812646(142-147)Online publication date: 7-Jun-2022
  • (2022)System and software architecting harmonization practices in ultra-large-scale systems of systemsInformation and Software Technology10.1016/j.infsof.2022.106984150:COnline publication date: 1-Oct-2022
  • (2022)A Delphi study to recognize and assess systems of systems vulnerabilitiesInformation and Software Technology10.1016/j.infsof.2022.106874146:COnline publication date: 1-Jun-2022
  • Show More Cited By

View Options

View options

Get Access

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media