research-article

Architectural design decision visualization for architecture design: preliminary results of a controlled experiment

Authors:

Mojtaba Shahin,

Zengyang LiAuthors Info & Claims

ECSA '11: Proceedings of the 5th European Conference on Software Architecture: Companion Volume

Article No.: 2, Pages 1 - 8

https://doi.org/10.1145/2031759.2031762

Published: 13 September 2011 Publication History

Abstract

Visualization of architectural design decision (ADD) and its rationale, as a kind of traceability information, is supposed to facilitate the understanding of architecture design and the reasoning behind the design rationale, which is supposed to improve the architecting process and gets better architecture design results. But the lack of empirical evaluation that supports this statement prevents industrial practitioners from using ADD visualization in their daily architecting activities. In this paper, we conducted a controlled experiment to investigate how visualization of ADD can improve the understanding of architecture design by using Compendium, an open source tool for rationale visualization. The preliminary results show that visualization of ADD and its rationale does not increase the total time for reading architecture document (including visualization diagrams of ADDs) plus designing task, and it improves the understanding of architects on existing architecture design with better new design results.

References

[1]

Kruchten, P., Lago, P., and van Vliet, H., 2006. Building up and reasoning about architectural knowledge. In Proceedings of the 2nd International Conference on the Quality of Software-Architectures (QoSA), pages 43--58.

Digital Library

[2]

Jansen, A. and Bosch, J., 2005. Software architecture as a set of architectural design decisions. In Proceedings of the 5th Working IEEE/IFIP Conference on Software Architecture (WICSA), pages 109--120.

Digital Library

[3]

Shahin, M., Liang, P., and Mohammad, R. K., 2010. Improving understandability of architecture design through visualization of architectural design decision, In Proceedings of the 5th Workshop on SHAring and Reusing architectural Knowledge (SHARK), pages 88--95.

Digital Library

[4]

Liang, P., and Avgeriou, P., 2009. Tools and Technologies for Architecture Knowledge Management. In Software Architecture Knowledge Management: Theory and Practice, Springer, pages 91--111.

[5]

Shahin, M., Liang, P., and Mohammad, R. K., 2009. Architectural design decision: existing models and tools. In Proceedings of the 8th Working IEEE/IFIP Conference on Software Architecture (WICSA), pages 293--296.

[6]

Kunz, W., and Rittel, H., 1970. Issues as Elements of Information Systems. Studiengruppe fur Systemforschung.

[7]

López, C., Inostroza, P., Cysneiros, L. M., and Astudillo, H., 2009. Visualization and comparison of architecture rationale with semantic web technologies, Journal of Systems and Software, 82(8):1198--1210, Elsevier.

Digital Library

[8]

Sellier, D., and Mannion, M., 2007. Visualising product Line requirement selection decision inter-dependencies, In Proceedings of the 2nd International Workshop on Requirements Engineering Visualization (REV), pages 1--10.

Digital Library

[9]

Ugai, T., Hayashi, S., and Saeki, M., 2010. Visualizing stakeholder concerns with anchored map, In Proceedings of the 5th International Workshop on Requirements Engineering Visualization (REV), pages 20--24.

[10]

Jedlitschka, A., and Pfahl, D., 2005. Reporting guidelines for controlled experiments in software engineering. In Proceedings of the 4th International Symposium on Empirical Software Engineering (ISESE), pages 95--104.

[11]

ISO, 2010. ISO/IEC FCD 4, 2010, Systems and software engineering - Architecture description, http://www.iso.org/iso/catalogue_detail.htm?csnumber=50508

[12]

Wikipedia, Student's t-test, http://en.wikipedia.org/wiki/T-test, accessed on 2010-12-20.

[13]

Tang, A., Tran, M. H., Han, M., Vliet, H., 2008. Design reasoning improves software design quality, In Proceeding of the 4th International Conference on Quality of Software-Architectures: Models and Architectures (QoSA), pages 28--42.

Digital Library

[14]

Jansen, A., Ven, J., Avgeriou, P., Hammer., D. K, 2007. Tool support for architectural decisions, In Proceedings of the 6th Working IEEE/IFIP Conference on Software Architecture (WICSA), page 4--13.

Digital Library

[15]

Shahin, M., Liang, P., and Mohammad, R. K., 2010. Rationale visualization of software architectural design decision using Compendium, In Proceedings of the 25th ACM Symposium on Applied Computing (SAC), pages 2358--2359.

Digital Library

[16]

Mirakhorli, M., 2011. Tracing architecturally significant requirements: a decision-centric approach, In Proceedings of the 33rd International Conference on Software Engineering (ICSE), pages 1126--1127.

Digital Library

[17]

Kunz, W., and Rittel, H., 1970. Issues as Elements of Information Systems. Studiengruppe fur Systemforschung.

[18]

Wohlin, C., Host, M., and Henningsson, K., 2003. Empirical research methods in software engineering. Empirical Methods and Studies in Software Engineering, Springer, pages 145--165.

[19]

Royston, P. 1982. An Extension of Shapiro and Wilk's W Test for Normality to Large Samples, Applied Statistics, volume 31, pages 115--124.

[20]

Tang, A., and Lago, P., 2010. Notes on Design Reasoning Techniques (V1.4), Swinburne University of Technology & VU University Amsterdam, 2010.

Cited By

Schoop SHebisch EFranz T(2024)Improving Comprehensibility of Event-Driven Microservice Architectures by Graph-Based VisualizationsSoftware Architecture10.1007/978-3-031-70797-1_14(207-214)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1007/978-3-031-70797-1_14
Kleebaum APaech BJohanssen JBruegge B(2021)Continuous Rationale Visualization2021 Working Conference on Software Visualization (VISSOFT)10.1109/VISSOFT52517.2021.00013(33-43)Online publication date: Sep-2021
https://doi.org/10.1109/VISSOFT52517.2021.00013
Bhat MShumaiev KHohenstein UBiesdorf AMatthes F(2020)The Evolution of Architectural Decision Making as a Key Focus Area of Software Architecture Research: A Semi-Systematic Literature Study2020 IEEE International Conference on Software Architecture (ICSA)10.1109/ICSA47634.2020.00015(69-80)Online publication date: Mar-2020
https://doi.org/10.1109/ICSA47634.2020.00015
Show More Cited By

Index Terms

Architectural design decision visualization for architecture design: preliminary results of a controlled experiment
1. Computing methodologies
  1. Modeling and simulation
    1. Simulation types and techniques
      1. Visual analytics
2. Software and its engineering
  1. Software notations and tools
    1. System description languages
  2. Software organization and properties
    1. Software system structures
      1. Software architectures

Recommendations

Improving understandability of architecture design through visualization of architectural design decision
SHARK '10: Proceedings of the 2010 ICSE Workshop on Sharing and Reusing Architectural Knowledge

Concentrating on components and connectors in traditional approaches to document software architecture causes the problems, such as high costs for architecture change and erode during architecture evolution. These problems result in a tendency to record ...
Rationale visualization of software architectural design decision using compendium
SAC '10: Proceedings of the 2010 ACM Symposium on Applied Computing

The justification for software architectural design decisions made throughout the architecting process is necessary for understanding, (re)using, communicating, and modifying an architecture design. Although there are many existing tools to capture, ...
Do architectural design decisions improve the understanding of software architecture? two controlled experiments
ICPC 2014: Proceedings of the 22nd International Conference on Program Comprehension

Architectural design decision (ADD) and its design rationale, as a paradigm shift on documenting and enriching architecture design description, is supposed to facilitate the understanding of architecture and the reasoning behind the design rationale, ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

ECSA '11: Proceedings of the 5th European Conference on Software Architecture: Companion Volume

September 2011

79 pages

ISBN:9781450306188

DOI:10.1145/2031759

Conference Chair:
Wilhelm Hasselbring,
General Chair:
Volker Gruhn

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

ADESSO: Adesso
University of Duisburg-Essen
Ruhr Institute: The Ruhr Institute for Software Technology

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 13 September 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Funding Sources

National Natural Science Foundation of China

Conference

ECSA '11

Sponsor:

ADESSO
Ruhr Institute

ECSA '11: Companion Volume

September 13 - 16, 2011

Essen, Germany

Acceptance Rates

Overall Acceptance Rate 48 of 72 submissions, 67%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

11
Total Citations
View Citations
354
Total Downloads

Downloads (Last 12 months)17
Downloads (Last 6 weeks)1

Reflects downloads up to 01 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Schoop SHebisch EFranz T(2024)Improving Comprehensibility of Event-Driven Microservice Architectures by Graph-Based VisualizationsSoftware Architecture10.1007/978-3-031-70797-1_14(207-214)Online publication date: 1-Sep-2024
https://dl.acm.org/doi/10.1007/978-3-031-70797-1_14
Kleebaum APaech BJohanssen JBruegge B(2021)Continuous Rationale Visualization2021 Working Conference on Software Visualization (VISSOFT)10.1109/VISSOFT52517.2021.00013(33-43)Online publication date: Sep-2021
https://doi.org/10.1109/VISSOFT52517.2021.00013
Bhat MShumaiev KHohenstein UBiesdorf AMatthes F(2020)The Evolution of Architectural Decision Making as a Key Focus Area of Software Architecture Research: A Semi-Systematic Literature Study2020 IEEE International Conference on Software Architecture (ICSA)10.1109/ICSA47634.2020.00015(69-80)Online publication date: Mar-2020
https://doi.org/10.1109/ICSA47634.2020.00015
Szvetits MZdun UAli SGarousi V(2019)Model-Integrated Queries for the Analysis of Runtime EventsProceedings of the 23rd International Conference on Evaluation and Assessment in Software Engineering10.1145/3319008.3319010(35-44)Online publication date: 15-Apr-2019
https://dl.acm.org/doi/10.1145/3319008.3319010
Javed MZdun ULv JZhang HBabar M(2015)On the effects of traceability links in differently sized software systemsProceedings of the 19th International Conference on Evaluation and Assessment in Software Engineering10.1145/2745802.2745812(1-10)Online publication date: 27-Apr-2015
https://dl.acm.org/doi/10.1145/2745802.2745812
de Graaf KLiang PTang Avan Vliet HLv JZhang HBabar M(2015)Supporting architecture documentationProceedings of the 19th International Conference on Evaluation and Assessment in Software Engineering10.1145/2745802.2745804(1-10)Online publication date: 27-Apr-2015
https://dl.acm.org/doi/10.1145/2745802.2745804
(2015)Automatic enforcement of constraints in real-time collaborative architectural decision makingJournal of Systems and Software10.1016/j.jss.2015.01.056103:C(128-149)Online publication date: 1-May-2015
https://dl.acm.org/doi/10.1016/j.jss.2015.01.056
Shahin MLiang PLi ZRoy CBegel AMoonen L(2014)Do architectural design decisions improve the understanding of software architecture? two controlled experimentsProceedings of the 22nd International Conference on Program Comprehension10.1145/2597008.2597139(3-13)Online publication date: 2-Jun-2014
https://dl.acm.org/doi/10.1145/2597008.2597139
Chen LBabar M(2014)Towards an Evidence-Based Understanding of Emergence of Architecture through Continuous Refactoring in Agile Software DevelopmentProceedings of the 2014 IEEE/IFIP Conference on Software Architecture10.1109/WICSA.2014.45(195-204)Online publication date: 7-Apr-2014
https://dl.acm.org/doi/10.1109/WICSA.2014.45
Javed MZdun U(2014)The Supportive Effect of Traceability Links in Architecture-Level Software UnderstandingProceedings of the 2014 IEEE/IFIP Conference on Software Architecture10.1109/WICSA.2014.43(215-224)Online publication date: 7-Apr-2014
https://dl.acm.org/doi/10.1109/WICSA.2014.43
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten