research-article

A framework for evaluating quality-driven self-adaptive software systems

Authors:

Norha M. Villegas,

Hausi A. Müller,

Gabriel Tamura,

Laurence Duchien,

Rubby CasallasAuthors Info & Claims

SEAMS '11: Proceedings of the 6th International Symposium on Software Engineering for Adaptive and Self-Managing Systems

Pages 80 - 89

https://doi.org/10.1145/1988008.1988020

Published: 23 May 2011 Publication History

Abstract

Over the past decade the dynamic capabilities of self-adaptive software-intensive systems have proliferated and improved significantly. To advance the field of self-adaptive and self-managing systems further and to leverage the benefits of self-adaptation, we need to develop methods and tools to assess and possibly certify adaptation properties of self-adaptive systems, not only at design time but also, and especially, at run-time. In this paper we propose a framework for evaluating quality-driven self-adaptive software systems. Our framework is based on a survey of self-adaptive system papers and a set of adaptation properties derived from control theory properties. We also establish a mapping between these properties and software quality attributes. Thus, corresponding software quality metrics can then be used to assess adaptation properties.

References

[1]

K. Appleby, S. Fakhouri, L. Fong, G. Goldszmidt, M. Kalantar, S. Krishnakumar, D. P. Pazel, J. Pershing, and B. Rochwerger. Océano - SLA based management of a computing utility. In 7th IFIP/IEEE International Symposium on Integrated Network Management, pages 855--868, 2001.

[2]

M. Barbacci, M. H. Klein, T. A. Longstaff, and C. B. Weinstock. Quality attributes. Technical Report Carnegie Mellon University/SEI-95-TR-021, Carnegie Mellon University/SEI, 1995.

[3]

L. Baresi and S. Guinea. Self-supervising BPEL processes. IEEE Transactions on Software Engineering, 99 (PrePrints), 2010.

Digital Library

[4]

G. Candea, J. Cutler, and A. Fox. Improving availability with recursive microreboots: a soft-state system case study. Performance Evaluation, 56(1-4):213--248, 2004. Dependable Systems and Networks - Performance and Dependability Symposium (DSN-PDS) 2002: Selected Papers.

Digital Library

[5]

V. Cardellini, E. Casalicchio, V. Grassi, F. Lo Presti, and R. Mirandola. QoS-driven runtime adaptation of service oriented architectures. In ACM SIGSOFT Symposium on the Foundations of Software Engineering, pages 131--140, New York, NY, USA, 2009. ACM.

Digital Library

[6]

J. Dowling and V. Cahill. Self-managed decentralised systems using K-components and collaborative reinforcement learning. In 1st ACM SIGSOFT Workshop on Self-Managed Systems, pages 39--43, New York, NY, USA, 2004. ACM.

Digital Library

[7]

G. Dumont and M. Huzmezan. Concepts, methods and techniques in adaptive control. In the 2002 American Control Conference, volume 2, pages 1137--1150. IEEE, 2002.

[8]

H. Ehrig, C. Ermel, O. Runge, A. Bucchiarone, and P. Pelliccione. Formal analysis and verification of self-healing systems. In Fundamental Approaches to Software Engineering, volume 6013 of LNCS, pages 139--153. Springer, 2010.

Digital Library

[9]

J. Floch, S. Hallsteinsen, E. Stav, F. Eliassen, K. Lund, and E. Gjorven. Using architecture models for runtime adaptability. IEEE Software, 23:62--70, 2006.

Digital Library

[10]

D. Garlan, S.-W. Cheng, A.-C. Huang, B. Schmerl, and P. Steenkiste. Rainbow: Architecture-based self-adaptation with reusable infrastructure. IEEE Computer, 37:46--54, 2004.

Digital Library

[11]

J. L. Hellerstein, Y. Diao, S. Parekh, and D. M. Tilbury. Feedback Control of Computing Systems. IEEE Press, John Wiley & Sons, 2004.

Digital Library

[12]

J. L. Hellerstein, S. Singhal, and Q. Wang. Research challenges in control engineering of computing systems. IEEE Transactions on Network and Service Management, 6(4):206--211, 2009.

Digital Library

[13]

IBM Corporation. An architectural blueprint for autonomic computing. Technical report, IBM Corporation, 2006.

[14]

V. Kumar, B. F. Cooper, Z. Cai, G. Eisenhauer, and K. Schwan. Middleware for enterprise scale data stream management using utility-driven self-adaptive information flows. Cluster Computing, 10:443--455, 2007.

Digital Library

[15]

M. Léger, T. Ledoux, and T. Coupaye. Reliable dynamic reconfigurations in a reflective component model. In 13th International Symposium on Component Based Software Engineering, volume 6092 of LNCS, pages 74--92. Springer, 2010.

Digital Library

[16]

C. Lu, J. A. Stankovic, T. F. Abdelzaher, G. Tao, S. H. Son, and M. Marley. Performance specifications and metrics for adaptive real-time systems. In Real-Time Systems Symposium, 2000.

Digital Library

[17]

A. C. Meng. On evaluating self-adaptive software. In 1st International Workshop on Self-Adaptive Software, pages 65--74, Secaucus, NJ, USA, 2000. Springer.

Digital Library

[18]

A. Mukhija and M. Glinz. Runtime adaptation of applications through dynamic recomposition of components. In 18th International Conference on Architecture of Computing Systems, 2005.

Digital Library

[19]

K. S. Narendra and J. Balakrishnan. Adaptive control using multiple models. IEEE Transactions on Automatic Control, 42:171--187, 1997.

[20]

S. Parekh, N. Gandhi, J. Hellerstein, D. Tilbury, T. Jayram, and J. Bigus. Using control theory to achieve service level objectives in performance management. Real-Time Systems, 23:127--141, 2002.

Digital Library

[21]

P. Reinecke, K. Wolter, and A. van Moorsel. Evaluating the adaptivity of computing systems. Performance Evaluation, 67(8):676--693, 2010. Special Issue on Software and Performance.

Digital Library

[22]

M. Salehie and L. Tahvildari. Self-adaptive software: Landscape and research challenges. ACM Transactions on Autonomous and Adaptive Systems, 4:14:1--14:42, 2009.

Digital Library

[23]

S. Sicard, F. Boyer, and N. De Palma. Using components for architecture-based management: the self-repair case. In 30th International Conference on Software Engineering, pages 101--110. ACM, 2008.

Digital Library

[24]

A. Solomon, M. Litoiu, J. Benayon, and A. Lau. Business process adaptation on a tracked simulation model. In 2010 Conference of the Center for Advanced Studies on Collaborative Research. ACM, 2010.

Digital Library

[25]

G. Tamura, R. Casallas, A. Cleve, and L. Duchien. QoS contract-aware reconfiguration of component architectures using e-graphs. In 7th International Workshop on Formal Aspects of Component Software, LNCS. Springer, 2010.

Digital Library

[26]

United States Air Force Chief Scientist (AF/ST). Technology Horizons a Vision for Air Force Science & Technology During 2010--2030. Technical report, U.S. Air Force, 2010.

[27]

J. White. Simplifying autonomic enterprise Java Bean applications via model-driven development: a case study. The Journal of Software and System Modeling, pages 601--615, 2005.

Digital Library

Cited By

Pereira ABezerra CCoutinho E(2024)Decomposition of Reliability Requirements for Self-Adaptive Systems Using the NFR FrameworkProceedings of the 20th Brazilian Symposium on Information Systems10.1145/3658271.3658325(1-10)Online publication date: 20-May-2024
https://dl.acm.org/doi/10.1145/3658271.3658325
Sanchez RTroya JCamara JBaresi LMa XPasquale L(2024)Automated Planning for Adaptive Cyber-Physical Systems under Uncertainty in Temporal Availability ConstraintsProceedings of the 19th International Symposium on Software Engineering for Adaptive and Self-Managing Systems10.1145/3643915.3644083(14-24)Online publication date: 15-Apr-2024
https://dl.acm.org/doi/10.1145/3643915.3644083
Xu MLiu RTahvildari LStoodley MOnut IShirani POnut IOnut IBranco P(2023)An Educational Course on Self-Adaptive Systems using IBM TechnologiesProceedings of the 33rd Annual International Conference on Computer Science and Software Engineering10.5555/3615924.3615939(143-148)Online publication date: 11-Sep-2023
https://dl.acm.org/doi/10.5555/3615924.3615939
Show More Cited By

Recommendations

High-quality specification of self-adaptive software systems
SEAMS '13: Proceedings of the 2013 8th International Symposium on Software Engineering for Adaptive and Self-Managing Systems (SEAMS)

Today' software systems have to cope with changing environments while at the same time facing high non-functional requirements such as flexibility and dependability. Recently, these non-functional requirements are addressed using self-adaptivity ...
Robustness-Driven Resilience Evaluation of Self-Adaptive Software Systems

An increasingly important requirement for certain classes of software-intensive systems is the ability to self-adapt their structure and behavior at run-time when reacting to changes that may occur to the system, its environment, or its goals. A major ...
Model-Driven Engineering of Self-Adaptive Software with EUREMA
Special Section on Best Papers from SEAMS 2012

The development of self-adaptive software requires the engineering of an adaptation engine that controls the underlying adaptable software by feedback loops. The engine often describes the adaptation by runtime models representing the adaptable software ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SEAMS '11: Proceedings of the 6th International Symposium on Software Engineering for Adaptive and Self-Managing Systems

May 2011

246 pages

ISBN:9781450305754

DOI:10.1145/1988008

Program Chairs:
Holger Giese
Hasso Plattner Institute, Germany
,
Betty H.C. Cheng
Michigan State University, USA

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 23 May 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

ICSE11

Sponsor:

SIGSOFT

ICSE11: International Conference on Software Engineering

May 23 - 24, 2011

HI, Waikiki, Honolulu, USA

Acceptance Rates

Overall Acceptance Rate 17 of 31 submissions, 55%

Upcoming Conference

ICSE 2025

2025 IEEE/ACM 46th International Conference on Software Engineering

April 26 - May 3, 2025

Ottawa , ON , Canada

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

92
Total Citations
View Citations
1,491
Total Downloads

Downloads (Last 12 months)48
Downloads (Last 6 weeks)7

Reflects downloads up to 15 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Pereira ABezerra CCoutinho E(2024)Decomposition of Reliability Requirements for Self-Adaptive Systems Using the NFR FrameworkProceedings of the 20th Brazilian Symposium on Information Systems10.1145/3658271.3658325(1-10)Online publication date: 20-May-2024
https://dl.acm.org/doi/10.1145/3658271.3658325
Sanchez RTroya JCamara JBaresi LMa XPasquale L(2024)Automated Planning for Adaptive Cyber-Physical Systems under Uncertainty in Temporal Availability ConstraintsProceedings of the 19th International Symposium on Software Engineering for Adaptive and Self-Managing Systems10.1145/3643915.3644083(14-24)Online publication date: 15-Apr-2024
https://dl.acm.org/doi/10.1145/3643915.3644083
Xu MLiu RTahvildari LStoodley MOnut IShirani POnut IOnut IBranco P(2023)An Educational Course on Self-Adaptive Systems using IBM TechnologiesProceedings of the 33rd Annual International Conference on Computer Science and Software Engineering10.5555/3615924.3615939(143-148)Online publication date: 11-Sep-2023
https://dl.acm.org/doi/10.5555/3615924.3615939
Petrovska AHutzelmann TKugele SHong JLanperne MPark JCerny TShahriar H(2023)A Theoretical Framework for Self-Adaptive Systems: Specifications, Formalisation, and Architectural ImplicationsProceedings of the 38th ACM/SIGAPP Symposium on Applied Computing10.1145/3555776.3577665(1440-1449)Online publication date: 27-Mar-2023
https://dl.acm.org/doi/10.1145/3555776.3577665
Cox PCoutino MPapari GSardarabadi AAnitori L(2023)Run-Time Monitors Design for Adaptive Radar Systems: A Practical Framework2023 IEEE Radar Conference (RadarConf23)10.1109/RadarConf2351548.2023.10149709(1-6)Online publication date: 1-May-2023
https://doi.org/10.1109/RadarConf2351548.2023.10149709
Hasan SElkhatib Y(2023)On the Interplay Between Self-adaptation and Energy EfficiencyProceedings of the 9th International Conference on Advanced Intelligent Systems and Informatics 202310.1007/978-3-031-43247-7_12(130-139)Online publication date: 18-Sep-2023
https://doi.org/10.1007/978-3-031-43247-7_12
Milić MMakajić-Nikolić D(2022)Development of a Quality-Based Model for Software Architecture Optimization: A Case Study of Monolith and Microservice ArchitecturesSymmetry10.3390/sym1409182414:9(1824)Online publication date: 2-Sep-2022
https://doi.org/10.3390/sym14091824
Cabrera CClarke S(2022)A Self-Adaptive Service Discovery Model for Smart CitiesIEEE Transactions on Services Computing10.1109/TSC.2019.294435615:1(386-399)Online publication date: 1-Jan-2022
https://doi.org/10.1109/TSC.2019.2944356
Naqvi MMalik SAstekin MMoonen L(2022)On Evaluating Self-Adaptive and Self-Healing Systems using Chaos Engineering2022 IEEE International Conference on Autonomic Computing and Self-Organizing Systems (ACSOS)10.1109/ACSOS55765.2022.00018(1-10)Online publication date: Sep-2022
https://doi.org/10.1109/ACSOS55765.2022.00018
Al-Ali RBulej LKofroň JBureš T(2022)A guide to design uncertainty-aware self-adaptive components in Cyber–Physical SystemsFuture Generation Computer Systems10.1016/j.future.2021.10.027128:C(466-489)Online publication date: 1-Mar-2022
https://dl.acm.org/doi/10.1016/j.future.2021.10.027
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents