Resilience is one of the most essential quality properties of software systems, the resilience of software architectures plays an important role in the security of a software system. However, even though there are some methods have been proposed for evaluating the resilience of software architecture in the past few years, most of them are validated only by case studies with some specific application scenarios. We do not find a work which has provided a wide empirical verification and comparison of these different methods. To fill this gap, we explore and compare five typical software architecture resilience evaluation methods by experiments in this paper, and try to find which methods are better in which aspects. We have obtained the following findings: first, the five methods studied in this paper are effective and consistent in the trend of resilience change; secondly, the change of architecture resilience is actually related to the specific attributes and component relationships in the architecture; finally, systems designed in an object-oriented style are generally more resilient than most other design styles studied.

弹性是软件系统最基本的质量属性之一，软件体系结构的弹性对软件系统的安全性起着重要作用。然而，尽管在过去几年中提出了一些评估软件体系结构弹性的方法，但大多数方法仅通过某些特定应用场景的案例研究进行了验证。我们没有找到对这些不同方法进行广泛实证验证和比较的工作。为了填补这一空白，本文通过实验探索和比较了五种典型的软件架构弹性评估方法，并试图找出哪些方法在哪些方面更好。我们得到了以下发现：首先，本文研究的五种方法在韧性变化趋势上均有效且一致；其次，架构弹性的变化实际上与架构中的特定属性和组件关系有关；最后，以面向对象风格设计的系统通常比所研究的大多数其他设计风格更具弹性。