Analysis of service diagnosis improvement through increased monitoring granularity
Pages 437 - 471
Abstract
Due to their loosely coupled and highly dynamic nature, service-oriented systems offer many benefits for realizing fault tolerance and supporting trustworthy computing. They enable automatic system reconfiguration when a faulty service is detected. Spectrum-based fault localization (SFL) is a statistics-based diagnosis technique that can be effectively applied to pinpoint problematic services. However, SFL exhibits poor performance in diagnosing services which are tightly interacted. Previous research suggests that an increase in the number of monitoring locations may improve the diagnosability for tight interaction. In this paper, we analyze the trade-offs between the diagnosis improvement through increased monitoring granularity and the overhead caused by the introduction of more monitors, when diagnosing tightly interacted faulty services. We apply SFL in a service-based system, for which we show that 100 % correct identification of faulty services can be achieved through the increased monitoring granularity. We assess the overhead with increased monitoring granularity and compare this with the original monitoring setup. Our experimental results show that the monitoring at the service communication level causes relatively high overhead, whereas the monitoring overhead at a finer level of granularity, i.e., at the service implementation level, is much lower, but highly dependent on the number of monitors deployed.
References
[1]
Abreu, R., Zoeteweij, P., & van Gemund, A. J. (2006). An evaluation of similarity coefficients for software fault localization. In Proceedings of international symposium on dependable computing (PRDC), IEEE (pp. 39-46).
[2]
Abreu, R., Zoeteweij, P., Golsteijn, R., & van Gemund, A. (2009). A practical evaluation of spectrum-based fault localization. Journal of Systems and Software, 82(11), 1780-1792.
[3]
Baresi, L., & Guinea, S. (2013). Event-based multi-level service monitoring. In IEEE 20th international conference on web services (ICWS), 2013 (pp. 83-90).
[4]
Baresi, L., Ghezzi, C., & Guinea, S. (2007). Towards self-healing composition of services. In B. J. Krämer & W. A. Halang (Eds.), Contributions to Ubiquitous Computing, Studies in Computational Intelligence (pp. 27-46). New York: Springer.
[5]
Bennett, K., Layzell, P., Budgen, D., Brereton, P., Macaulay, L., & Munro, M. (2000). Service-based software: the future for flexible software. In Proceedings of asia-pacific software engineering conference (APSEC), IEEE (pp. 214-221).
[6]
Canfora, G., & Di Penta, M. (2006). Testing services and service-centric systems: Challenges and opportunities. IT Professional, 8(2), 10-17.
[7]
Chatzigiannakis, V., & Papavassiliou, S. (2007). Diagnosing anomalies and identifying faulty nodes in sensor networks. IEEE Sensors Journal, 7(5), 637-645.
[8]
Chen, C., Gross, H. G., & Zaidman, A. (2012). Spectrum-based fault diagnosis for service-oriented software systems. In Proceedings of the international conference on service-oriented computing and applications (SOCA), IEEE (pp. 1-8).
[9]
Chen, C., Gross, H. G., & Zaidman, A. (2013). Improving service diagnosis through increased monitoring granularity. In 7th international conference on software security and reliability (SERE), IEEE (pp. 129-138).
[10]
Chen, M., Kiciman, E., Fratkin, E., Fox, A., & Brewer, E. (2002). Pinpoint: problem determination in large, dynamic internet services. In Proceedings of international conference on dependable systems and networks (DSN), IEEE (pp. 595-604).
[11]
Di Nitto, E., Ghezzi, C., Metzger, A., Papazoglou, M., & Pohl, K. (2008). A journey to highly dynamic, self-adaptive service-based applications. Automated Software Engineering, 15(3-4), 313-341.
[12]
Espinha, T., Chen, C., Zaidman, A., & Gross, H. G. (2012). Maintenance research in SOA--Towards a standard case study. In Proceedings of European conference on software maintenance and reengineering (CSMR), IEEE (pp. 391-396).
[13]
Feldman, A., Provan, G. M., & van Gemund, A. J. C. (2010). Approximate model-based diagnosis using greedy stochastic search. Journal of Artificial Intelligence Research, 38, 371-413.
[14]
Gonzalez-Sanchez, A., Piel, E., Gross, H. G., & van Gemund, A. (2010). Prioritizing tests for software fault localization. In International conference on quality software, IEEE (pp. 42-51).
[15]
Gonzalez-Sanchez, A., Abreu, R., Gross, H. G., & van Gemund, A. J. (2011). Spectrum-based sequential diagnosis. In Proceedings of international conference on artificial intelligence (AAAI) (pp. 189-196), AAAI Press.
[16]
Grosclaude, I. (2004). Model-based monitoring of component-based software systems. In International workshop on principles of diagnosis (pp. 155-160).
[17]
Heward, G., Muller, I., Han, J., Schneider, J. G., & Versteeg, S. (2010). Assessing the performance impact of service monitoring. In Software engineering conference (ASWEC), 2010 21st Australian (pp. 192-201).
[18]
Keller, A., & Ludwig, H. (2003). The wsla framework: Specifying and monitoring service level agreements for web services. Journal of Network and Systems Management, 11(1), 57-81.
[19]
Lin, K. J., Panahi, M., Zhang, Y., Zhang, J., & Chang, S. H. (2009). Building accountability middleware to support dependable soa. IEEE Internet Computing, 13(2), 16-25.
[20]
Mayer, W., Friedrich, G., & Stumptner, M. (2010). Diagnosis of service failures by trace analysis with partial knowledge. In Service-oriented computing, LNCS (Vol. 6470, pp. 334-349). Berlin: Springer.
[21]
Mayer, W., Friedrich, G., & Stumptner, M. (2012). On computing correct processes and repairs using partial behavioral models. In 20th European conference on artificial intelligence (ECAI) (pp. 582-587).
[22]
Mohamed, A., & Zulkernine, M. (2008). On failure propagation in component-based software systems. In Proceedings of international conference on quality software (QSIC), IEEE (pp. 402-411).
[23]
Mosincat, A. D., & Binder, W. (2011). Automated maintenance of service compositions with SLA violation detection and dynamic binding. International Journal on Software Tools for Technology Transfer, 13(2), 167-179.
[24]
Repp, N., Berbner, R., Heckmann, O., & Steinmetz, R. (2007). A cross-layer approach to performance monitoring of web services. In Emerging web services technology (pp. 21-32).
[25]
Reps, T., Ball, T., Das, M., & Larus, J. (1997). The use of program profiling for software maintenance with applications to the year 2000 problem. In European software engineering conference symposium on foundations of software engineering (ESEC/FSE), LNCS (Vol. 1301, pp. 432-449). Springer.
[26]
Weiser, M. (1981). Program slicing. In Proceedings of the international conference on software engineering (ICSE) (pp. 439-449). IEEE Press.
[27]
Weyuker, E. J. (1982). On testing non-testable programs. The Computer Journal, 25(4), 465-470.
[28]
Wong, W. E., Debroy, V., & Choi, B. (2010). A family of code coverage-based heuristics for effective fault localization. Journal of Systems and Software, 83(2), 188-208.
[29]
Yan, Y., & Dague, P. (2007). Modeling and diagnosing orchestrated web service processes. In Proceedings of international conference on web services (ICWS), IEEE (pp. 51-59).
[30]
Yan, Y., Dague, P., Pencole, Y., & Cordier, M. O. (2009). A model-based approach for diagnosing fault in web service processes. International Journal of Web Services Research (IJWSR), 6(1), 87-110.
[31]
Zhang, J., Chang, Y., & Lin, K. J. (2009). A dependency matrix based framework for QoS diagnosis in SOA. In Proceedings of international conference on service-oriented computing and applications (SOCA), IEEE (pp. 1-8).
[32]
Zhang, J., Huang, Z., & Lin, K. (2012). A hybrid diagnosis approach for QoS management in service-oriented architecture. In International conference on web services (ICWS), IEEE (pp. 82-89).
[33]
Zoeteweij, P., Abreu, R., Golsteijn, R., & van Gemund, A. J. (2007). Diagnosis of embedded software using program spectra. In Proceedings of international conference and workshops on engineering of computer-based systems (ECBS), IEEE (pp. 213-220).
[34]
Zulkernine, F., Martin, P., & Wilson, K. (2008). A middleware solution to monitoring composite web services-based processes. In Congress on services part II, 2008. SERVICES-2. IEEE (pp. 149-156).
- Analysis of service diagnosis improvement through increased monitoring granularity
Recommendations
Improving Service Diagnosis through Increased Monitoring Granularity
SERE '13: Proceedings of the 2013 IEEE 7th International Conference on Software Security and ReliabilityDue to their loose coupling and highly dynamic nature, service-oriented systems offer many benefits for realizing fault tolerance and supporting trustworthy computing. They enable automatic system reconfiguration in case that a faulty service is ...
Spectrum-based fault diagnosis for service-oriented software systems
SOCA '12: Proceedings of the 2012 5th IEEE International Conference on Service-Oriented Computing and Applications (SOCA)Due to the loosely coupled and highly dynamic nature of service-oriented systems, the actual configuration of such system only fully materializes at runtime, rendering many of the traditional quality assurance approaches useless. In order to enable ...
Improving Service Diagnosis through Invocation Monitoring
QSIC '13: Proceedings of the 2013 13th International Conference on Quality SoftwareService oriented architectures support software runtime evolution through reconfiguration of misbehaving services. Reconfiguration requires that the faulty services can be identified correctly. Spectrum-based fault localization is an automated diagnosis ...
Comments
Information & Contributors
Information
Published In
Copyright © Copyright © 2017 Springer Science+Business Media New York.
Publisher
Kluwer Academic Publishers
United States
Publication History
Published: 01 June 2017
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 05 Feb 2025