Abstract
The large scale of the Internet has offered unique economic opportunities, that in turn introduce overwhelming challenges for development and operations to provide reliable and fast services in order to meet the high demands on the performance of online services. In this paper, we investigate how performance engineers can identify three different classes of externally-visible performance problems (global delays, partial delays, periodic delays) from concrete traces. We develop a simulation model based on a taxonomy of root causes in server performance degradation. Within an experimental setup, we obtain results through synthetic monitoring of a target Web service, and observe changes in Web performance over time through exploratory visual analysis and changepoint detection. Finally, we interpret our findings and discuss various challenges and pitfalls.
Chapter PDF
Similar content being viewed by others
Keywords
- Control Chart
- Performance Degradation
- Periodic Delay
- Performance Change
- Service Level Agreement Violation
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Aguilera, M.K., Mogul, J.C., Wiener, J.L., Reynolds, P., Muthitacharoen, A.: Performance debugging for distributed systems of black boxes. ACM SIGOPS Operating Systems Review 37, 74–89 (2003)
Borzemski, L.: The experimental design for data mining to discover web performance issues in a wide area network. Cybernetics and Systems 41(1), 31–45 (2010)
Borzemski, L., Drwal, M.: Time series forecasting of web performance data monitored by MWING multiagent distributed system. In: Pan, J.-S., Chen, S.-M., Nguyen, N.T. (eds.) ICCCI 2010, Part I. LNCS, vol. 6421, pp. 20–29. Springer, Heidelberg (2010)
Borzemski, L., Kamińska-Chuchmała, A.: Knowledge discovery about web performance with geostatistical turning bands method. In: König, A., Dengel, A., Hinkelmann, K., Kise, K., Howlett, R.J., Jain, L.C. (eds.) KES 2011, Part II. LNCS, vol. 6882, pp. 581–590. Springer, Heidelberg (2011)
Borzemski, L., Kaminska-Chuchmala, A.: Knowledge engineering relating to spatial web performance forecasting with sequential gaussian simulation method. In: KES, pp. 1439–1448 (2012)
Borzemski, L., Kliber, M., Nowak, Z.: Using data mining algorithms in web performance prediction. Cybernetics and Systems 40(2), 176–187 (2009)
Bouch, A., Kuchinsky, A., Bhatti, N.: Quality is in the eye of the beholder: meeting users’ requirements for internet quality of service. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 297–304. ACM (2000)
Chen, M.Y., Kiciman, E., Fratkin, E., Fox, A., Brewer, E.: Pinpoint: Problem determination in large, dynamic internet services. In: Proceedings of International Conference on Dependable Systems and Networks, DSN 2002, pp. 595–604. IEEE (2002)
Chen, Y., Mahajan, R., Sridharan, B., Zhang, Z.-L.: A provider-side view of web search response time. SIGCOMM Comput. Commun. Rev. 43(4), 243–254 (2013)
Cherkasova, L., Ozonat, K., Mi, N., Symons, J., Smirni, E.: Automated anomaly detection and performance modeling of enterprise applications. ACM Transactions on Computer Systems (TOCS) 27(3), 6 (2009)
Cohen, I., Zhang, S., Goldszmidt, M., Symons, J., Kelly, T., Fox, A.: Capturing, indexing, clustering, and retrieving system history. ACM SIGOPS Operating Systems Review 39, 105–118 (2005)
Heikes, R.G., Montgomery, D.C., Rardin, R.L.: Using common random numbers in simulation experiments - an approach to statistical analysis. Simulation 27(3), 81–85 (1976)
Jaccard, P.: The distribution of the flora in the alpine zone. 1. New Phytologist 11(2), 37–50 (1912)
King, A.: Speed up your site: Web site optimization. New Riders, Indianapolis (2003)
Leitner, P., Ferner, J., Hummer, W., Dustdar, S.: Data-Driven Automated Prediction of Service Level Agreement Violations in Service Compositions. Distributed and Parallel Databases 31(3), 447–470 (2013)
Liu, Z., Niclausse, N., Jalpa-Villanueva, C., Barbier, S.: Traffic Model and Performance Evaluation of Web Servers. Technical Report RR-3840, INRIA (December 1999)
Magalhaes, J.P., Silva, L.M.: Anomaly detection techniques for web-based applications: An experimental study. In: 2012 11th IEEE International Symposium on Network Computing and Applications (NCA), pp. 181–190. IEEE (2012)
Matsumoto, M., Nishimura, T.: Mersenne twister: A 623-dimensionally equidistributed uniform pseudo-random number generator. ACM Transactions on Modeling and Computer Simulation (TOMACS) 8(1), 3–30 (1998)
Nguyen, T.H., Adams, B., Jiang, Z.M., Hassan, A.E., Nasser, M., Flora, P.: Automated detection of performance regressions using statistical process control techniques. In: Proceedings of the Third Joint WOSP/SIPEW International Conference on Performance Engineering, pp. 299–310. ACM (2012)
R Core Team. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing, Vienna, Austria, (2013)
Forrester research. Ecommerce web site performance today: An updated look at consumer reaction to a poor online shopping experience (August 2009)
Shirazi, B.A., Kavi, K.M., Hurson, A.R. (eds.): Scheduling and Load Balancing in Parallel and Distributed Systems. IEEE Computer Society Press, Los Alamitos (1995)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Cito, J., Suljoti, D., Leitner, P., Dustdar, S. (2014). Identifying Root Causes of Web Performance Degradation Using Changepoint Analysis. In: Casteleyn, S., Rossi, G., Winckler, M. (eds) Web Engineering. ICWE 2014. Lecture Notes in Computer Science, vol 8541. Springer, Cham. https://doi.org/10.1007/978-3-319-08245-5_11
Download citation
DOI: https://doi.org/10.1007/978-3-319-08245-5_11
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-08244-8
Online ISBN: 978-3-319-08245-5
eBook Packages: Computer ScienceComputer Science (R0)