research-article

Adaptive quality of service management for enterprise services

Authors:

Stefan Krompass,

Andreas Scholz,

Alfons KemperAuthors Info & Claims

ACM Transactions on the Web (TWEB), Volume 2, Issue 1

Article No.: 8, Pages 1 - 46

https://doi.org/10.1145/1326561.1326569

Published: 03 March 2008 Publication History

Abstract

In the past, enterprise resource planning systems were designed as monolithic software systems running on centralized mainframes. Today, these systems are (re-)designed as a repository of enterprise services that are distributed throughout the available computing infrastructure. These service oriented architectures (SOAs) require advanced automatic and adaptive management concepts in order to achieve a high quality of service level in terms of, for example, availability, responsiveness, and throughput. The adaptive management has to allocate service instances to computing resources, adapt the resource allocation to unforeseen load fluctuations, and intelligently schedule individual requests to guarantee negotiated service level agreements (SLAs). Our AutoGlobe platform provides such a comprehensive adaptive service management comprising

—static service-to-server allocation based on automatically detected service utilization patterns,

—adaptive service management based on a fuzzy controller that remedies exceptional situations by automatically initiating, for example, service migration, service replication (scale-out), and

—adaptive scheduling of individual service requests that prioritizes requests depending on the current degree of service level conformance.

All three complementary control components are described in detail, and their effectiveness is analyzed by means of realistic business application scenarios.

References

[1]

Abbott, R. K. and Garcia-Molina, H. 1988a. Scheduling real-time transactions. SIGMOD Rec. 17, 1, 71--81.

Digital Library

[2]

Abbott, R. K. and Garcia-Molina, H. 1988b. Scheduling real-time transactions: A performance evaluation. In Proceedings of the 14th International Conference on Very Large Data Bases, F. Bancilhon and D. J. DeWitt, Eds. Morgan Kaufmann, 1--12.

Digital Library

[3]

Agarwal, V., Dasgupta, K., Karnik, N., Kumar, A., Kundu, A., Mittal, S., and Srivastava, B. 2005. A service creation environment based on end-to-end composition of Web Services. In Proceedings of the International World Wide Web Conference (WWW). ACM Press, New York, NY, 128--137.

Digital Library

[4]

AutoGlobe. AutoGlobe simulation studies. http://www-db.in.tum.de/research/projects/AutoGlobe/simulationStudies/.

[5]

Beeri, C., Eyal, A., Kamenkovich, S., and Milo, T. 2005. Querying business processes with BP-QL. In Proceedings of the International Conference on Very Large Data Bases (VLDB). Trondheim, Norway. 343--354.

Digital Library

[6]

Bennani, M. N. and Menasce, D. A. 2005. Resource allocation for autonomic data centers using analytic performance models. In Proceedings of the 2nd International Conference on Automatic Computing (ICAC'05). IEEE Computer Society, 229--240.

Digital Library

[7]

Bodik, P., Friedman, G., Biewald, L., Levine, H., Candea, G., Patel, K., Tolle, G., Hui, J., Fox, A., Jordan, M. I., and Patterson, D. 2005. Combining visualization and statistical analysis to improve operator confidence and efficiency for failure detection and localization. In Proceedings of the 2nd International Conference on Autonomic Computing (ICAC). IEEE Computer Society, 89--100.

Digital Library

[8]

Bonatti, P. A. and Festa, P. 2005. On optimal service selection. In Proceedings of the International World Wide Web Conference (WWW). ACM Press, New York, NY, 530--538.

Digital Library

[9]

Box, G., Gwilym, Jenkins, and Reinsel, G. 1994. Time Series Analysis: Forecasting and Control, 3rd ed. Prentice Hall, Englewood Cliffs, NJ.

Digital Library

[10]

Braumandl, R., Kemper, A., and Kossmann, D. 2003. Quality of service in an information economy. ACM Trans. Inter. Tech. 3, 4, 291--333.

Digital Library

[11]

Brown, K. P., Carey, M. J., and Livny, M. 1993. Managing memory to meet multiclass workload response time goals. In Prooceedings of the 19th International Conference on Very Large Data Bases, J. Clifford and R. King, Eds. Morgan Kaufmann Publishers Inc., 328-- 341.

Digital Library

[12]

Brown, K. P., Carey, M. J., and Livny, M. 1996. Goal-oriented buffer management revisited. In Proceedings of the ACM SIGMOD International Conference on Management of Data, H. V. Jagadish and I. S. Mumick, Eds. ACM Press, 353--364.

Digital Library

[13]

Brown, K. P., Mehta, M., Carey, M. J., and Livny, M. 1994. Towards automated performance tuning for complex workloads. In Proceedings of 20th International Conference on Very Large Data Bases (VLDB'94). Morgan Kaufmann, 72--84.

Digital Library

[14]

Carey, M. J., Jauhari, R., and Livny, M. 1989. Priority in DBMS resource scheduling. In Proceedings of the 15th International Conference on Very Large Data Bases, P. Apers and G. Wiederhold, Eds. Morgan Kaufmann, 397--410.

Digital Library

[15]

Castellanos, M., Casati, F., Shan, M.-C., and Dayal, U. 2005. iBOM: a platform for intelligent business operation management. In Proceedings of the International Conference on Data Engineering (ICDE). IEEE Computer Society, 1084--1095.

Digital Library

[16]

Chaudhuri, S., Dageville, B., and Lohman, G. 2004. Self-managing technology in database management systems. The International Conference on Very Large Data Bases (VLDB) Tutorial, Toronto, Canada.

Digital Library

[17]

Cohen, I., Goldszmidt, M., Kelly, T., Symons, J., and Chase, J. S. 2004. Correlating instrumentation data to system states: A building block for automated diagnosis and control. In Operating System Design and Implementation (OSDI). San Francisco, CA.

Digital Library

[18]

Condor. http://www.cs.wisc.edu/condor/.

[19]

Dinda, P. A. and O'Hallaron, D. R. 1999. An evaluation of linear models for host load prediction. In Proceedings of the 8th IEEE International Symposium on High Performance Distributed Computing (HPDC). IEEE Computer Society, 87--96.

Digital Library

[20]

Doyle, R. P., Chase, J. S., Asad, O. M., Jin, W., and Vahdat, A. 2003. Model-based resource provisioning in a Web service utility. In USENIX Symposium on Internet Technologies and Systems.

Digital Library

[21]

EGA. Enterprise Grid Alliance. http://www.gridalliance.org.

[22]

Elnikety, S., Nahum, E., Tracey, J., and Zwaenepoel, W. 2004. A method for transparent admission control and request scheduling in e-commerce Web sites. In Proceedings of the International World Wide Web Conference (WWW). ACM Press, 66--73.

Digital Library

[23]

Fisher, M. L. and Krieger, A. M. 1984. Analysis of a linearization heuristic for single-machine scheduling to maximize profit. Math. Program. 28, 218--225.

[24]

FlexFrame. FlexFrame für mySAP business suite. http://www.fujitsu-siemens.de/le/solutions/it_infrastructure_solutions/sap_infrastructure/index.html.

[25]

Gmach, D., Krompass, S., Seltzsam, S., and Kemper, A. 2005. Dynamic load balancing of virtualized database services using hints and load forecasting. In Proceedings of the 1st International Workshop on Adaptive and Self-Managing Enterprise Applications (CASE'05), J. Castro and E. Teniente, Eds. Vol. 2. 23--37.

[26]

Gray, J. and Reuter, A. 1993. Transaction Processing: Concepts and Techniques. Morgan Kaufmann.

Digital Library

[27]

Hellerstein, J. L., Diao, Y., Parekh, S., and Tilbury, D. M. 2004. Feedback Control of Computing Systems. John Wiley & Sons.

Digital Library

[28]

Hellerstein, J. L., Zhang, F., and Shahabuddin, P. 2001. A statistical approach to predictive detection. Comput. Netw. 35, 1, 77--95.

Digital Library

[29]

Hofmeyer, S. 2004. Flexibler geht's nicht. SAP Info---Das SAP-Magazin 121. 60--62.

[30]

Horn, P. 2001. Autonomic computing: IBM's perspective on the state of information technology. http://www.research.ibm.com/autonomic/manifesto/autonomic_computing.pdf.

[31]

HP. Infrastructure and management solutions for the adaptive enterprise White Paper. http://www.hp.com/products1/promos/adaptive_enterprise/us/pdf_adaptive_enterprise.html.

[32]

HP OpenView. 2007. http://openview.hp.com.

[33]

IBM Director. IBM Director 5.10. http://www-03.ibm.com/servers/eserver/xseries/systems_management/ibm_director/.

[34]

IBM Dynamic Infrastructure. IBM dynamic infrastructure for mySAP business suite. http://www.ibm.com/solutions/sap/us/en/xslpage/xmlid/25044.

[35]

IBM PMAC 2005. Policy management for autonomic computing---developer's guide and reference. http://dl.alphaworks.ibm.com/tech/pmac/PMDevGuide121.pdf.

[36]

Jin, L., Casati, F., Sayal, M., and Shan, M.-C. 2001. Load balancing in distributed workflow management system. In Proceedings of the ACM Symposium on Applied Computing (SAC). Las Vegas, NV, 522--530.

Digital Library

[37]

Karbhari, P., Rabinovich, M., Xiao, Z., and Douglis, F. 2002. ACDN: A content delivery network for applications. In Proceedings of the ACM SIGMOD (Project Demo). 619.

Digital Library

[38]

Keidl, M., Seltzsam, S., and Kemper, A. 2003. Reliable Web service execution and deployment in dynamic environments. In Proceedings of the International Workshop on Technologies for E-Services (TES). Lecture Notes in Computer Science, vol. 2819. 104-- 118.

[39]

Keidl, M., Seltzsam, S., Stocker, K., and Kemper, A. 2002. ServiceGlobe: Distributing e-services across the Internet (Demonstration). In Proceedings of the International Conference on Very Large Data Bases (VLDB). Hong Kong, China, 1047--1050.

Digital Library

[40]

Kleinbaum, D. G., Kupper, L. L., and Muller, K. E., Eds. 1988. Applied Regression Analysis and Other Multivariable Methods. PWS Publishing Co., Boston, MA.

Digital Library

[41]

Klir, G. J. and Yuan, B. 1994. Fuzzy Sets and Fuzzy Logic: Theory and Applications. Prentice Hall, Upper Saddle River, NJ.

Digital Library

[42]

Kraiss, A., Schön, F., Weikum, G., and Deppisch, U. 2001. Towards response time guarantees for e-service middleware. IEEE Data Engin. Bull. 24, 1, 58--63.

[43]

Kraiss, A., Schön, F., Weikum, G., and Deppisch, U. 2002. With HEART towards response time guarantees for message-based e-services. In Proceedings of the 8th International Conference on Extending Database Technology (EDBT). Springer, 732--735.

Digital Library

[44]

Krompass, S., Gmach, D., Scholz, A., Seltzsam, S., and Kemper, A. 2006. Quality of service enabled database applications. In Proceedings of the Service-Oriented Computing---(ICSOC'06). Lecture Notes in Computer Science, vol. 4294. 215--226.

Digital Library

[45]

Li, W.-S., Batra, V. S., Raman, V., Han, W., and Narang, I. 2005. QoS-based data access and placement for federated information systems. In Proceedings of the 31st International Conference on Very Large Data Bases, K. Böhm, C. S. Jensen, L. M. Haas, M. L. Kersten, P.-Å. Larson, and B. C. Ooi, Eds. 1358--1362.

Digital Library

[46]

Liu, Y., Ngu, A. H. H., and Zeng, L. 2004. QoS computation and policing in dynamic Web service selection. In Proceedings of the International World Wide Web Conference (WWW). ACM Press, 66--73.

Digital Library

[47]

MaxDB. http://www.mysql.com/products/maxdb/.

[48]

McWherter, D. T., Schroeder, B., Ailamaki, A., and Harchol-Balter, M. 2004. Priority mechanisms for OLTP and transactional Web applications. In Proceedings of the 20th International Conference on Data Engineering (ICDE'04). IEEE Computer Society, 535-- 546.

Digital Library

[49]

Menasce, D. 2003a. Automatic QoS control. IEEE Inter. Comput. 7, 1.

Digital Library

[50]

Menasce, D. 2003b. Workload characterization. IEEE Inter. Comput. 7, 5.

Digital Library

[51]

Niu, B., Martin, P., Powley, W., Horman, R., and Bird, P. 2006. Workload adaptation in autonomic DBMSs. In Proceedings of the 2006 Conference of the Center for Advanced Studies on Collaborative Research (CASCON'06). ACM Press, 13.

Digital Library

[52]

nworks. 2007. nworks: VMware Management. http://www.nworks.com/vmware.

[53]

Ocèano Project. 2003. http://www.research.ibm.com/oceanoproject.

[54]

OGF. Grid Resource Allocation Agreement Protocol Working Group (GRAAP-WG). https://forge.gridforum.org/sf/projects/graap-wg.

[55]

Pang, H., Carey, M. J., and Livny, M. 1995. Multiclass query scheduling in real-time database systems. IEEE Trans. Knowl. Data Engin. 7, 4, 533--551.

Digital Library

[56]

Petersen, U., Dreyer, S., and Paira, N. 2004. A flexible framework. SAP INFO---The SAP Maga. 120, 64--65.

[57]

Porter, G. and Katz, R. H. 2006. Effective Web service load balancing through statistical monitoring. Commun. ACM 49, 3, 48--54.

Digital Library

[58]

Pradhan, P., Tewari, R., Sahu, S., Chandra, A., and Shenoy, P. 2002. An observation-based approach towards self-managing Web servers. In Proceedings of ACM/IEEE International Workshop on Quality of Service (IWQoS). Miami Beach, FL. 13--22.

[59]

Rinnooy Kan, A. 1976. Machine Scheduling Problems: Classification, Complexity and Computations. Martinus Nijhoff, The Hague, The Netherlands.

[60]

Rolia, J., Zhu, X., Arlitt, M., and Andrzejak, A. 2004. Statistical service assurances for applications in utility grid environments. Performance Eval. 58, 2+3, 319--339.

Digital Library

[61]

SAP. 2003. SAP keynote: Turning vision into reality: Customer roadmaps to lower TCO. http:// www.sap.com/community/events/2003_orlando/keynotes.asp.SAPPHIRE'03.

[62]

SAP Netweaver. http://www.sap.com/solutions/netweaver/.

[63]

Sayal, M., Casati, F., Dayal, U., and Shan, M.-C. 2002. Business process cockpit. In Proceedings of the International Conference on Very Large Data Bases (VLDB). Hong Kong, China, 880-- 883.

Digital Library

[64]

Schroeder, B., Harchol-Balter, M., Iyengar, A., and Nahum, E. 2006a. Achieving class-based QoS for transactional workloads. In Proceedings of the 22nd International Conference on Data Engineering (ICDE'06). IEEE Computer Society, 1--2.

Digital Library

[65]

Schroeder, B., Harchol-Balter, M., Iyengar, A., and Nahum, E. 2006b. How to determine a good multi-programming level for external scheduling. In Proceedings of the 22nd International Conference on Data Engineering. IEEE Computer Society, 60.

Digital Library

[66]

Seltzsam, S., Börzsönyi, S., and Kemper, A. 2001. Security for distributed e-service composition. In Proceedings of the International Workshop on Technologies for E-Services (TES). Lecture Notes in Computer Science, vol. 2193. 147--162.

Digital Library

[67]

Seltzsam, S., Gmach, D., Krompass, S., and Kemper, A. 2006. AutoGlobe: An automatic administration concept for service-oriented database applications. In Proceedings of the 22nd International Conference on Data Engineering (ICDE'06), Industrial Track. Atlanta, GA, 90.

Digital Library

[68]

SUN N1. N1 Advanced Architecture für SAP. http://de.sun.com/solutions/solution_sales/sap_erp/n1aa/index.html.

[69]

TPC-C. TPC Benchmark C, Standard Specification Version 5.4. http://www.tpc.org/tpcc/.

[70]

Urgaonkar, B., Pacifici, G., Shenoy, P., Spreitzer, M., and Tantawi, A. 2007. An analytical model for multi-tier Internet services and its applications. ACM Trans. Web 1, 1.

Digital Library

[71]

Vilalta, R., Apte, C. V., Hellerstein, J. L., Ma, S., and Weiss, S. M. 2002. Predictive algorithms in the management of computer systems. IBM Syst. J. 41, 3, 461--474.

Digital Library

[72]

Weikum, G., Mönkeberg, A., Hasse, C., and Zabback, P. 2002. Self-tuning database technology and information services: From wishful thinking to viable engineering. In Proceedings of the International Conference on Very Large Data Bases (VLDB). Hong Kong, China, 20-- 31.

Digital Library

[73]

Xu, W., Zhu, X., Singhal, S., and Wang, Z. 2001. Predictive control for dynamic resource allocation in enterprise data centers. In Proceedings of the 10th IEEE/IFIP Network Operations and Management Symposium (NOMS). IEEE Computer Society, 115--126.

[74]

Zadeh, L. A. 1965. Fuzzy sets. Inform. Control 8, 3, 338--353.

[75]

Zeng, L., Benatallah, B., Ngu, A. H. H., Dumas, M., Kalagnanam, J., and Chang, H. 2004. QoS-aware middleware for Web services composition. IEEE Trans. Softw. Engin. 30, 311--327.

Digital Library

Cited By

Kondratenko NKovalenko LCirella GDoroshenko HBabych SArtiukh T(2024)Modeling a System of Adaptive Management of Manufacturing Enterprises in Ukraine: Political, Economic, Socio-cultural, and Technological AnalysisHandbook on Post-War Reconstruction and Development Economics of Ukraine10.1007/978-3-031-48735-4_6(85-102)Online publication date: 16-Feb-2024
https://doi.org/10.1007/978-3-031-48735-4_6
Hassan MAli SImad MBibi S(2022)New Advancements in Cybersecurity: A Comprehensive SurveyBig Data Analytics and Computational Intelligence for Cybersecurity10.1007/978-3-031-05752-6_1(3-17)Online publication date: 2-Sep-2022
https://doi.org/10.1007/978-3-031-05752-6_1
Müller HKharitonov ANahhas ABosse STurowski K(2021)Addressing IT Capacity Management Concerns Using Machine Learning TechniquesSN Computer Science10.1007/s42979-021-00862-83:1Online publication date: 29-Oct-2021
https://dl.acm.org/doi/10.1007/s42979-021-00862-8
Show More Cited By

Index Terms

Recommendations

Towards adaptive management of QoS-aware service compositions
Special Issue on "Advances in Grid services Engineering and Management"

Service compositions enable users to realize their complex needs as a single request. Despite intensive research, especially in the area of business processes, web services and grids, an open and valid question is still how to manage service ...
Workflow composition of service level agreements for web services

Service-oriented architecture enables an environment where businesses can expose services for use by their collaborators and their peer organizations. In this dynamic environment, organizations require the use of service level agreements (SLAs) to ...
Quality of Service Management for Web Service Compositions
CSE '08: Proceedings of the 2008 11th IEEE International Conference on Computational Science and Engineering

Typically, scientific applications have to be distributed across computational grid infrastructures. These applications can use existent grid services. Service components in this kind of application may have different computational platforms that should ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on the Web

ACM Transactions on the Web Volume 2, Issue 1

February 2008

280 pages

ISSN:1559-1131

EISSN:1559-114X

DOI:10.1145/1326561

Issue’s Table of Contents

Copyright © 2008 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 03 March 2008

Accepted: 01 July 2007

Revised: 01 December 2006

Received: 01 March 2006

Published in TWEB Volume 2, Issue 1

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

69
Total Citations
View Citations
2,086
Total Downloads

Downloads (Last 12 months)20
Downloads (Last 6 weeks)2

Reflects downloads up to 30 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kondratenko NKovalenko LCirella GDoroshenko HBabych SArtiukh T(2024)Modeling a System of Adaptive Management of Manufacturing Enterprises in Ukraine: Political, Economic, Socio-cultural, and Technological AnalysisHandbook on Post-War Reconstruction and Development Economics of Ukraine10.1007/978-3-031-48735-4_6(85-102)Online publication date: 16-Feb-2024
https://doi.org/10.1007/978-3-031-48735-4_6
Hassan MAli SImad MBibi S(2022)New Advancements in Cybersecurity: A Comprehensive SurveyBig Data Analytics and Computational Intelligence for Cybersecurity10.1007/978-3-031-05752-6_1(3-17)Online publication date: 2-Sep-2022
https://doi.org/10.1007/978-3-031-05752-6_1
Müller HKharitonov ANahhas ABosse STurowski K(2021)Addressing IT Capacity Management Concerns Using Machine Learning TechniquesSN Computer Science10.1007/s42979-021-00862-83:1Online publication date: 29-Oct-2021
https://dl.acm.org/doi/10.1007/s42979-021-00862-8
Wang RJi W(2020)Computational Intelligence for Information Security: A SurveyIEEE Transactions on Emerging Topics in Computational Intelligence10.1109/TETCI.2019.29234264:5(616-629)Online publication date: Oct-2020
https://doi.org/10.1109/TETCI.2019.2923426
Gandhi ADube PKarve AKochut AZhang L(2020)Providing Performance Guarantees for Cloud-Deployed ApplicationsIEEE Transactions on Cloud Computing10.1109/TCC.2017.27714028:1(269-281)Online publication date: 1-Jan-2020
https://doi.org/10.1109/TCC.2017.2771402
Grohmann JNicholson PIglesias JKounev SLugones D(2019)MonitorlessProceedings of the 20th International Middleware Conference10.1145/3361525.3361543(149-162)Online publication date: 9-Dec-2019
https://dl.acm.org/doi/10.1145/3361525.3361543
Muller HBosse STurowski K(2019)On the Utility of Machine Learning for Service Capacity Management of Enterprise Applications2019 15th International Conference on Signal-Image Technology & Internet-Based Systems (SITIS)10.1109/SITIS.2019.00053(274-281)Online publication date: Nov-2019
https://doi.org/10.1109/SITIS.2019.00053
Wajahat MKarve AKochut AGandhi A(2017)MLscale: A machine learning based application-agnostic autoscalerSustainable Computing: Informatics and Systems10.1016/j.suscom.2017.10.003Online publication date: Oct-2017
https://doi.org/10.1016/j.suscom.2017.10.003
Yoon DNiu NMozafari BÖzcan FKoutrika GMadden S(2016)DBSherlockProceedings of the 2016 International Conference on Management of Data10.1145/2882903.2915218(1599-1614)Online publication date: 26-Jun-2016
https://dl.acm.org/doi/10.1145/2882903.2915218
Wajahat MGandhi AKarve AKochut A(2016)Using machine learning for black-box autoscaling2016 Seventh International Green and Sustainable Computing Conference (IGSC)10.1109/IGCC.2016.7892598(1-8)Online publication date: 2016
https://doi.org/10.1109/IGCC.2016.7892598
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents