research-article

Adaptive Resource Provisioning for Virtualized Servers Using Kalman Filters

Authors:

Evangelia Kalyvianaki,

Themistoklis Charalambous,

Steven HandAuthors Info & Claims

ACM Transactions on Autonomous and Adaptive Systems (TAAS), Volume 9, Issue 2

Article No.: 10, Pages 1 - 35

https://doi.org/10.1145/2626290

Published: 01 July 2014 Publication History

Abstract

Resource management of virtualized servers in data centers has become a critical task, since it enables cost-effective consolidation of server applications. Resource management is an important and challenging task, especially for multitier applications with unpredictable time-varying workloads. Work in resource management using control theory has shown clear benefits of dynamically adjusting resource allocations to match fluctuating workloads. However, little work has been done toward adaptive controllers for unknown workload types. This work presents a new resource management scheme that incorporates the Kalman filter into feedback controllers to dynamically allocate CPU resources to virtual machines hosting server applications. We present a set of controllers that continuously detect and self-adapt to unforeseen workload changes. Furthermore, our most advanced controller also self-configures itself without any a priori information and with a small 4.8% performance penalty in the case of high-intensity workload changes. In addition, our controllers are enhanced to deal with multitier server applications: by using the pair-wise resource coupling between tiers, they improve server response to large workload increases as compared to controllers with no such resource-coupling mechanism. Our approaches are evaluated and their performance is illustrated on a 3-tier Rubis benchmark website deployed on a prototype Xen-virtualized cluster.

References

[1]

Virgilio Almeida, Martin Arlitt, and Jerry Rolia. 2002. Analyzing a web-based system’s performance measures at multiple time scales. SIGMETRICS Performance Evaluation Review 30, 2 (2002), 3--9.

Digital Library

[2]

Cristiana Amza, Anupam Chandra, Alan L. Cox, Sameh Elnikety, Romer Gil, Karthick Rajamani, Willy Zwaenepoel, Emmanuel Cecchet, and Julie Marguerite. 2002. Specification and implementation of dynamic web site benchmarks. In Proceedings of the 5th Annual IEEE Workshop on Workload Characterization (WWW-5). 3--13.

[3]

Paul Barham, Boris Dragovic, Keir Fraser, Steven Hand, Tim Harris, Alex Ho, Rolf Neugebauer, Ian Pratt, and Andrew Warfield. 2003. Xen and the art of virtualization. In Proceedings of the 19th ACM Symposium on Operating Systems Principles (SOSP’03). ACM, New York, NY, 164--177.

Digital Library

[4]

Emmanuel Cecchet, Anupam Chanda, Sameh Elnikety, Julie Marguerite, and Willy Zwaenepoel. 2003. Performance comparison of middleware architectures for generating dynamic web content. In Proceedings of the ACM/IFIP/USENIX 2003 International Conference on Middleware (Middleware’03). Springer-Verlag, New York, NY, 242--261.

Digital Library

[5]

Emmanuel Cecchet, Julie Marguerite, and Willy Zwaenepoel. 2002. Performance and scalability of EJB applications. In Proceedings of the 17th ACM SIGPLAN Conference on Object-oriented Programming, Systems, Languages, and Applications (OOPSLA’02). ACM, New York, NY, 246--261.

Digital Library

[6]

Themistoklis Charalambous and Evangelia Kalyvianaki. 2010. A min-max framework for CPU resource provisioning in virtualized servers using H_∞ filters. In Proceedings of the 49th IEEE Conference on Decision and Control (CDC’10). 3778--3783.

[7]

Jeffrey S. Chase, Darrell C. Anderson, Prachi N. Thakar, Amin M. Vahdat, and Ronald P. Doyle. 2001. Managing energy and server resources in hosting centers. In Proceedings of the 18th ACM Symposium on Operating Systems Principles (SOSP’01). ACM, New York, NY, 103--116.

Digital Library

[8]

Mike Y. Chen, Anthony Accardi, Emre Kiciman, Jim Lloyd, Dave Patterson, Armando Fox, and Eric Brewer. 2004. Path-based faliure and evolution management. In Proceedings of the 1st Conference on Symposium on Networked Systems Design and Implementation (NSDI’04). USENIX Association, Berkeley, CA, 309--322.

Digital Library

[9]

Ludmila Cherkasova and Rob Gardner. 2005. Measuring CPU overhead for I/O processing in the Xen virtual machine monitor. In Proceedings of the Annual USENIX Technical Conference (USENIX’05). USENIX Association, Berkeley, CA, 387--390.

Digital Library

[10]

Eduardo F. Costa and Alessandro Astolfi. 2008. On the stability of the recursive Kalman filter for linear time-invariant systems. In Proceedings of the American Control Conference (CDC’08). 1286--1291.

[11]

Jeffrey Dean and Sanjay Ghemawat. 2004. MapReduce: Simplified data processing on large clusters. In Proceedings of the 6th Symposium on Operating Systems Design & Implementation (OSDI’’04). ACM, New York, NY, 137--150.

Digital Library

[12]

Zhenhuan Gong, Xiaohui Gu, and John Wilkes. 2010. PRESS: Predictive elastic resource scaling for cloud systems. In International Conference on Network and Service Management (CNSM’10). IEEE Computer Society, Washington, DC, 9--16.

[13]

Gueyoung Jung, Kaustubh R. Joshi, Matti A. Hiltunen, Richard D. Schlichting, and Calton Pu. 2008. Generating adaptation policies for multi-tier applications in consolidated server environments. In Proceedings of the 2008 International Conference on Autonomic Computing (ICAC’08). IEEE Computer Society, Washington, DC, 23--32.

Digital Library

[14]

Rudolph E. Kalman. 1960. A new approach to linear filtering and prediction problems. Transactions of the ASME--Journal of Basic Engineering 82, Series D (1960), 35--45.

[15]

Evangelia Kalyvianaki, Themistoklis Charalambous, and Steven Hand. 2009. Self-adaptive and self-configured CPU resource provisioning for virtualized servers using Kalman filters. In Proceedings of the 6th International Conference on Autonomic Computing (ICAC’09). ACM, New York, NY, 117--126.

Digital Library

[16]

Evangelia Kalyvianaki, Themistoklis Charalambous, and Steven Hand. 2010. Resource provisioning for multi-tier virtualized server applications. Computer Measurement Group Journal (CMG), Spring Issue 126 (2010), 6--17.

[17]

Minkyong Kim and Brian Noble. 2001. Mobile network estimation. In Proceedings of the 7th Annual International Conference on Mobile Computing and Networking (MobiCom’01). ACM, New York, NY, 298--309.

Digital Library

[18]

Sajib Kundu, Raju Rangaswami, Ajay Gulati, Ming Zhao, and Kaushik Dutta. 2012. Modeling virtualized applications using machine learning techniques. In Proceedings of the 8th ACM SIGPLAN/SIGOPS Conference on Virtual Execution Environments (VEE’12). ACM Press, New York, 3--12.

Digital Library

[19]

Xue Liu, Xiaoyun Zhu, P. Padala, Zhikui Wang, and S. Singhal. 2007. Optimal multivariate control for differentiated services on a shared hosting platform. In Proceedings of the 46th IEEE Conference on Decision and Control. IEEE Computer Society, Washington, DC, 3792--3799.

[20]

Peter S. Maybeck. 1979. Stochastic Models, Estimation, and Control. Mathematics in Science and Engineering, Vol. 141. Academic Press, New York.

[21]

Daniel A. Menasce and Mohamed N. Bennani. 2006. Autonomic virtualized environments. In Proceedings of the International Conference on Autonomic and Autonomous Systems (ICAS’06). IEEE Computer Society, Washington, DC, 28.

Digital Library

[22]

Aravind Menon, Jose Renato Santos, Yoshio Turner, G. (John) Janakiraman, and Willy Zwaenepoel. 2005. Diagnosing performance overheads in the xen virtual machine environment. In Proceedings of the 1st ACM/USENIX International Conference on Virtual Execution Environments (VEE’05). ACM Press, New York, NY, 13--23.

Digital Library

[23]

Hiep Nguyen, Zhiming Shen, Xiaohui Gu, Sethuraman Subbiah, and John Wilkes. 2013. AGILE: Elastic distributed resource scaling for infrastructure-as-a-service. In Proceedings of the 10th International Conference on Autonomic Computing (ICAC’13). 69--82.

[24]

Pradeep Padala, Kai-Yuan Hou, Kang G. Shin, Xiaoyun Zhu, Mustafa Uysal, Zhikui Wang, Sharad Singhal, and Arif Merchant. 2009. Automated control of multiple virtualized resources. In Proceedings of the 4th ACM European Conference on Computer systems (EuroSys’09). ACM, New York, NY, 13--26.

Digital Library

[25]

Pradeep Padala, Kang G. Shin, Xiaoyun Zhu, Mustafa Uysal, Zhikui Wang, Sharad Singhal, Arif Merchant, and Kenneth Salem. 2007. Adaptive control of virtualized resources in utility computing environments. In Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 2007 (EuroSys’07). ACM, New York, NY, 289--302.

Digital Library

[26]

Zhiming Shen, Sethuraman Subbiah, Xiaohui Gu, and John Wilkes. 2011. CloudScale: Elastic resource scaling for multi-tenant cloud systems. In Proceedings of the 2nd ACM Symposium on Cloud Computing (SOCC’11). ACM, New York, NY.

Digital Library

[27]

Dan Simon. 2006. Optimal State Estimation. John Wiley & Sons, Inc.

[28]

Gerald Tesauro, Nicholas K. Jong, Rajarshi Das, and Mohamed N. Bennani. 2007. On the use of hybrid reinforcement learning for autonomic resource allocation. Cluster Computing 10, 3 (2007), 287--299.

Digital Library

[29]

Bhuvan Urgaonkar and Prashant Shenoy. 2004. Sharc: Managing CPU and network bandwidth in shared clusters. IEEE Transactions Parallel Distributed Systems (TPDS’04) 15, 1 (Jan. 2004), 2--17.

Digital Library

[30]

Bhuvan Urgaonkar, Prashant Shenoy, Abhishek Chandra, Pawan Goyal, and Timothy Wood. 2008. Agile dynamic provisioning of multi-tier internet applications. Transactions on Autonomic and Adaptive Systems (TAAS’08) 3, 1 (2008), 1:1--1:39.

Digital Library

[31]

Bhuvan Urgaonkar, Prashant Shenoy, and Timothy Roscoe. 2002. Resource overbooking and application profiling in shared hosting platforms. SIGOPS Operating Systems Review 36, SI (Dec. 2002), 239--254.

Digital Library

[32]

Zhikui Wang, Xue Liu, Alex Zhang, Christopher Stewart, Xiaoyun Zhu, Terence Kelly, and Sharad Singhal. 2007. AutoParam: Automated control of application-level performance in virtualized server environments. In Proceedings of the 2nd International Workshop on Feedback Control Implementation and Design in Computing Systems and Networks (FeBID’07).

[33]

Zhikui Wang, Xiaoyun Zhu, and Sharad Singhal. 2005. Utilization and SLO-Based control for dynamic sizing of resource partitions. In Proceedings of the 16th IFIP/IEEE Ambient Networks International Conference on Distributed Systems: Operations and Management (DSOM’05). Springer-Verlag, Berlin, 133--144.

Digital Library

[34]

Greg Welch and Gary Bishop. 1995. An Introduction to the Kalman Filter. Technical Report 95-041. University of North Carolina at Chapel Hill, Department of Computer Science.

Digital Library

[35]

Timothy Wood, Ludmila Cherkasova, Kivanc Ozonat, and Prashant Shenoy. 2008. Profiling and modeling resource usage of virtualized applications. In Proceedings of the 9th ACM/IFIP/USENIX International Conference on Middleware (Middleware’08). Springer-Verlag, New York, NY, 366--387.

Digital Library

[36]

Timothy Wood, Prashant Shenoy, Arun Venkataramani, and Mazin Yousif. 2007. Black-box and gray-box strategies for virtual machine migration. In Proceedings of the 4th USENIX Conference on Networked Systems Design and Implementation (NSDI’07). USENIX Association, Berkeley, CA, 229--242.

Digital Library

[37]

Jing Xu, Ming Zhao, Jose Fortes, Robert Carpenter, and Mazin Yousif. 2007. On the use of fuzzy modeling in virtualized data center management. In Proceedings of the International Conference on Autonomic Computing (ICAC’07). IEEE Computer Society, Washington, DC, 25.

Digital Library

[38]

Wei Xu, Xiaoyun Zhu, Sharad Singhal, and Zhikui Wang. 2006. Predictive control for dynamic resource allocation in enterprise data centers. In Proceedings of the IEEE/IFIP Network Operations and Management Symposium (NOMS’06). 115--126.

[39]

Qi Zhang, Ludmila Cherkasova, and Evgenia Smirni. 2007. A regression-based analytic model for dynamic resource provisioning of multi-tier applications. In Proceedings of the 4th International Conference on Autonomic Computing (ICAC’07). IEEE Computer Society, Washington, DC, 27.

Digital Library

[40]

Tao Zheng, Jinmei Yang, Murray Woodside, Marin Litoiu, and Gabriel Iszlai. 2005. Tracking time-varying parameters in software systems with extended Kalman filters. In Proceedings of the 2005 conference of the Centre for Advanced Studies on Collaborative research (CASCON’05). IBM Press, 334--345.

Digital Library

[41]

Xiaoyun Zhu, Zhikui Wang, and Sharad Singhal. 2006. Utility-driven workload management using nested control design. In Proceedings of the American Control Conference (ACC’06). 6.

Cited By

Vlahakis EJungers RAthanasopoulos NMcLoone S(2024)AIMD-Inspired Switching Control of Computing NetworksIEEE Transactions on Control of Network Systems10.1109/TCNS.2023.329820211:2(683-695)Online publication date: Jun-2024
https://doi.org/10.1109/TCNS.2023.3298202
Gyeera TSimons AStannett M(2023)Kalman Filter Based Prediction and Forecasting of Cloud Server KPIsIEEE Transactions on Services Computing10.1109/TSC.2022.321714816:4(2742-2754)Online publication date: 1-Jul-2023
https://doi.org/10.1109/TSC.2022.3217148
Awad MLeivadeas AAwad A(2023)Multi-resource predictive workload consolidation approach in virtualized environmentsComputer Networks: The International Journal of Computer and Telecommunications Networking10.1016/j.comnet.2023.110088237:COnline publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1016/j.comnet.2023.110088
Show More Cited By

Index Terms

Adaptive Resource Provisioning for Virtualized Servers Using Kalman Filters

Recommendations

Self-adaptive and self-configured CPU resource provisioning for virtualized servers using Kalman filters
ICAC '09: Proceedings of the 6th international conference on Autonomic computing

Data center virtualization allows cost-effective server consolidation which can increase system throughput and reduce power consumption. Resource management of virtualized servers is an important and challenging task, especially when dealing with ...
Resource management architecture for future information appliances
Real-Time and Embedded Computing Systems

This paper presents our CPU resource management architecture and mechanisms for future information appliances. Information appliances are special purpose computational devices. Their examples include mobile phones, digital TVs, and vehicle navigation ...
Performance Analysis of Network I/O Workloads in Virtualized Data Centers

Server consolidation and application consolidation through virtualization are key performance optimizations in cloud-based service delivery industry. In this paper, we argue that it is important for both cloud consumers and cloud providers to understand ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Autonomous and Adaptive Systems

ACM Transactions on Autonomous and Adaptive Systems Volume 9, Issue 2

July 2014

146 pages

ISSN:1556-4665

EISSN:1556-4703

DOI:10.1145/2642710

Editors:
Manish Parashar
Rutgers University, USA
,
Franco Zambonelli
University of Modena e Reggio Emilia, Italy

Issue’s Table of Contents

Copyright © 2014 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 July 2014

Accepted: 01 April 2014

Revised: 01 March 2014

Received: 01 August 2013

Published in TAAS Volume 9, Issue 2

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

26
Total Citations
View Citations
449
Total Downloads

Downloads (Last 12 months)15
Downloads (Last 6 weeks)0

Reflects downloads up to 15 Oct 2024

Other Metrics

View Author Metrics

Citations

Cited By

Vlahakis EJungers RAthanasopoulos NMcLoone S(2024)AIMD-Inspired Switching Control of Computing NetworksIEEE Transactions on Control of Network Systems10.1109/TCNS.2023.329820211:2(683-695)Online publication date: Jun-2024
https://doi.org/10.1109/TCNS.2023.3298202
Gyeera TSimons AStannett M(2023)Kalman Filter Based Prediction and Forecasting of Cloud Server KPIsIEEE Transactions on Services Computing10.1109/TSC.2022.321714816:4(2742-2754)Online publication date: 1-Jul-2023
https://doi.org/10.1109/TSC.2022.3217148
Awad MLeivadeas AAwad A(2023)Multi-resource predictive workload consolidation approach in virtualized environmentsComputer Networks: The International Journal of Computer and Telecommunications Networking10.1016/j.comnet.2023.110088237:COnline publication date: 1-Dec-2023
https://dl.acm.org/doi/10.1016/j.comnet.2023.110088
Pervaiz AYang YDuracz ABartha FSai RImes CCartwright RPalem KLu SHoffmann HScholliers CSinger J(2022)GOAL: Supporting General and Dynamic Adaptation in Computing SystemsProceedings of the 2022 ACM SIGPLAN International Symposium on New Ideas, New Paradigms, and Reflections on Programming and Software10.1145/3563835.3567655(16-32)Online publication date: 29-Nov-2022
https://dl.acm.org/doi/10.1145/3563835.3567655
Makridis EDeliparaschos KKalyvianaki EZolotas ACharalambous T(2022)Robust Dynamic CPU Resource Provisioning in Virtualized ServersIEEE Transactions on Services Computing10.1109/TSC.2020.296697215:2(956-969)Online publication date: 1-Mar-2022
https://doi.org/10.1109/TSC.2020.2966972
Liu JZhang SWang QWei J(2022)Coordinating Fast Concurrency Adapting With Autoscaling for SLO-Oriented Web ApplicationsIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2022.315151233:12(3349-3362)Online publication date: 1-Dec-2022
https://doi.org/10.1109/TPDS.2022.3151512
Awad MKara NLeivadeas A(2022)Utilization prediction-based VM consolidation approachJournal of Parallel and Distributed Computing10.1016/j.jpdc.2022.08.001170:C(24-38)Online publication date: 21-Oct-2022
https://dl.acm.org/doi/10.1016/j.jpdc.2022.08.001
Zharikov ETelenyk S(2021)Performance Analysis of a Dynamic Virtual Machine Management Method Based on the Power-Aware Integral EstimationElectronics10.3390/electronics1021258110:21(2581)Online publication date: 22-Oct-2021
https://doi.org/10.3390/electronics10212581
Vlahakis EAthanasopoulos NMcLoone S(2021)AIMD scheduling and resource allocation in distributed computing systems2021 60th IEEE Conference on Decision and Control (CDC)10.1109/CDC45484.2021.9683379(4642-4647)Online publication date: 14-Dec-2021
https://dl.acm.org/doi/10.1109/CDC45484.2021.9683379
Wan CSantriaji MRogers EHoffmann HMaire MLu SGavrilovska AZadok E(2020)ALERTProceedings of the 2020 USENIX Conference on Usenix Annual Technical Conference10.5555/3489146.3489170(353-369)Online publication date: 15-Jul-2020
https://dl.acm.org/doi/10.5555/3489146.3489170
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents