article

Managing server energy and operational costs in hosting centers

Authors:

Anand Sivasubramaniam,

Natarajan GautamAuthors Info & Claims

ACM SIGMETRICS Performance Evaluation Review, Volume 33, Issue 1

Pages 303 - 314

https://doi.org/10.1145/1071690.1064253

Published: 06 June 2005 Publication History

Abstract

The growing cost of tuning and managing computer systems is leading to out-sourcing of commercial services to hosting centers. These centers provision thousands of dense servers within a relatively small real-estate in order to host the applications/services of different customers who may have been assured by a service-level agreement (SLA). Power consumption of these servers is becoming a serious concern in the design and operation of the hosting centers. The effects of high power consumption manifest not only in the costs spent in designing effective cooling systems to ward off the generated heat, but in the cost of electricity consumption itself. It is crucial to deploy power management strategies in these hosting centers to lower these costs towards enhancing profitability. At the same time, techniques for power management that include shutting down these servers and/or modulating their operational speed, can impact the ability of the hosting center to meet SLAs. In addition, repeated on-off cycles can increase the wear-and-tear of server components, incurring costs for their procurement and replacement. This paper presents a formalism to this problem, and proposes three new online solution strategies based on steady state queuing analysis, feedback control theory, and a hybrid mechanism borrowing ideas from these two. Using real web server traces, we show that these solutions are more adaptive to workload behavior when performing server provisioning and speed control than earlier heuristics towards minimizing operational costs while meeting the SLAs.

References

[1]

Web Caching project. http://www.ircache.net.]]

[2]

Intel Outlines Platform Innovations for More Manageable, Balanced and Secure Enterprise Computing. Intel Press Release, February 2004. http://www.intel.com/ca/pressroom/2004/0218b.htm.]]

[3]

T. Abdelzaher, K. G. Shin, and N. Bhatti. Performance guarantees for Web server end-systems: A control-theoretical approach. IEEE Transactions on Parallel and Distributed Systems, 13(1), 2002.]]

Digital Library

[4]

B. D. O. Anderson and J. B. Moore. Optimal Control: Linear Quadratic Methods. Prentice Hall, 1989.]]

Digital Library

[5]

K. Appleby, S. Fakhouri, L. Fong, G. Goldszmidt, M. Kalantar, S. Krishnakumar, D. Pazel, J. Pershing, and B. Rochwerger. Oceano-SLA Based Management of a Computing Utility. In Proceedings of the IEEE/IFIP Integrated Network Management, May 2001.]]

[6]

P. Bohrer, M. Elnozahy, M. Kistler, C. Lefurgy, C. McDowell, and R. Rajamony. The Case for Power Management in Web Servers. In R. Graybill and R. Melhem, editors, Power Aware Computing. Kluwer Academic Publishers, 2002.]]

Digital Library

[7]

G. Bolch, S. Greiner, H. Meer, and K. S. Trivedi. Queueing Networks and Markov Chains: Modeling and Performance Evaluation with Computer Science Applications. John Wiley, New York, 1998.]]

Digital Library

[8]

E. Carrera, E. Pinheiro, and R. Bianchini. Conserving Disk Energy in Network Servers. In Proceedings of the 17th International Conference on Supercomputing, 2003.]]

Digital Library

[9]

A. Chandra, P. Goyal, and P. Shenoy. Quantifying the Benefits of Resource Multiplexing in On-Demand Data Centers. In Proceedings of First ACM Workshop on Algorithms and Architectures for Self-Managing Systems, June 2003.]]

[10]

A. Chandrakasan and R. W. Brodersen. Low-Power CMOS Design. Wiley-IEEE Press, 1998.]]

Digital Library

[11]

J. Chase, D. Anderson, P. Thakur, and A. Vahdat. Managing Energy and Server Resources in Hosting Centers. In Proceedings of the 18th Symposium on Operating Systems Principles SOSP'01, October 2001.]]

Digital Library

[12]

J. Chase and R. Doyle. Balance of Power: Energy Management for Server Clusters. In Proceedings of the 8th Workshop on Hot Topics in Operating Systems, May 2001.]]

Digital Library

[13]

Y. Chen, A. Das, W. Qin, A. Sivasubramaniam, Q. Wang, and N. Gautam. Managing Server Energy and Operational Costs in Hosting Centers. Technical Report CSE-05-002, The Pennsylvania State University, February 2005.]]

Digital Library

[14]

J. G. Elerath. Specifying Reliability in the Disk Drive Industry: No More MTBFs. In Proceedings of the Annual Reliability and Maintainability Symposium, pages 194--199, 2000.]]

[15]

M. Elnozahy, M. Kistler, and R. Rajamony. Energy-Efficient Server Clusters. In Proceedings of the Second Workshop on Power Aware Computing Systems, February 2002.]]

Digital Library

[16]

M. Elnozahy, M. Kistler, and R. Rajamony. Energy Conservation Policies for Web Servers. In Proceedings of the 4th USENIX Symposium on Internet Technologies and Systems, March 2003.]]

Digital Library

[17]

K. Flautner, S. Reinhardt, and T. Mudge. Automatic performance setting for dynamic voltage scaling. In Proceedings of the 7th annual international conference on Mobile computing and networking, pages 260--271, 2001.]]

Digital Library

[18]

N. Gandhi, S. Parekh, J Hellerstein, and D. Tilbury. Feedback Control of a Lotus Notes Server: Modeling and Control Design. In Proceedings of the American Control Conference, 2001.]]

[19]

D. Grunwald, P. Levis, K. I. Farkas, C. B. Morrey III, and M. Neufeld. Policies for Dynamic Clock Scheduling. In Proceedings of the Symposium on Operating Systems Design and Implementation, pages 73--86, 2000.]]

Digital Library

[20]

S. Gurumurthi, A. Sivasubramaniam, M. Kandemir, and H. Franke. DRPM: Dynamic Speed Control for Power Management in Server Class Disks. In Proceedings of the International Symposium on Computer Architecture, pages 169--179, 2003.]]

Digital Library

[21]

D. P. Helmbold, D. E. Long, T. L. Sconyers, and B. Sherrod. Adaptive disk spin-down for mobile computers. Mob. Netw. Appl., 5(4):285--297, 2000.]]

Digital Library

[22]

J. Jones and B. Fonseca. Energy Crisis Pinches Hosting Vendors. http://iwsun4.infoworld.com/articles/hn/xml/01/01/08/010108hnpower.xml.]]

[23]

C. Lefurgy, K. Rajamani, F. Rawson, W. Felter, M. Kistler, and T. W. Kelle. Energy Management for Commercial Servers. IEEE Computer, 36(12):39--48, 2003.]]

Digital Library

[24]

K. Li, R. Kumpf, P. Horton, and T. E. Anderson. Quantitative Analysis of Disk Drive Power Management in Portable Computers. Technical report, University of California at Berkeley, 1993.]]

Digital Library

[25]

J. R. Lorch and A. J. Smith. Improving Dynamic Voltage Scaling Algorithms with PACE. In Proceedings of ACM SIGMETRICS, June 2001.]]

Digital Library

[26]

C. Lu, T. F. Abdelzaher, J. A. Stankovic, and S. H. Son. A Feedback Control Approach for Guaranteeing Relative Delays in Web Servers. In Proceedings of the Seventh Real-Time Technology and Applications Symposium, page 51, 2001.]]

Digital Library

[27]

C. D. Patel, C. E. Bash, C. Belady, L. Stahl, and D. Sullivan. Computational Fluid Dynamics Modeling of High Compute Density Data Centers to Assure System Inlet Air Specifications. In Proceedings of the Pacific Rim ASME International Electronic Packaging Technical Conference and Exhibition (IPACK), 2001.]]

[28]

T. Pering, T. Burd, and R. Brodersen. The simulation and evaluation of dynamic voltage scaling algorithms. In Proceedings of the 1998 international symposium on Low power electronics and design, pages 76--81, 1998.]]

Digital Library

[29]

E. Pinheiro, R. Bianchini, E. V. Carrera, and T. Heath. Load Balancing and Unbalancing for Power and Performance in Cluster-Based Systems. In Proceedings of the Workshop on Compilers and Operating Systems for Low Power, September 2001.]]

[30]

P. Pradhan, R. Tewari, S. Sahu, A. Chandra, and P. Shenoy. An Observation-based Approach Towards Self-managing Web Servers. In Proceedings of ACM/IEEE Intl Workshop on Quality of Service, May 2002.]]

[31]

S. Ranjan, J. Rolia, H. Fu, and E. Knightly. QoS-Driven Server Migration for Internet Data Centers. In Proceedings of International Workshop on QoS, May 2002.]]

[32]

K. Roy and S. Prasad. Low-Power CMOS VLSI Circuit Design. John Wiley and Sons, New York, 2000.]]

[33]

V. Sharma, A. Thomas, T. Abdelzaher, and K. Skadron. Power-aware QoS Management in Web Servers. In Proceedings of the Real-Time Systems Symposium, December 2003.]]

Digital Library

[34]

K. Shen, H. Tang, T. Yang, and L. Chu. Integrated resource management for cluster-based Internet services. SIGOPS Oper. Syst. Rev., 36(11):225--238, 2002.]]

Digital Library

[35]

D. S. Stoffer and R. H. Shumway. Time Series Analysis and Its Applications. Springer Verlag, New York, 2000.]]

Digital Library

[36]

B. Urgaonkar and P. Shenoy. Cataclysm: Handling Extreme Overloads in Internet Services. In Proceedings of ACM Principles of Distributed Computing, July 2004.]]

Digital Library

[37]

M. Weiser, B. Welch, A. J. Demers, and S. Shenker. Scheduling for Reduced CPU Energy. In Proceedings of the Symposium on Operating Systems Design and Implementation, pages 13--23, 1994.]]

Digital Library

[38]

Q. Zhang, E. Smirni, and G. Ciardo. Profit-driven Service Differentiation in Transient Environments. In Proceedings of the 11th IEEE/ACM International Symposium on Modeling, Analysis and Simulation of Computer Telecommunications Systems, 2003.]]

Cited By

Salihović NMemić BČolaković AAvdagić-Golub EDžubur A(2023)Towards green data centers: Energy efficiency and performance evaluation2023 22nd International Symposium INFOTEH-JAHORINA (INFOTEH)10.1109/INFOTEH57020.2023.10094184(1-6)Online publication date: 15-Mar-2023
https://doi.org/10.1109/INFOTEH57020.2023.10094184
Ruiz Duarte JFan N(2023)Operations of data centers with onsite renewables considering greenhouse gas emissionsSustainable Computing: Informatics and Systems10.1016/j.suscom.2023.10090340(100903)Online publication date: Dec-2023
https://doi.org/10.1016/j.suscom.2023.100903
Brandwjan ABegin TCastel-Taleb HAtmaca T(2022)A Study of Live VM Migration for Server Consolidation in Data Centers2022 9th International Conference on Future Internet of Things and Cloud (FiCloud)10.1109/FiCloud57274.2022.00018(75-82)Online publication date: Aug-2022
https://doi.org/10.1109/FiCloud57274.2022.00018
Show More Cited By

Index Terms

Managing server energy and operational costs in hosting centers

Recommendations

Managing energy and server resources in hosting centers

Internet hosting centers serve multiple service sites from a common hardware base. This paper presents the design and implementation of an architecture for resource management in a hosting center operating system, with an emphasis on energy as a driving ...
Read More
Managing server energy and operational costs in hosting centers
SIGMETRICS '05: Proceedings of the 2005 ACM SIGMETRICS international conference on Measurement and modeling of computer systems

The growing cost of tuning and managing computer systems is leading to out-sourcing of commercial services to hosting centers. These centers provision thousands of dense servers within a relatively small real-estate in order to host the applications/...
Read More
Managing energy and server resources in hosting centers
SOSP '01: Proceedings of the eighteenth ACM symposium on Operating systems principles

Internet hosting centers serve multiple service sites from a common hardware base. This paper presents the design and implementation of an architecture for resource management in a hosting center operating system, with an emphasis on energy as a driving ...
Read More

Comments

Information & Contributors

Information

Published In

cover image ACM SIGMETRICS Performance Evaluation Review

ACM SIGMETRICS Performance Evaluation Review Volume 33, Issue 1

Performance evaluation review

June 2005

417 pages

ISSN:0163-5999

DOI:10.1145/1071690

Issue’s Table of Contents

SIGMETRICS '05: Proceedings of the 2005 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
June 2005
428 pages
ISBN:1595930221
DOI:10.1145/1064212
General Chairs:
Derek Eager
University of Saskatchewan, Canada
,
Carey Williamson
University of Calgary, Canada
,
Program Chairs:
Sem Borst
Bell Labs, USA & CWI, The Netherlands
,
John C. S. Lui
Chinese University of Hong Kong, China

Copyright © 2005 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 06 June 2005

Published in SIGMETRICS Volume 33, Issue 1

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

482
Total Citations
View Citations
2,072
Total Downloads

Downloads (Last 12 months)48
Downloads (Last 6 weeks)7

Other Metrics

View Author Metrics

Citations

Cited By

Salihović NMemić BČolaković AAvdagić-Golub EDžubur A(2023)Towards green data centers: Energy efficiency and performance evaluation2023 22nd International Symposium INFOTEH-JAHORINA (INFOTEH)10.1109/INFOTEH57020.2023.10094184(1-6)Online publication date: 15-Mar-2023
https://doi.org/10.1109/INFOTEH57020.2023.10094184
Ruiz Duarte JFan N(2023)Operations of data centers with onsite renewables considering greenhouse gas emissionsSustainable Computing: Informatics and Systems10.1016/j.suscom.2023.10090340(100903)Online publication date: Dec-2023
https://doi.org/10.1016/j.suscom.2023.100903
Brandwjan ABegin TCastel-Taleb HAtmaca T(2022)A Study of Live VM Migration for Server Consolidation in Data Centers2022 9th International Conference on Future Internet of Things and Cloud (FiCloud)10.1109/FiCloud57274.2022.00018(75-82)Online publication date: Aug-2022
https://doi.org/10.1109/FiCloud57274.2022.00018
Jin CBai XZhang XXu XTang YZeng C(2022)A measurement-based power consumption model of a server by considering inlet air temperatureEnergy10.1016/j.energy.2022.125126261(125126)Online publication date: Dec-2022
https://doi.org/10.1016/j.energy.2022.125126
Manaserh YTradat MBani-Hani DAlfallah ASammakia BNemati KSeymour M(2022)Machine learning assisted development of IT equipment compact models for data centers energy planningApplied Energy10.1016/j.apenergy.2021.117846305(117846)Online publication date: Jan-2022
https://doi.org/10.1016/j.apenergy.2021.117846
Zhang WWen YLai LLiu FFan R(2021)Cost Optimal Data Center Servers: A Voltage Scaling ApproachIEEE Transactions on Cloud Computing10.1109/TCC.2018.28448239:1(118-130)Online publication date: 1-Jan-2021
https://doi.org/10.1109/TCC.2018.2844823
Setiawan RGanga RVelayutham PThangavel KSharma DRajan RKrishnamoorthy SSengan S(2021)Encrypted Network Traffic Classification and Resource Allocation with Deep Learning in Software Defined NetworkWireless Personal Communications10.1007/s11277-021-08403-5127:1(749-765)Online publication date: 28-Mar-2021
https://doi.org/10.1007/s11277-021-08403-5
Ahmed MAhmed W(2021)State-of-the-Art Power Management TechniquesProceedings of Second Doctoral Symposium on Computational Intelligence10.1007/978-981-16-3346-1_18(223-236)Online publication date: 20-Sep-2021
https://doi.org/10.1007/978-981-16-3346-1_18
Nazir BAhmad Z(2021)Dynamic energy efficient load balancing strategy for computational gridConcurrency and Computation: Practice and Experience10.1002/cpe.648434:1Online publication date: 17-Jul-2021
https://doi.org/10.1002/cpe.6484
Grohmann JHerbst NChalbani AArian YPeretz NKounev S(2020)A Taxonomy of Techniques for SLO Failure Prediction in Software SystemsComputers10.3390/computers90100109:1(10)Online publication date: 11-Feb-2020
https://doi.org/10.3390/computers9010010
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents