Article

Just In Time Dynamic Voltage Scaling: Exploiting Inter-Node Slack to Save Energy in MPI Programs

Authors:

Nandini Kappiah,

Vincent W. Freeh,

David K. LowenthalAuthors Info & Claims

SC '05: Proceedings of the 2005 ACM/IEEE conference on Supercomputing

Page 33

https://doi.org/10.1109/SC.2005.39

Published: 12 November 2005 Publication History

Abstract

Recently, improving the energy efficiency of HPC machines has become important. As a result, interest in using powerscalable clusters, where frequency and voltage can be dynamically modified, has increased. On power-scalable clusters, one opportunity for saving energy with little or no loss of performance exists when the computational load is not perfectly balanced. This situation occurs frequently, as balancing load between nodes is one of the long standing problems in parallel and distributed computing. In this paper we present a system called Jitter, which reduces the frequency on nodes that are assigned less computation and therefore have slack time. This saves energy on these nodes, and the goal of Jitter is to attempt to ensure that they arrive "just in time" so that they avoid increasing overall execution time. For example, in Aztec, from the ASCI Purple suite, our algorithm uses 8% less energy while increasing execution time by only 2.6%.

References

[1]

{1} N. D. Adiga et al. An overview of the BlueGene/L supercomputer. In Supercomputing 2002, November 2002.

Digital Library

[2]

{2} Manish Anand, Edmund Nightingale, and Jason Flinn. Self-tuning wireless network power management. In Mobicom, September 2003.

Digital Library

[3]

{3} ASCI Purple Benchmark Suite. http://www.llnl.gov/- asci/platforms/purple/rfp/benchmarks/.

[4]

{4} D. Bailey, J. Barton, T. Lasinski, and H. Simon. The NAS parallel benchmarks. RNR-91-002, NASA Ames Research Center, August 1991.

[5]

{5} Milind Bhandarkar, L. V. Kale, Eric de Sturler, and Jay Hoeflinger. Adaptive load balancing for MPI programs. In International Conference on Computational Science, pages 108-117, San Francisco, CA, May 2001.

Digital Library

[6]

{6} Pat Bohrer, Elmootazbellah Elnozahy, Tom Keller, Michael Kistler, Charles Lefurgy, Chandler McDowell, and Ram Rajamony. The case of power management in web servers. In Robert Graybill and Rami Melham, editors, Power Aware Computing. Kluwer/Plenum, 2002.

Digital Library

[7]

{7} Enrique V. Carrera, Eduardo Pinheiro, and Ricardo Bianchini. Conserving disk energy in network servers. In Proceedings of International Conference on Supercomputing, pages 86-97, San Fransisco, CA, 2003.

Digital Library

[8]

{8} Jeffrey S. Chase, Darrell C. Anderson, Prachi N. Thakar, Amin Vahdat, and Ronald P. Doyle. Managing energy and server resources in hosting centres. In Symposium on Operating Systems Principles, pages 103-116, 2001.

Digital Library

[9]

{9} Compaq Computer Corporation, Intel Corporation, Microsoft Corporation, Phoenix Technologies Ltd., and Toshiba Corporation. Advanced configuration and power interface specification, revision 2.0. July 2000.

[10]

{10} F. Douglis, P. Krishnan, and B. Bershad. Adaptive disk spin-down policies for mobile computers. In Proc. 2nd USENIX Symp. on Mobile and Location-Independent Computing, 1995.

Digital Library

[11]

{11} C. S. Ellis. The case for higher-level power management. In Proceedings of the 7th Workshop on Hot Topics in Operating Systems, March 1999.

Digital Library

[12]

{12} Elmootazbellah Elnozahy, Michael Kistler, and Ramakrishnan Rajamony. Energy conservation policies for web servers. In USITS '03, 2003.

Digital Library

[13]

{13} E. N. (Mootaz) Elnozahy, Michael Kistler, and Ramakrishnan Rajamony. Energy-efficient server clusters. In Workshop on Mobile Computing Systems and Applications, Feb 2002.

[14]

{14} K. Flautner, S. Reinhardt, and T. Mudge. Automatic performance-setting for dynamic voltage scaling. In Proceedings of the 7th Conference on Mobile Computing and Networking MOBICOM '01, July 2001.

Digital Library

[15]

{15} Vincent W. Freeh, David K. Lowenthal, Feng Pan, and Nandani Kappiah. Using multiple energy gears in mpi programs on a power-scalable cluster. In PPOPP 2005, Chicago, IL, June 2005.

Digital Library

[16]

{16} Vincent W. Freeh, David K. Lowenthal, Rob Springer, Feng Pan, and Nandani Kappiah. Exploring the energy-time tradeoff in mpi programs on a power-scalable cluster. In IPDPS 2005, Denver, CO, April 2005.

Digital Library

[17]

{17} Chris Gniady, Y. Charlie Hu, and Yung-Hsiang Lu. Program counter based techniques for dynamic power management. In Proceedings of the 10th International Symposium on High-Performance Computer Architecture, February 2004.

Digital Library

[18]

{18} D. Grunwald, P. Levis, K. Farkas, C. Morrey, and M. Neufeld. Policies for dynamic clock scheduling. In Proceedings of 4th Symposium on Operating System Design and Implementation, October 2000.

Digital Library

[19]

{19} S. Gurumurthi, A. Sivasubramaniam, M. Kandemir, and H. Franke. Dynamic speed control for power management in server class disks. In Proceedings of International Symposium on Computer Architecture, pages 169-179, June 2003.

Digital Library

[20]

{20} Sudhanva Gurumurthi, Anand Sivasubramaniam, Mahmut Kandemir, and Hubertus Franke. Reducing disk power consumption in servers with DRPM. IEEE Computer, pages 41-48, December 2003.

Digital Library

[21]

{21} Taliver Heath, Eduardo Pinheiro, Jerry Hom, Ulrich Kremer, and Ricardo Bianchini. Application transformations for energy and performance-aware device management. In Proceedings of the 11th International Conference on Parallel Architectures and Compilation Techniques, September 2002.

Digital Library

[22]

{22} D. P. Helmbold, D. D. E. Long, and B. Sherrod. A dynamic disk spin-down technique for mobile computing. In Mobile Computing and Networking, pages 130-142, 1996.

Digital Library

[23]

{23} C-H. Hsu and U. Kremer. The design, implementation, and evaluation of a compiler algorithm for cpu energy reduction. In ACM SIGPLAN Conference on Programming Languages, Design, and Implementation, June 2003.

Digital Library

[24]

{24} Jian Ke and Evan Speight. Tern: Migrating threads in an MPI runtime environment. Technical Report CSL-TR-2001-1016, Cornell, November 2001.

[25]

{25} Ken Kennedy and Ulrich Kremer. Automatic data layout for distributed-memory machines. ACM Transactions on Programming Languages and Systems, 20(4):869-916, 1998.

Digital Library

[26]

{26} Ronny Krashinsky and Hari Balakrishnan. Minimizing energy for wireless web access with bounded slowdown. In Mobicom 2002, Atlanta, GA, September 2002.

Digital Library

[27]

{27} Orion Lawlor, Milind Bhandarkar, and L. V. Kale. Adaptive MPI. TR 02-05, University of Illinois, 2002.

[28]

{28} A. R. Lebeck, X. Fan, H. Zeng, and C. S. Ellis. Power aware page allocation. In Architectural Support for Programming Languages and Operating Systems, pages 105-116, 2000.

Digital Library

[29]

{29} Charles Lefurgy, Karthick Rajamani, Freeman Rawson, Wes Felter, Michael Kistler, and Tom W. Keller. Energy management for commerical servers. IEEE Computer, pages 39-48, December 2003.

Digital Library

[30]

{30} John Markoff and Steve Lohr. Intel's huge bet turns iffy. New York Times Technology Section, September 29, 2002. Section 3, Page 1, Coumn 2.

[31]

{31} Donald G. Morris and David K. Lowenthal. Accurate data redistribution cost estimation in software distributed shared memory systems. In Principles and Practice of Parallel Programming, pages 62-71, June 2001.

Digital Library

[32]

{32} Orion Multisystems. http://www.orionmulti.com/.

[33]

{33} Athanasios E. Papathanasiou and Michael L. Scott. Energy efficiency through burstiness. In WMCSA, October 2003.

[34]

{34} T. Pering, T. Burd, and R. Brodersen. The simulation and evaluation of dynamic voltage scaling algorithms. In Proceedings of the International Symposium on Low-Power Electronics and Design ISPLED '98, pages 76-81, August 1998.

Digital Library

[35]

{35} E. Pinheiro, R. Bianchini, E. V. Carrera, and T. Heath. Dynamic cluster reconfiguration for power and performance. In Compilers and Operating Systems for Low Power, September 2001.

Digital Library

[36]

{36} Eduardo Pinheiro, Ricardo Bianchini, Enrique V. Carrera, and Taliver Heath. Load balancing and unbalancing for power and performance in cluster-based systems. In Workshop on Compilers and Operating Systems for Low Power, September 2001.

[37]

{37} Rolf Rabenseifner. Automatic profiling of MPI applications with hardware performance counters. In PVM/MPI, pages 35-42, 1999.

Digital Library

[38]

{38} Vivek Sharma, Arun Thomas, Tarek Abdelzaher, and Kevin Skadron. Power-aware QoS management in web servers. In 24th Annual IEEE Real-Time Systems Symposium, Cancun, Mexico, December 2003.

Digital Library

[39]

{39} A. Vahdat, A. Lebeck, and C. Ellis. Every joule is precious: The case for revisiting operating system design for energy efficiency. SIGOPS European Workshop, 2000.

Digital Library

[40]

{40} M. Warren, E. Weigle, and W. Feng. High-density computing: A 240-node beowulf in one cubic meter. In Supercomputing 2002, November 2002.

Digital Library

[41]

{41} D. Brent Weatherly, David K. Lowenthal, Mario Nakazawa, and Franklin Lowenthal. Dyn-MPI: Supporting MPI on non dedicated clusters. In Supercomputing 2003, November 2003.

Digital Library

[42]

{42} M. Weiser, B. Welch, A. J. Demers, and S. Shenker. Scheduling for reduced CPU energy. In Operating Systems Design and Implementation (OSDI'94), pages 13-23, 1994.

Digital Library

[43]

{43} F. C. Wong, R. P. Martin, R. H. Arpaci-Dusseau, and D. E. Culler. Architectural requirements and scalability of the NAS parallel benchmarks. In Proceedings of Supercomputing '99, Portland, OR, November 1999.

Digital Library

[44]

{44} Heng Zeng, Carla S. Ellis, Alvin R. Lebeck, and Amin Vahdat. Currentcy: Unifying policies for resource management. In USENIX 2003 Annual Technical Conference, June 2003.

Digital Library

[45]

{45} D. Zhu, R. Melhem, and B. Childers. Scheduling with dynamic voltage/speed adjustment using slack reclamation in multi-processor real-time systems. IEEE Transactions on Parallel and Distributed Systems, 14(7): 686-700, July 2003.

Digital Library

[46]

{46} D. Zhu, D. Mosse, and R. Melhem. Power-aware scheduling for and/or graphs in real-time systems. IEEE Transactions on Parallel and Distributed Systems, 15(9): 849-864, September 2004.

Digital Library

[47]

{47} Qingbo Zhu, Francis M. David, Christo Devaraj, Zhenmin Li, Yuanyuan Zhou, and Pei Cao. Reducing energy consumption of disk storage using power-aware cache management. In Proceedings of the 10th International Symposium on High-Performance Computer Architecture (HPCA-10), February 2004.

Digital Library

Cited By

Kumar SGupta AKumar VBhalachandra Sde Supinski BHall MGamblin T(2021)CuttlefishProceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis10.1145/3458817.3476163(1-14)Online publication date: 14-Nov-2021
https://dl.acm.org/doi/10.1145/3458817.3476163
Gholkar NMueller FRountree BTaufer MBalaji PPeña A(2019)Uncore power scavengerProceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis10.1145/3295500.3356150(1-23)Online publication date: 17-Nov-2019
https://dl.acm.org/doi/10.1145/3295500.3356150
Demirci GMarincic IHoffmann H(2018)A divide and conquer algorithm for DAG scheduling under power constraintsProceedings of the International Conference for High Performance Computing, Networking, Storage, and Analysis10.5555/3291656.3291704(1-12)Online publication date: 11-Nov-2018
https://dl.acm.org/doi/10.5555/3291656.3291704
Show More Cited By

Index Terms

Just In Time Dynamic Voltage Scaling: Exploiting Inter-Node Slack to Save Energy in MPI Programs

Recommendations

Just-in-time dynamic voltage scaling: Exploiting inter-node slack to save energy in MPI programs

Although users of high-performance computing are most interested in raw performance, both energy and power consumption have become critical concerns. As a result, improving energy efficiency of nodes on HPC machines has become important, and the ...
The limit of dynamic voltage scaling and insomniac dynamic voltage scaling

Dynamic voltage scaling (DVS) is a popular approach for energy reduction of integrated circuits. Current processors that use DVS typically have an operating voltage range from full to half of the maximum V_dd. However, there is no fundamental reason why ...
Dynamic voltage scaling for systemwide energy minimization in real-time embedded systems
ISLPED '04: Proceedings of the 2004 international symposium on Low power electronics and design

Traditionally, dynamic voltage scaling (DVS) techniques have focused on minimizing the processor energy consumption as opposed to the entire system energy consumption. The slowdown resulting from DVS can increase the energy consumption of components ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SC '05: Proceedings of the 2005 ACM/IEEE conference on Supercomputing

November 2005

829 pages

ISBN:1595930612

General Chair:
William Kramer

Sponsors

SIGARCH: ACM Special Interest Group on Computer Architecture
IEEE-CS: Computer Society

Publisher

IEEE Computer Society

United States

Publication History

Published: 12 November 2005

Check for updates

Qualifiers

Article

Conference

SC '05

Sponsor:

SIGARCH
IEEE-CS

SC '05: International Conference for High Performance Computing, Networking, Storage and Analysis

November 12 - 18, 2005

Acceptance Rates

SC '05 Paper Acceptance Rate 62 of 260 submissions, 24%;

Overall Acceptance Rate 1,516 of 6,373 submissions, 24%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

46
Total Citations
View Citations
376
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)0

Reflects downloads up to 30 Aug 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kumar SGupta AKumar VBhalachandra Sde Supinski BHall MGamblin T(2021)CuttlefishProceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis10.1145/3458817.3476163(1-14)Online publication date: 14-Nov-2021
https://dl.acm.org/doi/10.1145/3458817.3476163
Gholkar NMueller FRountree BTaufer MBalaji PPeña A(2019)Uncore power scavengerProceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis10.1145/3295500.3356150(1-23)Online publication date: 17-Nov-2019
https://dl.acm.org/doi/10.1145/3295500.3356150
Demirci GMarincic IHoffmann H(2018)A divide and conquer algorithm for DAG scheduling under power constraintsProceedings of the International Conference for High Performance Computing, Networking, Storage, and Analysis10.5555/3291656.3291704(1-12)Online publication date: 11-Nov-2018
https://dl.acm.org/doi/10.5555/3291656.3291704
Wu KRen JLi D(2018)Runtime data management on non-volatile memory-based heterogeneous memory for task-parallel programsProceedings of the International Conference for High Performance Computing, Networking, Storage, and Analysis10.5555/3291656.3291698(1-13)Online publication date: 11-Nov-2018
https://dl.acm.org/doi/10.5555/3291656.3291698
Imes CHofmeyr SHoffmann H(2018)Energy-efficient Application Resource Scheduling using Machine Learning ClassifiersProceedings of the 47th International Conference on Parallel Processing10.1145/3225058.3225088(1-11)Online publication date: 13-Aug-2018
https://dl.acm.org/doi/10.1145/3225058.3225088
Gholkar NMueller FRountree BMarathe AZhao MChandra ARamakrishnan L(2018)PShifterProceedings of the 27th International Symposium on High-Performance Parallel and Distributed Computing10.1145/3208040.3208047(106-117)Online publication date: 11-Jun-2018
https://dl.acm.org/doi/10.1145/3208040.3208047
Demirci GMarincic IHoffmann H(2018)A divide and conquer algorithm for DAG scheduling under power constraintsProceedings of the International Conference for High Performance Computing, Networking, Storage, and Analysis10.1109/SC.2018.00039(1-12)Online publication date: 11-Nov-2018
https://dl.acm.org/doi/10.1109/SC.2018.00039
Wu KRen JLi D(2018)Runtime data management on non-volatile memory-based heterogeneous memory for task-parallel programsProceedings of the International Conference for High Performance Computing, Networking, Storage, and Analysis10.1109/SC.2018.00034(1-13)Online publication date: 11-Nov-2018
https://dl.acm.org/doi/10.1109/SC.2018.00034
Jin Cde Supinski BAbramson DPoxon HDeRose LDinh MEndrei MJessup E(2017)A survey on software methods to improve the energy efficiency of parallel computingInternational Journal of High Performance Computing Applications10.1177/109434201666547131:6(517-549)Online publication date: 1-Nov-2017
https://dl.acm.org/doi/10.1177/1094342016665471
Bhalachandra SPorterfield AOlivier SPrins JFowler R(2017)Improving Energy Efficiency in Memory-constrained Applications Using Core-specific Power ControlProceedings of the 5th International Workshop on Energy Efficient Supercomputing10.1145/3149412.3149418(1-8)Online publication date: 12-Nov-2017
https://dl.acm.org/doi/10.1145/3149412.3149418
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents