research-article

Challenges in the management of high-performance computing centers: an organizational perspective

Authors:

Nicholas Berente,

Jennifer ClaggettAuthors Info & Claims

SC '11: State of the Practice Reports

Article No.: 18, Pages 1 - 8

https://doi.org/10.1145/2063348.2063372

Published: 12 November 2011 Publication History

Abstract

To deliver consistently, high performance computing (HPC) centers must execute in both technical and organizational domains. While the technical domain certainly involves formidable challenges, scholars have indicated that organizational challenges in HPC can be equally complex and problematic. HPC centers represent a unique form of organizing and there is very little research into the way they are managed and how this management can potentially be improved.

In this paper, we present findings from an in-depth exploratory study of ten diverse HPC centers. Drawing a variety of traditions in organizational scholarship, we identify three domains that present significant management challenges for HPC centers: (1) governance; (2) resource acquisition and allocation; and (3) infrastructural innovation and collaboration. We conclude by detailing subsequent steps in this research program.

References

[1]

Adler, P. S., Goldoftas, B., & Levine, D. I. 1999. Flexibility versus efficiency? A case study of model changeovers in the Toyota production system. Organization Science, 10(1):43--68.

Digital Library

[2]

Astley W. G., and Zammuto R. F. (1992) "Organization Science, Managers, and Language Games," Organization Science, vol.3, n.4, pp. 443--460

Digital Library

[3]

Atkins, D. E., Droegemeier, K. K., Feldman, S. I., Garcia-Molina, H., Klein, M. L., Messerschmitt, D. G., Messina, P., Ostriker, J. P. & Wright, M. H. 2003 Revolutionizing science and engineering through cyberinfrastructure. Report of the National Science Foundation blue-ribbon advisory panel on cyberinfrastructure. Arlington, VA: US National Science Foundation.

[4]

Baldwin, C., and Clark, K., (2000) Design Rules Vol. 1: The Power of Modularity, MIT Press, Cambridge, Massachusetts.

Digital Library

[5]

Berente, N. and Lyytinen, K. (2007), "What is Being Iterated? Reflections on Iteration in Information Systems Engineering Processes," in Krogstie, J., Opdahl, A., and Brinkkemper, S., eds, Conceptual Modeling in Information Systems Engineering, Springer-Verlag Berlin Heidelberg (ISE Series Vol. 6), 2007.

[6]

Bietz, M. J., Baumer, E. P. S., and Lee, C. P. (2010) Synergizing in Cyberinfrastructure Development, Computer Supported Cooperative Work, July 7 2010.

Digital Library

[7]

Boehm, B. (1988) A Spiral Model of Software Development and Enhancement, IEEE Computer, May 1988.

Digital Library

[8]

Boland Jr, RJ. And Tenkasi, R. V. (1995) "Perspective making and perspective taking in communities of knowing." Organization Science, v. 6 issue 4, 1995, p. 350.

[9]

Bowker, G. C., Baker, K., Millerand, F., and Ribes, D. (2010) "Towards Information Infrastructure Studies: Ways of Knowing in a Networked Environment," (in J. Hunsinger, M. Allen, L. Klasrup eds) International Handbook of Internet Research, Springer

[10]

Burnes, B. (1996) "No such thing as... a "one best way" to manage organizational change," Management Decision, 34(10), 11--18.

[11]

Christensen, C. (1997) The Innovator's Dilemma: when new technologies cause great firms to fail, Harvard Business School Press, Cambridge Mass.

Digital Library

[12]

David, P. A. (2006) "Towards a cyberinfrastructure for enhanced scientific collaboration: providing its 'soft" foundations may be the hardest part." in D. Foray and B. Kahin (eds), Advancing Knowledge and the Knowledge-Economy, MIT Press, Cambridge, Mass.

[13]

Dyer, JH. and Singh, H. (1998) "The relational view: Cooperative strategy and sources of interorganizational competitive advantage." Academy of Management Review, v. 23 issue 4, 1998, p. 660.

[14]

Edwards, P., Jackson, S., Bowker, G. and Knobel, C. (2007). "Report to the NSF of a Workshop on 'History and Theory of Infrastructures: Lessons for new scientific infrastructures'," University of Michigan, School of Information.

[15]

Edwards, P., Jackson, S., Bowker, G. and Williams, R. (2009) "Introduction: An Agenda for Infrastructure Studies," Journal of the Association for Information Systems, 10(5): 364--374.

[16]

Eisenhardt, K. M. (1989) "Building Theories from Case Study Research," Academy of Management Review, 14(4):532--550.

[17]

Eisenhardt, K. M. and Martin, J. A. (2000) "Dynamic Capabilities: What are they?" Strategic Management Journal, 21(10-11):1105--1121.

[18]

Feldman, M. S. and Pentland, B. T. (2003) "Reconceptualizing Organizational Routines as a Source of Flexibility and Change," Administrative Science Quarterly, 48(1):94--118.

[19]

Galbraith, J. (1977) Organizational Design, Addison-Wesley, Reading, MA.

[20]

Grover, V and Markus, ML (2007) Business Process Transformation (Advances in Management Information Systems). M. E. Sharpe, Armonk NY.

Digital Library

[21]

Hansen, S., Berente N. and Lyytinen, K., (2009) "Requirements in the 21st Century: Current Practice & Emerging Trends," in Lyytinen, Loucopoulos, Mylopoulos, Robinson eds, Design Requirements Engireering: A Ten-Year Perspective, Springer-Verlag (Lecture Notes in Business Information Processing Series Vol.14), 2009.

[22]

Hanseth, O & Lyytinen, K (2010) Design theory for dynamic complexity in information infrastructures: the case of building internet. Journal of Information Technology, 2010.

[23]

Helper, S., J. P. MacDuffie, and Sabel, C. "Pragmatic collaborations: advancing knowledge while controlling opportunism." Industrial and Corporate Change, (9:3), 2000, p. 443. (Hirscheim et al 1995;

[24]

Karasti, H., Baker, K. S., and Millerant, F. (2010) "Infrastructure Time: Long-term Matters in Collaborative Development," Computer Supported Cooperative Work, May 30, 2010

Digital Library

[25]

Lee, C., Dourish, P. and Mark, G. (2006): 'The Human Infrastructure of Cyberinfrastructure', In Proceedings of the Conference on Computer Supported Cooperative Work (CSCW '06), ACM Press, New York, NY, pp. 483--492.

Digital Library

[26]

Lyytinen, K., and King, J. L. (2006) "Standard making: a critical research frontier for information systems research," MIS Quarterly, 30:405--411.

Digital Library

[27]

Lyytinen, K., Mathiassen, L. and Ropponen, J. (1998) "Attention shaping and software risk-A categorical analysis of four classical risk management approaches." Information Systems Research, v. 9, 1998, p. 233.

Digital Library

[28]

Mahring, M. (2002) IT Project Governance, Elanders Gotab, Stockholm, 2002.

[29]

March, J. G. (1991) "Exploration and Exploitation in Organizational Learning," Organization Science, 2(1):71--87.

Digital Library

[30]

Martins, L. L, Gilson, L. L. and Maynard, M. T. (2004) "Virtual teams: What do we know and where do we go from here?." Journal of Management, v. 30 issue 6, 2004, p. 805.

[31]

Miner, J. B. (2005) Essential Theories of Motivation and Leadership, M. E. Sharpe Inc.

[32]

Mintzberg, H. (1981) The Structuring of Organizations: a synthesis of the research, Prentice-Hall.

[33]

Moller, K. K. & Halinan, A. (1999) "Business Relationships and Networks: Managerial Challenges of Network Era," Industrial Marketing Management, 28:413--427.

[34]

NSF (2007) "Cyberinfrastructure Vision for 21st Century Discovery," National Science Foundation, Cyberinfrastructure Council, March 2007.

[35]

Olson, G. M., Zimmerman, A., and Bos, N. (2008) Scientific Collaboration on the Internet, The MIT Press, Cambridge, Massachusetts.

Digital Library

[36]

Ribes, D. and Finholt, T. A. (2007): 'Tensions Across the Scales: Planning Infrastructure for the Long-Term', in Proceedings of the International ACM SIGGROUP Conference on Supporting Group Work (GROUP '07), ACM Press, New York, NY.

Digital Library

[37]

Ribes, D. and Finholt, T. A. (2009). "The Long Now of Technology Infrastructure: Articulating Tensions in Development," Journal of the Association for Information Systems, 10(5): 375--398.

[38]

Spencer Jr, B.; Butler, R.; Ricker, K.; Marcusiu, D.; Finholt, T.; Foster, I. & Kesselman, C. (2006), 'Cyberenvironment project management: lessons learned'. Technical report, NSF Grant CMS-0117853.

[39]

Star, S. L. and Ruhleder, K.(1996) "Steps toward an ecology of infrastructure: Problems of design and access in large information systems." Information Systems Research, v. 7, 1996, p. 111.

[40]

Strauss, A. L. and J. M. Corbin (1998). Basics of Qualitative Research: Techniques and Procedures for Developing Grounded Theory, Sage Publications Inc.

[41]

Tashakkori, A. and Teddlie, C. (2003), Handbook of Mixed Methods in Social & Behavioral Research, Sage Publications.

[42]

Thamhain, H. J. (2003) "Managing innovative R&D teams." R and D Management, v. 33 issue 3, 2003, p.297.

[43]

Von Hippel, E. and Von Krogh, G (2003) "Open source software and the" private-collective" innovation model: Issues for organization science." Organization Science, v. 14 issue 2, 2003, p. 209.

Digital Library

[44]

Weick, K. E., & Roberts, K. H. (1993). Collective mind in organizations: Heedful interrelating on flight decks. Administrative Science Quarterly, 38(3), 357--381.

[45]

Weick, K. E. and Sutcliffe. K. M. (2001), Managing the Unexpected, John Wiley and Sons.

[46]

Yoo, Y., Boland, R. J., and Lyytinen (2006) "From organization design to organization designing." Organization Science, v. 17 issue 2, 2006, p. 215.

Digital Library

[47]

Yin, R. K. (2003). Case study research: Design and methods (3rd ed. Vol. 5). Thousand Oaks: Sage Publications.

[48]

Zimmerman, A. S. (2007). A socio-technical framework for cyberinfrastructure design. In Proceedings of e-Social Science. Ann Arbor, MI, USA, October 7--9 2007, p. 10.

[49]

Zimmerman, A. and Finholt, T. A. (2007): 'Growing an Infrastructure: The Role of Gateway Organizations in Cultivating New Communities of Users,' in Proceedings of the International ACM SIGGROUP Conference on Supporting Group Work (GROUP '07), ACM Press, New York, NY

Digital Library

Cited By

Hacker TEigenmann RRathje E(2013)Advancing Earthquake Engineering Research through CyberinfrastructureJournal of Structural Engineering10.1061/(ASCE)ST.1943-541X.0000712139:7(1099-1111)Online publication date: Jul-2013
https://doi.org/10.1061/(ASCE)ST.1943-541X.0000712
Karagiannis D(2013)Business Process Management: A Holistic Management ApproachInformation Systems: Methods, Models, and Applications10.1007/978-3-642-38370-0_1(1-12)Online publication date: 2013
https://doi.org/10.1007/978-3-642-38370-0_1

Challenges in the management of high-performance computing centers: an organizational perspective
1. Social and professional topics
  1. Professional topics
    1. Management of computing and information systems

Recommendations

Evaluating parameter sweep workflows in high performance computing
SWEET '12: Proceedings of the 1st ACM SIGMOD Workshop on Scalable Workflow Execution Engines and Technologies

Scientific experiments based on computer simulations can be defined, executed and monitored using Scientific Workflow Management Systems (SWfMS). Several SWfMS are available, each with a different goal and a different engine. Due to the exploratory ...
Domain-Oriented Services for High Energy Physics in Polish Computing Centers
eScience on Distributed Computing Infrastructure - Volume 8500

The large amounts of data collected by the High Energy Physics HEP experiments require intensive data processing on a large scale in order to extract their final physics results. In an extreme case --- the experiments performed on the Large Hadron ...
Contemporary High Performance Computing: From Petascale toward Exascale

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SC '11: State of the Practice Reports

November 2011

242 pages

ISBN:9781450311397

DOI:10.1145/2063348

Conference Chair:
Scott Lathrop
University of Chicago
,
Program Chairs:
Jim Costa
Sandia National Laboratories
,
William Kramer
National Center for Supercomputing Applications

Copyright © 2011 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGARCH: ACM Special Interest Group on Computer Architecture
IEEE-CS: Computer Society

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 12 November 2011

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Qualifiers

Research-article

Funding Sources

Office of Cyberinfrastructure

Conference

SC '11

Sponsor:

SIGARCH
IEEE-CS

SC '11: International Conference for High Performance Computing, Networking, Storage and Analysis

November 12 - 18, 2011

Washington, Seattle

Acceptance Rates

Overall Acceptance Rate 1,516 of 6,373 submissions, 24%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
121
Total Downloads

Downloads (Last 12 months)11
Downloads (Last 6 weeks)1

Reflects downloads up to 18 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Hacker TEigenmann RRathje E(2013)Advancing Earthquake Engineering Research through CyberinfrastructureJournal of Structural Engineering10.1061/(ASCE)ST.1943-541X.0000712139:7(1099-1111)Online publication date: Jul-2013
https://doi.org/10.1061/(ASCE)ST.1943-541X.0000712
Karagiannis D(2013)Business Process Management: A Holistic Management ApproachInformation Systems: Methods, Models, and Applications10.1007/978-3-642-38370-0_1(1-12)Online publication date: 2013
https://doi.org/10.1007/978-3-642-38370-0_1

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents