Democratizing HPC Access and Use with Knowledge Graphs
Authors: 
Pouya Kousha, Vivekananda Sathu, Matthew Lieber, Hari Subramoni, and Dhabaleswar K. PandaAuthors Info & Claims
Pouya Kousha, Vivekananda Sathu, Matthew Lieber, Hari Subramoni, and Dhabaleswar K. PandaAuthors Info & ClaimsNovember 2023
Pages 243 - 251
Abstract
The field of High-Performance Computing (HPC) is undergoing rapid evolution, with an expanding and diverse user base harnessing its unparalleled computational capabilities. As the range of HPC applications grows, newcomers to the field are faced with the daunting task of optimizing their applications for efficient execution on HPC systems. Traditional documentation, often spanning dozens of pages, is cumbersome for finding answers and ill-suited for integration with emerging conversational AI-powered user interfaces like chatbots. Addressing this challenge, we propose a novel HPC ontology crafted to encapsulate HPC runtime relations in a scalable fashion. Our proposed ontology not only facilitates the transfer and querying of this knowledge but also serves as a foundational pillar for our AI-powered Speech Assistant Interface (SAI)[13]. This ensures reproducibility, reliability, and optimal performance when executing tasks. In this paper, we elucidate the relationships and properties underpinning our ontology and showcase how users can interact with knowledge graphs based on our proposed ontology to derive insights.
References
[1]
Google AI. 2023. Google Bard. Bard, Google AI. https://bard.google.com/
[2]
Anthropic. 2023. Anthropic. https://www.anthropic.com Accessed on August 16, 2023.
[3]
Gabriel G. Castañé, Huanhuan Xiong, Dapeng Dong, and John P. Morrison. 2018. An ontology for heterogeneous resources management interoperability and HPC in the cloud. Future Generation Computer Systems 88 (2018), 373–384. https://doi.org/10.1016/j.future.2018.05.086
[4]
Ohio Supercomputer Center. 1987. Ohio Supercomputer Center. http://osc.edu/ark:/19495/f5s1ph73.
[5]
Mike Conover, Matt Hayes, Ankit Mathur, Jianwei Xie, Jun Wan, Sam Shah, Ali Ghodsi, Patrick Wendell, Matei Zaharia, and Reynold Xin. 2023. Free Dolly: Introducing the World’s First Truly Open Instruction-Tuned LLM. https://www.databricks.com/blog/2023/04/12/dolly-first-open-commercially-viable-instruction-tuned-llm
[6]
Jia Deng, Wei Dong, Richard Socher, Li-Jia Li, Kai Li, and Li Fei-Fei. 2009. Imagenet: A Large-Scale Hierarchical Image Database. In Computer Vision and Pattern Recognition, 2009. CVPR 2009. IEEE Conference on. IEEE, 248–255.
[7]
Li Deng. 2012. The mnist database of handwritten digit images for machine learning research. IEEE Signal Processing Magazine 29, 6 (2012), 141–142.
[8]
Danilo Dessí, Francesco Osborne, Diego Reforgiato Recupero, Davide Buscaldi, and Enrico Motta. 2022. SCICERO: A deep learning and NLP approach for generating scientific knowledge graphs in the computer science domain. Knowledge-Based Systems 258 (2022), 109945. https://doi.org/10.1016/j.knosys.2022.109945
[9]
OBO Foundry. 2023. OBO Foundry Principles. https://obofoundry.org/principles/fp-000-summary.html Accessed: 2023/10/23 15:23:57.
[10]
Yolanda Gil, Varun Ratnakar, and Daniel Garijo. 2015. OntoSoft: Capturing Scientific Software Metadata. In Proceedings of the 8th International Conference on Knowledge Capture(K-CAP 2015). Association for Computing Machinery, New York, NY, USA, Article 32, 4 pages. https://doi.org/10.1145/2815833.2816955
[11]
Dave Hudak, Doug Johnson, Alan Chalker, Jeremy Nicklas, Eric Franz, Trey Dockendorf, and Brian McMichael. 2018. Open OnDemand: A web-based client portal for HPC centers. Journal of Open Source Software 3 (05 2018), 622. https://doi.org/10.21105/joss.00622
[12]
Simon Jupp, Tony Burdett, Catherine Leroy, and Helen E. Parkinson. 2015. A new Ontology Lookup Service at EMBL-EBI. In Workshop on Semantic Web Applications and Tools for Life Sciences. https://api.semanticscholar.org/CorpusID:29293420
[13]
Pouya Kousha, Arpan Jain, Ayyappa Kolli, Matthew Lieber, Mingzhe Han, Nicholas Contini, Hari Subramoni, and Dhableswar K. Panda. 2023. SAI: AI-Enabled Speech Assistant Interface for Science Gateways in HPC. In High Performance Computing, Abhinav Bhatele, Jeff Hammond, Marc Baboulin, and Carola Kruse (Eds.). Springer Nature Switzerland, Cham, 402–424.
[14]
Pouya Kousha, Matthew Lieber, Hari Subramoni, and Dhableswar K. Panda. 2023. Speech Assistant Interface Demo. https://youtu.be/R6Xsb5Qi92k Accessed: 2023/10/23 15:23:57.
[15]
Alex Krizhevsky. 2019. CIFAR-10 Dataset. https://www.cs.toronto.edu/ kriz/cifar.html [Online; accessed 2023/10/23 15:23:57].
[16]
Chunhua Liao, Pei-Hung Lin, Gaurav Verma, Tristan Vanderbruggen, Murali Emani, Zifan Nan, and Xipeng Shen. 2021. HPC Ontology: Towards a Unified Ontology for Managing Training Datasets and AI Models for High-Performance Computing. In 2021 IEEE/ACM Workshop on Machine Learning in High Performance Computing Environments (MLHPC). 69–80. https://doi.org/10.1109/MLHPC54614.2021.00012
[17]
Jerry Liu. 2022. LlamaIndex. https://doi.org/10.5281/zenodo.1234
[18]
James Malone, Andy Brown, Allyson Lister, Jon Ison, Duncan Hull, Helen Parkinson, and Robert Stevens. 2014. The Software Ontology (SWO): A resource for reproducibility in biomedical data analysis, curation and digital preservation. Journal of biomedical semantics 5 (06 2014), 25. https://doi.org/10.1186/2041-1480-5-25
[19]
Matthew Horridge. 2023. OWLViz: Ontology Visualization Tool. GitHub repository. https://github.com/protegeproject/owlviz Accessed on August 16, 2023.
[20]
Cynthia Matuszek, John Cabral, Michael Witbrock, and John DeOliveira. 2006. An Introduction to the Syntax and Content of Cyc.44–49.
[21]
Mark A. Musen. 2015. The protégé project: a look back and a look forward. AI Matters 1, 4 (2015), 4–12. https://doi.org/10.1145/2757001.2757003
[22]
Network Based Computing Laboratory. 2015. OSU Micro-Benchmarks. http://mvapich.cse.ohio-state.edu/benchmarks/.
[23]
Yuval Netzer, Tao Wang, Adam Coates, Alessandro Bissacco, Bo Wu, and Andrew Y. Ng. 2011. Reading Digits in Natural Images with Unsupervised Feature Learning. In NIPS Workshop on Deep Learning and Unsupervised Feature Learning 2011. http://ufldl.stanford.edu/housenumbers/nips2011_housenumbers.pdf
[24]
OpenAI. 2023. ChatGPT - Language Generation Tool. https://chat.openai.com Accessed on August 16, 2023.
[25]
OpenAI. 2023. OpenAI. https://www.openai.com Accessed on August 16, 2023.
[26]
Aamir Shafi and Hari Subramoni. 2023. ConvoHPC’23. https://nowlab.cse.ohio-state.edu/static/media/workshops/presentations/convohpc23/SAI-ISC-slides.pdf
[27]
M.A. Sicilia, E. Garcia, S. Sanchez, and E. Rodriguez. 2004. On integrating learning object metadata inside the OpenCyc knowledge base. In IEEE International Conference on Advanced Learning Technologies, 2004. Proceedings.900–901. https://doi.org/10.1109/ICALT.2004.1357711
[28]
Steffen Staab and Rudi Studer. 2009. Handbook on Ontologies (2nd ed.). Springer Publishing Company, Incorporated.
[29]
Christian Szegedy, Vincent Vanhoucke, Sergey Ioffe, Jonathon Shlens, and Zbigniew Wojna. 2015. Rethinking the Inception Architecture for Computer Vision. arxiv:cs.CV/1512.00567
[30]
Hugo Touvron 2023. Llama 2: Open Foundation and Fine-Tuned Chat Models. arxiv:cs.CL/2307.09288
[31]
Michael Uschold and Michael Grüninger. 1996. Ontologies: Principles, methods and applications. The Knowledge Engineering Review 11 (01 1996).
Index Terms
- Democratizing HPC Access and Use with Knowledge Graphs
Recommendations
An Edge Service for Managing HPC Workflows
HUST'17: Proceedings of the Fourth International Workshop on HPC User Support ToolsLarge experimental collaborations, such as those at the Large Hadron Collider at CERN, have developed large job management systems running hundreds of thousands of jobs across worldwide computing grids. HPC facilities are becoming more important to ...
Unified Access to Grid and HPC Resources
PDP '10: Proceedings of the 2010 18th Euromicro Conference on Parallel, Distributed and Network-based ProcessingFacing computing and data intensive problems scientists are forced to use all the available resources to solve their problems. This applies to the usage of different distributed e-Infrastructures based on different concepts and architectures. Providing ...
HPC on the Grid: The Theophys Experience
The Grid Virtual Organization (VO) "Theophys", associated to the INFN (Istituto Nazionale di Fisica Nucleare), is a theoretical physics community with various computational demands, spreading from serial, SMP, MPI and hybrid jobs. That has led, in the ...
Comments
Information & Contributors
Information
Published In
November 2023
2180 pages
ISBN:9798400707858
DOI:10.1145/3624062
Copyright © 2023 ACM.
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].
Publisher
Association for Computing Machinery
New York, NY, United States
Publication History
Published: 12 November 2023
Check for updates
Author Tags
Qualifiers
- Research-article
- Research
- Refereed limited
Funding Sources
Conference
SC-W 2023
SC-W 2023: Workshops of The International Conference on High Performance Computing, Network, Storage, and Analysis
November 12 - 17, 2023
CO, Denver, USA
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 63Total Downloads
- Downloads (Last 12 months)63
- Downloads (Last 6 weeks)4
Other Metrics
Citations
Cited By
View allView Options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign inFull Access
View options
View or Download as a PDF file.
PDFeReader
View online with eReader.
eReaderHTML Format
View this article in HTML Format.
HTML Format