research-article

Science Use Case Design Patterns for Autonomous Experiments

Authors:

Christian Engelmann,

Suhas SomnathAuthors Info & Claims

EuroPLoP '23: Proceedings of the 28th European Conference on Pattern Languages of Programs

Article No.: 26, Pages 1 - 14

https://doi.org/10.1145/3628034.3628060

Published: 05 February 2024 Publication History

Abstract

Connecting scientific instruments and robot-controlled laboratories with computing and data resources at the edge, the Cloud or the high-performance computing (HPC) center enables autonomous experiments, self-driving laboratories, smart manufacturing, and artificial intelligence (AI)-driven design, discovery and evaluation. The Self-driven Experiments for Science / Interconnected Science Ecosystem (INTERSECT) Open Architecture enables science breakthroughs using intelligent networked systems, instruments and facilities with a federated hardware/software architecture for the laboratory of the future. It relies on a novel approach, consisting of (1) science use case design patterns, (2) a system of systems architecture, and (3) a microservice architecture. This paper introduces the science use case design patterns of the INTERSECT Architecture. It describes the overall background, the involved terminology and concepts, and the pattern format and classification. It further offers an overview of the 12 defined patterns and 4 examples of patterns of 2 different pattern classes. It also provides insight into building solutions from these patterns. The target audience are computer, computational, instrument and domain science experts working in the field of autonomous experiments.

References

[1]

Anees Al-Najjar, Nageswara Rao, Neena Imam, Thomas Naughton, Seth Hitefield, Lawrence Sorrillo, James Kohl, Wael Elwasif, Jean-Christophe Bilheux, Hassina Bilheux, Swen Boehm, and Jason Kincl. 2021. Virtual Framework for Development and Testing of Federation Software Stack. In 2021 IEEE 46th Conference on Local Computer Networks (LCN). 323–326. https://doi.org/10.1109/LCN52139.2021.9524993

[2]

Peter Amstutz, Maxim Mikheev, Michael R. Crusoe, Nebojša Tijanić, Samuel Lampa, 2022. Existing Workflow systems. https://s.apache.org/existing-workflow-systems

[3]

Balsam 2022. Balsam Workflows. https://www.alcf.anl.gov/support-center/theta/balsam

[4]

Jan Borchers. 2001. A Pattern Approach to Interaction Design. John Wiley & Sons, Inc., New York, NY, USA.

Digital Library

[5]

Michael Brim and Christian Engelmann. 2022. INTERSECT Architecture Specification: Microservice Architecture (Version 0.5). Technical Report ORNL/TM-2022/2715. Oak Ridge National Laboratory, Oak Ridge, TN, USA. https://doi.org/10.2172/1902805

[6]

Frank Buschmann, Kevin Henney, and Douglas C. Schmidt. 2007. Pattern-Oriented Software Architecture - Volume 4: A Pattern Language for Distributed Computing. Wiley Publishing.

[7]

Frank Buschmann, Regine Meunier, Hans Rohnert, Peter Sommerlad, and Michael Stal. 1996. Pattern-Oriented Software Architecture - Volume 1: A System of Patterns. Wiley Publishing.

[8]

Jonathan Carter, John Feddema, Doug Kothe, Rob Neely, Jason Pruet, and Rick Stevens. 2023. Advanced Research Directions on AI for Science, Energy, and Security. Available at https://www.anl.gov/ai-for-science-report.

[9]

Defense Advanced Research Projects Agency, U.S. Department of Defense. 2022. Creating Cross-Domain Kill Webs in Real Time. https://www.darpa.mil/news-events/2020-09-18a

[10]

Defense Advanced Research Projects Agency, U.S. Department of Defense. 2022. System of Systems Integration Technology and Experimentation (SoSITE). https://www.darpa.mil/program/system-of-systems-integration-technology-and-experimentation

[11]

DOE 2020. DOE National Laboratories’ Computational Facilities – Research Workshop Report. Technical Report ANL/MCS-TM-388. Argonne National Laboratory, Lemont, IL, USA. https://publications.anl.gov/anlpubs/2020/02/158604.pdf

[12]

Chad Dougherty, Kirk Sayre, Robert Seacord, David Svoboda, and Kazuya Togashi. 2009. Secure Design Patterns. Technical Report CMU/SEI-2009-TR-010. Software Engineering Institute, Carnegie Mellon University, Pittsburgh, PA. https://doi.org/10.1184/R1/6583640.v1

[13]

Douglas K. Van Duyne, James Landay, and Jason I. Hong. 2002. The Design of Sites: Patterns, Principles, and Processes for Crafting a Customer-Centered Web Experience. Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA.

[14]

Christian Engelmann, Olga Kuchar, Swen Boehm, Michael J. Brim, Thomas Naughton, Suhas Somnath, Scott Atchley, Jack Lange, Ben Mintz, and Elke Arenholz. 2022. The INTERSECT Open Federated Architecture for the Laboratory of the Future. In Communications in Computer and Information Science (CCIS): Accelerating Science and Engineering Discoveries Through Integrated Research Infrastructure for Experiment, Big Data, Modeling and Simulation. 18th Smoky Mountains Computational Sciences & Engineering Conference (SMC) 2022, Vol. 1690. Springer, Cham, 173–190. https://doi.org/10.1007/978-3-031-23606-8_11 Acceptance rate 32.4% (24/74).

[15]

Christian Engelmann and Suhas Somnath. 2022. INTERSECT Architecture Specification: Use Case Design Patterns (Version 0.5). Technical Report ORNL/TM-2022/2681. Oak Ridge National Laboratory, Oak Ridge, TN, USA. https://doi.org/10.2172/1896984

[16]

FireCrest 2022. FireCrest RESTful API. https://firecrest.readthedocs.io/en/latest/ index.html

[17]

Evan Fortunato. 2016. STITCHES - SoS Technology Integration Tool Chain for Heterogeneous Electronic Systems. https://ndiastorage.blob.core.usgovcloudapi. net/ndia/2016/systems/18869_Fortunato_SoSITE_STITCHES_Overview_Long_ 9Sep2016_.pdf

[18]

Martin Fowler. 2002. Patterns of Enterprise Application Architecture. Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA.

Digital Library

[19]

Erich Gamma, Richard Helm, Ralph Johnson, and John Vlissides. 1994. Design Patterns: Elements of Reusable Object-oriented Software. Addison-Wesley Professional.

Digital Library

[20]

Daniel Garijo, Pinar Alper, Khalid Belhajjame, Oscar Corcho, Yolanda Gil, and Carole Goble. 2014. Common motifs in scientific workflows: An empirical analysis. Future Generation Computer Systems 36 (2014), 338–351. https://doi.org/10.1016/j.future.2013.09.018 Special Section: Intelligent Big Data Processing Special Section: Behavior Data Security Issues in Network Information Propagation Special Section: Energy-efficiency in Large Distributed Computing Architectures Special Section: eScience Infrastructure and Applications.

[21]

Gladier 2022. Gladier experiment steering. https://labs.globus.org/projects/ gladier.html

[22]

Globus Automate 2022. Globus Automation Services. https://docs.globus.org/globus-automation-services

[23]

Jeffrey Heer and Maneesh Agrawala. 2006. Software Design Patterns for Information Visualization. IEEE Transactions on Visualization and Computer Graphics 12, 5 (Sept. 2006), 853–860. https://doi.org/10.1109/TVCG.2006.178

Digital Library

[24]

Nils Heinonen. 2020. Argonne researchers use Theta for real-time analysis of COVID-19 proteins. https://www.alcf.anl.gov/news/argonne-researchers-use-theta-real-time-analysis-covid-19-proteins

[25]

Saurabh Hukerikar and Christian Engelmann. 2017. Resilience Design Patterns: A Structured Approach to Resilience at Extreme Scale. Journal of Supercomputing Frontiers and Innovations (JSFI) 4, 3 (Oct. 2017), 4–42. https://doi.org/10.14529/jsfi170301

Digital Library

[26]

Saurabh Hukerikar and Christian Engelmann. 2017. Resilience Design Patterns: A Structured Approach to Resilience at Extreme Scale (Version 1.2). Technical Report ORNL/TM-2017/745. Oak Ridge National Laboratory, Oak Ridge, TN, USA. https://doi.org/10.2172/1436045

[27]

ISO/IEC JTC 1/SC 7 Software and systems engineering. 2019. ISO/IEC/IEEE 21839:2019. https://www.iso.org/standard/71955.html

[28]

Sergei V. Kalinin, Maxim Ziatdinov, Jacob Hinkle, Stephen Jesse, Ayana Ghosh, Kyle P. Kelley, Andrew R. Lupini, Bobby G. Sumpter, and Rama K. Vasudevan. 2021. Automated and Autonomous Experiments in Electron and Scanning Probe Microscopy. ACS Nano 15, 8 (2021), 12604–12627. https://doi.org/10.1021/acsnano.1c02104 arXiv:https://doi.org/10.1021/acsnano.1c02104

[29]

Kebotix 2022. Kebotix. https://www.kebotix.com

[30]

Michael Kircher and Prashant Jain. 2004. Pattern-Oriented Software Architecture, Volume 3: Patterns for Resource Management. Wiley Publishing.

[31]

Kubernetes 2022. Kubernetes. https://kubernetes.io

[32]

Olga A. Kuchar, Swen Boehm, Thomas Naughton, Suhas Somnath, Ben Mintz, Jack Lange, Scott Atchley, Rohit Srivastava, and Patrick Widener. 2022. INTERSECT Architecture Specification: System-of-systems Architecture (Version 0.5). Technical Report ORNL/TM-2022/2717. Oak Ridge National Laboratory, Oak Ridge, TN, USA. https://doi.org/10.2172/1968700

[33]

Mark. W. Maier. 1998. Architecting Principles for System-of-Systems. Systems Engineering 1, 4 (Nov. 1998), 267–284.

[34]

Mark. W. Maier and Eberhardt Rechtin. 2009. The Art of Systems Architecting (Systems Engineering). CRC Press, Boca Raton, FL, USA.

[35]

William H. J. Manthorpe Jr.1996. The Emerging Joint System of Systems: A Systems Engineering Challenge and Opportunity for APL. John Hopkins APL Technical Digest 17, 3 (July 1996), 305–313.

[36]

National Energy Research Scientific Computing Center (NERSC). 2022. Superfacility API. https://api.nersc.gov

[37]

National Energy Research Scientific Computing Center (NERSC). 2022. Superfacility project. https://www.nersc.gov/research-and-development/superfacility

[38]

Thomas Naughton, Seth Hitefield, Lawrence Sorrillo, Nageswara Rao, James Kohl, Wael Elwasif, Jean-Christophe Bilheux, Hassina Bilheux, Swen Boehm, Jason Kincl, Satyabrata Sen, and Neena Imam. 2020. Software Framework for Federated Science Instruments. In Driving Scientific and Engineering Discoveries Through the Convergence of HPC, Big Data and AI, Jeffrey Nichols, Becky Verastegui, Arthur Barney Maccabe, Oscar Hernandez, Suzanne Parete-Koon, and Theresa Ahearn (Eds.). Springer International Publishing, 189–203.

[39]

Netflix. 2022. Netflix OSS. https://netflix.github.io

[40]

Netflix. 2022. Spring Cloud Netflix. https://spring.io/projects/spring-cloud-netflix

[41]

Richard S. Pei. 2000. System of Systems Integration (SoSI) - A Smart Way of Acquiring Army C4I2WS Systems. In Proceedings of the Summer Computer Simulation Conference 2000. 574–579.

[42]

Eberhardt Rechtin. 1990. Systems Architecting: Creating & Building Complex Systems. Prentice Hall.

[43]

Katharine Sanderson. 2019. Automation: Chemistry shoots for the Moon. Nature 568 (April 2019), 577–579. https://doi.org/10.1038/d41586-019-01246-y

[44]

Douglas C. Schmidt, Michael Stal, Hans Rohnert, and Frank Buschmann. 2000. Pattern-Oriented Software Architecture Volume 2: Patterns for Concurrent and Networked Objects. Wiley Publishing.

[45]

Rick Stevens, Valerie Taylor, Jeff Nichols, Arthur Barney Maccabe, Katherine Yelick, and David Brown. 2020. AI for Science Report. Available at https://www.anl.gov/cels/reference/ai-for-science-report-2020.

[46]

Jerry Talton, Lingfeng Yang, Ranjitha Kumar, Maxine Lim, Noah Goodman, and Radomír Měch. 2012. Learning Design Patterns with Bayesian Grammar Induction. In Proceedings of the 25th Annual ACM Symposium on User Interface Software and Technology (UIST) 2012 (Cambridge, Massachusetts, USA). ACM, New York, NY, USA, 63–74. https://doi.org/10.1145/2380116.2380127

Digital Library

[47]

Mohammadreza Torkjazi and Ali K. Raz. 2022. A Taxonomy for System of Autonomous Systems. In 2022 17th Annual System of Systems Engineering Conference (SOSE). 198–203. https://doi.org/10.1109/SOSE55472.2022.9812673

Digital Library

[48]

Keri Troutman. 2019. Superfacility Framework Advances Photosynthesis Research. https://www.nersc.gov/news-publications/nersc-news/science-news/2019/superfacility-framework-advances-photosynthesis-research

[49]

U.S. Department of Defense. 2010. The DoDAF Architecture Framework Version 2.02. https://dodcio.defense.gov/Library/DoD-Architecture-Framework

[50]

W.M.P. van der Aalst, A.H.M. ter Hofstede, B. Kiepuszewski, and A.P. Barros. 2003. Workflow Patterns. Distributed and Parallel Databases 14, 1 (2003), 5–51. https://doi.org/10.1023/A:1022883727209

Digital Library

[51]

Rafael Vescovi, Ryan Chard, Nickolaus D. Saint, Ben Blaiszik, Jim Pruyne, Tekin Bicer, Alex Lavens, Zhengchun Liu, Michael E. Papka, Suresh Narayanan, Nicholas Schwarz, Kyle Chard, and Ian T. Foster. 2022. Linking scientific instruments and computation: Patterns, technologies, and experiences. Patterns 3, 10 (2022), 100606. https://doi.org/10.1016/j.patter.2022.100606

[52]

Hanchen Wang, Tianfan Fu, Yuanqi Du, Wenhao Gao, Kexin Huang, Ziming Liu, Payal Chandak, Shengchao Liu, Peter Van Katwyk, Andreea Deac, Anima Anandkumar, Karianne Bergen, Carla P. Gomes, Shirley Ho, Pushmeet Kohli, Joan Lasenby, Jure Leskovec, Tie-Yan Liu, Arjun Manrai, Debora Marks, Bharath Ramsundar, Le Song, Jimeng Sun, Jian Tang, Petar Veličković, Max Welling, Linfeng Zhang, Connor W. Coley, Yoshua Bengio, and Marinka Zitnik. 2023. Scientific Discovery in the Age of Artificial Intelligence. Nature 620 (Aug. 2023), 47–60. https://doi.org/10.1038/s41586-023-06221-2

[53]

Eberhard Wolff. 2016. Microservices: Flexible Software Architectures. Addison-Wesley Professional.

Cited By

Hahn SFackler PGodoy WMaheshwari KMorgan ZSavici AHoffmann CValero-Lara PVetter JFerreira Da Silva R(2024)Integrating ORNL’s HPC and Neutron Facilities with a Performance-Portable CPU/GPU EcosystemSC24-W: Workshops of the International Conference for High Performance Computing, Networking, Storage and Analysis10.1109/SCW63240.2024.00264(2107-2117)Online publication date: 17-Nov-2024
https://doi.org/10.1109/SCW63240.2024.00264

Index Terms

Science Use Case Design Patterns for Autonomous Experiments
1. Software and its engineering
  1. Software organization and properties
    1. Software system structures
      1. Software architectures

Recommendations

15 design patterns for pattern illustrating
PLoP '18: Proceedings of the 25th Conference on Pattern Languages of Programs

This paper presents fifteen design patterns for Pattern Illustrating, which support people to create good pattern illustrations. Pattern Illustrating is a process of visualizing the essence of each pattern symbolically, conducted after Pattern Mining ...
Towards a Unified Catalog of Hypermedia Design Patterns
HICSS '00: Proceedings of the 33rd Hawaii International Conference on System Sciences-Volume 6 - Volume 6

There has been a recent increase in the number of published design patterns for hypermedia. Some of these patterns have been evolving, while others have remained untouched.This paper attempts to list all the patterns currently known, tracing the ...
Research state of the art on GoF design patterns: A mapping study

Design patterns are used in software development to provide reusable and documented solutions to common design problems. Although many studies have explored various aspects of design patterns, no research summarizing the state of research related to ...

Comments

Information & Contributors

Information

Published In

cover image ACM Other conferences

EuroPLoP '23: Proceedings of the 28th European Conference on Pattern Languages of Programs

July 2023

451 pages

ISBN:9798400700408

DOI:10.1145/3628034

Copyright © 2023 ACM.

Publication rights licensed to ACM. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of the United States government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 05 February 2024

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Funding Sources

U.S. Department of Energy

Conference

EuroPLoP 2023

EuroPLoP 2023: 28th European Conference on Pattern Languages of Programs

July 5 - 9, 2023

Irsee, Germany

Acceptance Rates

Overall Acceptance Rate 216 of 354 submissions, 61%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

1
Total Citations
View Citations
28
Total Downloads

Downloads (Last 12 months)28
Downloads (Last 6 weeks)1

Reflects downloads up to 09 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Hahn SFackler PGodoy WMaheshwari KMorgan ZSavici AHoffmann CValero-Lara PVetter JFerreira Da Silva R(2024)Integrating ORNL’s HPC and Neutron Facilities with a Performance-Portable CPU/GPU EcosystemSC24-W: Workshops of the International Conference for High Performance Computing, Networking, Storage and Analysis10.1109/SCW63240.2024.00264(2107-2117)Online publication date: 17-Nov-2024
https://doi.org/10.1109/SCW63240.2024.00264

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

HTML Format

View this article in HTML Format.

Media

Figures

Other

Tables

View Table of Contents