article

Simplifying construction of complex workflows for non-expert users of the Southern California Earthquake Center Community Modeling Environment

Authors:

Philip Maechling,

Hans Chalupsky,

Maureen Dougherty,

Sridhar Gullapalli,

Carl Kesselman,

Brian Mendenhall,

Marc Spraragen,

Garrick Staples,

Karan VahiAuthors Info & Claims

ACM SIGMOD Record, Volume 34, Issue 3

Pages 24 - 30

https://doi.org/10.1145/1084805.1084811

Published: 01 September 2005 Publication History

Abstract

Workflow systems often present the user with rich interfaces that express all the capabilities and complexities of the application programs and the computing environments that they support. However, non-expert users are better served with simple interfaces that abstract away system complexities and still enable them to construct and execute complex workflows. To explore this idea, we have created a set of tools and interfaces that simplify the construction of workflows. Implemented as part of the Community Modeling Environment developed by the Southern California Earthquake Center, these tools, are integrated into a comprehensive workflow system that supports both domain experts as well as non expert users.

References

[1]

Altintas, I., C. Berkley, E. Jaeger, M. Jones, B. Ludäscher, S. Mock, Kepler: Towards a Grid-Enabled System for Scientific Workflows, In the Workflow in Grid Systems Workshop in GGF10 - The Tenth Global Grid Forum, Berlin, Germany, March 2004.

[2]

Cao, J., S. A. Jarvis, S. Saini, and G. R. Nudd. GridFlow: Workflow Management for Grid Computing. In 3rd IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGrid 2003), Tokyo, Japan, May 2003.

Digital Library

[3]

Churches, D., G. Gombas, A. Harrison, J. Maassen, C. Robinson, M. Shields, I. Taylor and I. Wang, Programming Scientific and Distributed Workflow with Triana Services. In Grid Workflow 2004 Special Issue of Concurrency and Computation: Practice and Experience, to be published, 2005.

Digital Library

[4]

Deelman, E., James Blythe, Yolanda Gil, Carl Kesselman, Scott Koranda, Albert Lazzarini, Gaurang Mehta, Maria Alessandra Papa, Karan Vahi (2003a). Pegasus and the Pulsar Search: From Metadata to Execution on the Grid, Applications Grid Workshop, PPAM 2003, Czestochowa, Poland 2003.

[5]

Deelman E., James Blythe, Yolanda Gil, Carl Kesselman (2003b). Workflow Management in GriPhyN, Grid Resource Management, Kluwer, 2003.

[6]

Deelman, E., James Blythe, Yolanda Gil, Carl Kesselman, Gaurang Mehta, Karan Vahi, Kent Blackburn, Albert Lazzarini, Adam Arbree, Richard Cavanaugh, and Scott Koranda (2003c). Mapping Abstract Complex Workflows onto Grid Environments, Journal of Grid Computing, Vol. 1, no. 1, 2003, pp. 25--39.

[7]

Deelman, E., James Blythe, Yolanda Gil, Carl Kesselman, Gaurang Mehta, Sonal Patil, Mei-Hui Su, Karan Vahi, Miron Livny (2004), Pegasus:Mapping Scientific Workflows onto the Grid, Across Grids Conference 2004, Nicosia, Cyprus, 2004

[8]

Domenico B., John Caron, Ethan Davis, Robb Kambic and Stefano Nativi (2002). Thematic Real-time Environmental Distributed Data Services (THREDDS): Incorporating Interactive Analysis Tools into NSDL, Journal of Digital Information, Volume 2 Issue 4 Article No. 114, 2002-05-29

[9]

Field, E. H., V. Gupta, N. Gupta, P. Maechling, and T. H. Jordan (2005). Hazard Map Calculations Using GRID Computing, to be published to Seismological Research Letters, 2005

[10]

Foster, I., C. Kesselman, S. Tuecke, The Anatomy of the Grid: Enabling ScalableVirtual Organizations, International J. Supercomputer Applications, 15(3), 2001.

Digital Library

[11]

Foster, I., J. Voeckler, M. Wilde, and Y. Zhao. Chimera: A Virtual Data System for Representing, Querying and Automating Data Derivation Proceedings of the 14th Conference on Scientific and Statistical Database Management, Edinburgh, Scotland, July 2002.

Digital Library

[12]

Frey, J. T. Tannenbaum, I. Foster, M. Livny, S. Tuecke, Condor-G: A Computation Management Agent for Multi-Institutional Grids, Cluster Computing, 5(3):237--246, 2002.

Digital Library

[13]

Genesereth, M. R. (1991). Knowledge interchange format. In J. Allen, R. Fikes, and E. Sandewall, editors, Proceedings of the 2nd International Conference on Principles of Knowledge Representation and Reasoning, pages 599--600, San Mateo, CA, USA, April 1991.

[14]

Jordan, T. H., P. J Maechling, and the SCEC/CME Collaboration (2003). The SCEC community modeling environment: an information infrastructure for system-level science, Seism. Res. Lett. 74, 324--328

[15]

Kim, J., M. Spraragen, and Y. Gil (2004a), An Intelligent Assistant for Interactive Workflow Composition, In Proceedings of the International Conference on Intelligent User Interfaces (IUI-2004); Madeira, Portugal, 2004.

Digital Library

[16]

Kim, J., M. Spraragen, and Y. Gil (2004b), A Knowledge-Based Approach to Interactive Workflow Composition, In Proceedings of the 2004 Workshop on Planning and Scheduling for Web and Grid Services, at the 14th International Conference on Automatic Planning and Scheduling (ICAPS 04); Whistler, Canada, 2004.

[17]

McGough, S., L. Young, A. Afzal, S. Newhouse, and J. Darlington, WorkflowEnactment in ICENI In UK e-Science, All Hands Meeting, p. 894--900, Nottingham, UK, Sep. 2004

[18]

PowerLoom: http://www.isi.edu/isd/LOOM/PowerLoom/

[19]

Romberg, R., The UNICORE Architecture-Seamless Access to Distributed Resources, Proceedings of 8th IEEE International Symposium on High Performance Computing, Redondo Beach, CA, USA, August 1999, pp. 287--293

Digital Library

[20]

von Laszewski, G. K. Amin, M. Hategan, N. J. Zaluzec, S. Hampton, and A. Rossi, GridAnt: A Client-Controllable Grid Workflow System. In 37th Annual Hawaii International Conference on System Sciences (HICSS'04) IEEE Computer Society Press, Los Alamitos, CA, USA, January 5-8, 2004.

Digital Library

[21]

Wroe C., C. A. Goble, M. Greenwood, P. Lord, S. Miles, J. Papay, T. Payne, L. Moreau (2004), Automating Experiments Using Semantic Data on a Bioinformatics Grid, In IEEE Intelligent Systems special issue on e-Science Jan/Feb 2004.

Digital Library

Cited By

Vargas-Acosta RChavira LVillanueva-Rosales NPennington D(2022)Automating Multivariable Workflow Composition for Model-to-Model Integration2022 IEEE 18th International Conference on e-Science (e-Science)10.1109/eScience55777.2022.00030(159-170)Online publication date: Oct-2022
https://doi.org/10.1109/eScience55777.2022.00030
Tomasiewicz DPawlik MMalawski MRycerz K(2020)Foundations for Workflow Application Scheduling on D-Wave SystemComputational Science – ICCS 202010.1007/978-3-030-50433-5_40(516-530)Online publication date: 15-Jun-2020
https://doi.org/10.1007/978-3-030-50433-5_40
McGarry GTolmie PBenford SGreenhalgh CChamberlain ALee CPoltrock SBarkhuus LBorges MKellogg W(2017)"They're all going out to something weird"Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing10.1145/2998181.2998325(995-1008)Online publication date: 25-Feb-2017
https://dl.acm.org/doi/10.1145/2998181.2998325
Show More Cited By

Index Terms

Simplifying construction of complex workflows for non-expert users of the Southern California Earthquake Center Community Modeling Environment

Recommendations

What makes workflows work in an opportunistic environment?: Research Articles
Workflow in Grid Systems

In this paper, we examine the issues of workflow mapping and execution in opportunistic environments such as the Grid. As applications become ever more complex, the process of choosing the appropriate resources and successfully executing the application ...
Adaptive Workflow Processing and Execution in Pegasus
GPC-WORKSHOPS '08: Proceedings of the 2008 The 3rd International Conference on Grid and Pervasive Computing - Workshops

Workflows are widely used in applications that require coordinated use of computational resources. Workflow definition languages typically abstract over some aspects of the way in which a workflow is to be executed, such as the level of parallelism to ...
Deploying High Throughput Scientific Workflows on Container Schedulers with Makeflow and Mesos
CCGrid '17: Proceedings of the 17th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing

Workflows are a widely used abstraction for describing large scientific applications and running them on distributed systems. However, most workflow systems have been silent on the question of what execution environment each task in the workflow is ...

Comments

Information & Contributors

Information

Published In

cover image ACM SIGMOD Record

ACM SIGMOD Record Volume 34, Issue 3

September 2005

115 pages

ISSN:0163-5808

DOI:10.1145/1084805

Issue’s Table of Contents

Copyright © 2005 Authors.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 September 2005

Published in SIGMOD Volume 34, Issue 3

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

37
Total Citations
View Citations
454
Total Downloads

Downloads (Last 12 months)9
Downloads (Last 6 weeks)0

Reflects downloads up to

Other Metrics

View Author Metrics

Citations

Cited By

Vargas-Acosta RChavira LVillanueva-Rosales NPennington D(2022)Automating Multivariable Workflow Composition for Model-to-Model Integration2022 IEEE 18th International Conference on e-Science (e-Science)10.1109/eScience55777.2022.00030(159-170)Online publication date: Oct-2022
https://doi.org/10.1109/eScience55777.2022.00030
Tomasiewicz DPawlik MMalawski MRycerz K(2020)Foundations for Workflow Application Scheduling on D-Wave SystemComputational Science – ICCS 202010.1007/978-3-030-50433-5_40(516-530)Online publication date: 15-Jun-2020
https://doi.org/10.1007/978-3-030-50433-5_40
McGarry GTolmie PBenford SGreenhalgh CChamberlain ALee CPoltrock SBarkhuus LBorges MKellogg W(2017)"They're all going out to something weird"Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing10.1145/2998181.2998325(995-1008)Online publication date: 25-Feb-2017
https://dl.acm.org/doi/10.1145/2998181.2998325
Wang YShi WBerrocal EChard KCostan ANicolae BRamakrishnan L(2015)On Performance Resilient Scheduling for Scientific Workflows in HPC Systems with Constrained Storage ResourcesProceedings of the 6th Workshop on Scientific Cloud Computing10.1145/2755644.2755646(17-24)Online publication date: 16-Jun-2015
https://dl.acm.org/doi/10.1145/2755644.2755646
Shi HZheng LLiu G(2015)Research on TSP based on ant colony algorithm2015 IEEE International Conference on Information and Automation10.1109/ICInfA.2015.7279626(2048-2051)Online publication date: Aug-2015
https://doi.org/10.1109/ICInfA.2015.7279626
Chen WLee YFekete AZomaya A(2015)Adaptive multiple-workflow scheduling with task rearrangementThe Journal of Supercomputing10.1007/s11227-014-1361-071:4(1297-1317)Online publication date: 1-Apr-2015
https://dl.acm.org/doi/10.1007/s11227-014-1361-0
Wang YHu MKent K(2015)ACSComputing10.1007/s00607-014-0409-697:4(379-402)Online publication date: 1-Apr-2015
https://dl.acm.org/doi/10.1007/s00607-014-0409-6
Reimann PSchwarz HMitschang B(2014)Data patterns to alleviate the design of scientific workflows exemplified by a bone simulationProceedings of the 26th International Conference on Scientific and Statistical Database Management10.1145/2618243.2618279(1-4)Online publication date: 30-Jun-2014
https://dl.acm.org/doi/10.1145/2618243.2618279
Gil YPrasad S(2014)Teaching parallelism without programmingProceedings of the Workshop on Education for High-Performance Computing10.1109/EduHPC.2014.12(42-48)Online publication date: 16-Nov-2014
https://dl.acm.org/doi/10.1109/EduHPC.2014.12
Acuña RLacroix ZChomilier J(2013)A workflow for the prediction of the effects of residue substitution on protein stabilityProceedings of the 8th IAPR international conference on Pattern Recognition in Bioinformatics10.1007/978-3-642-39159-0_23(253-264)Online publication date: 17-Jun-2013
https://dl.acm.org/doi/10.1007/978-3-642-39159-0_23
Show More Cited By

View Options

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents