research-article

Publish/subscribe as a model for scientific workflow interoperability

Authors:

Andrew JonesAuthors Info & Claims

WORKS '09: Proceedings of the 4th Workshop on Workflows in Support of Large-Scale Science

Article No.: 1, Pages 1 - 10

https://doi.org/10.1145/1645164.1645165

Published: 16 November 2009 Publication History

Abstract

Workflow interoperability is receiving increasing attention from the distributed computing community. Different standards and levels have been set to achieve interoperability among workflow system, for example, by the Workflow Management Coalition (WfMC). WS-based notification messaging systems provide a mechanism for decoupling and enabling asynchronous messaging among different applications in the distributed computing environment. In this paper a generic approach to achieving interoperability among workflow systems, based on a WS-based notification messaging system, is proposed. This approach exposes an API called Publish/Subscribe Scientific Workflow Interoperability Framework (PS-SWIF) that can be implemented in multiple workflow systems to provide run time interoperability. The PS-SWIF application is based on Web Services that enable scientists to apply a Publish/Subscribe mechanism to publish a topic using a workflow system, and enables different workflow systems to subscribe to this topic and receive notification messages when an event is executed.

References

[1]

Globus Alliance and IBM. The WS-Resource Framework, 2004. Available at: URL http://www.globus.org/wsrf/.

[2]

F. Curbera D. Box, E. Christensen et al. Web Services Addressing (WS-Addressing), 2004. Available at: URL http://www.w3.org/Submission/ws-addressing/.

[3]

Susan B. Davidson, Sarah Cohen Boulakia, and Anat Eyal et al. Provenance in scientific workflow systems. IEEE Data Eng. Bull., 30(4):44--50, 2007.

[4]

Ewa Deelman and Miron Livny. The pegasus approach to building a workflow management system.

[5]

T. Delaitre, T. Kiss, A. Goyeneche, G. Terstyanszky, S. Winter, and P. Kacsuk. GEMLCA: Running legacy code applications as grid services. Journal of Grid Computing, 3(1):75--90, 2005.

[6]

UK e Science Programme. The OGSA-DAI Project. 2002. Available at: URL http://www.ogsadai.org.uk/.

[7]

D. Box et al. Web services eventing (ws-eventing), 2004. Available at: URL http://www.w3.org/Submission/WS-Eventing/.

[8]

IBM et al. Web services notification (ws-notification), 2004. Available at: URL http://www.ibm.com/developerworks/library/specification-/ws-notification/.

[9]

National Science Foundation. The Kepler Project. 2002. Available at: URL https://kepler-project.org/.

[10]

The National Science Foundation. Linked environments for atmospheric discovery (lead), 2003. Available at: URL http://www.renci.org/focus-areas/project-archive/lead.

[11]

GGF. Global Grid Forum (GGF), 2001. Available at: URL http://www.ggf.org/.

[12]

A. Harrison. The WSPeer Project. 2006. Available at: URL http://www.wspeer.org/.

[13]

Andrew Harrison. Workflow sharing and interoperability. GridNet2 Report - Open Grid Forum OGF21, October 2007.

[14]

D. Hollingsworth. Workflow management coalition: The workflow reference model. Document TC00--1003, Workflow Management Coalition, Jan, 1995.

[15]

The European Bioinformatics Institute. Ebi soaplab web services. Available at: URL http://www.ebi.ac.uk/Tools/webservices/soaplab/overview.

[16]

P. Kacsuk and G. Sipos. Multi-grid, multi-user workflows in the P-GRADE grid portal. Journal of Grid Computing, 3(3):221--238, 2005.

[17]

A. Kertesz, G. Sipos, and P. Kacsuk. Brokering multi-grid workflows in the P-GRADE portal. Lecture Notes in Computer Science, 4375:138, 2007.

Digital Library

[18]

K Klingenstein and D Gannon. Improving interoperability, sustainability and platform convergence in scientific and scholarly workflow. Technical report, University of Colorado and Indiana University, 2007.

[19]

Scott Koranda. Ligo inspiral analysis workflow, 2007. Available at: URL https://spaces.internet2.edu/display/scischworkflow/Home.

[20]

T. Kukla, T. Kiss, G. Terstyanszky, and P. Kacsuk. A general and scalable solution for heterogeneous workflow invocation and nesting. In Workflows in Support of Large-Scale Science, 2008. WORKS 2008. Third Workshop on, pages 1--8, Nov. 2008.

[21]

Virtual Laboratory. The Virtual laboratory for e-science. 2004.

[22]

Philip Maechling. Scec earthquake wave propagation and source validation workflow, 2007. Available at: URL https://spaces.internet2.edu/display/scischworkflow/Home.

[23]

Workflow Management Coalition members. Workflow Management Coalition Workflow Standard - Interoperability Abstract Specification. The Workflow Management Coalition, 1996.

[24]

Workflow Management Coalition members. Workflow Management Coalition Workflow Standard - Interoperability Internet e-m MIME Binding. The Workflow Management Coalition, 2000.

[25]

Workflow Management Coalition members. Workflow Management Coalition Workflow Standard - Interoperability Wf-XML Binding. The Workflow Management Coalition, 2001.

[26]

C. Nemeth, G. Dozsa, R. Lovas, and P. Kacsuk. The p-grade grid portal. Lecture Notes in Computer Science, pages 10--19, 2004.

[27]

The University of Manchester and University of Southampton. myExpriment Project, 2007. Available at: URL http://www.myexperiment.org/workflows/159.

[28]

T. Oinn, M. Addis, J. Ferris, D. Marvin, M. Senger, M. Greenwood, T. Carver, K. Glover, M. R. Pocock, A. Wipat, et al. Taverna: a tool for the composition and enactment of bioinformatics workflows, 2004.

[29]

I. Rice, P. Longden and A. Bleasby. The european molecular biology open software suite (emboss), 2003. Available at: URL http://emboss.sourceforge.net/what/.

[30]

and D Chappell S Graham, P Niblett. Web Services Base Notification (WS-Base Notification), 2004. Available at: URL http://download.boulder.ibm.com/ibmdl/pub/software/dw-/library/ws-notification/WS-BaseN.pdf.

[31]

and D Chappell S Graham, P Niblett. Web Services Brokered Notification (WS-BrokeredNotification), 2004. Available at: URL http://download.boulder.ibm.com/ibmdl/pub/software/dw-/library/ws-notification/WS-BaseN.pdf.

[32]

and D Chappell S Graham, P Niblett. Web Services Topics (WS-Topics), 2004. Available at: URL http://download.boulder.ibm.com/ibmdl/pub/software/dw-/library/ws-notification/WS-BaseN.pdf.

[33]

H Son and X Li. High Performance Computing and Communications, chapter PARMI: A Publish/Subscribe Based Asynchronous RMI Framework for Cluster Computing. Springer Berlin/Heidelberg, 2007.

Digital Library

[34]

swif. The Publish/Subscribe Model for Scientific Workflow System. 2009. Available at: URL http://swif.cs.cf.ac.uk/.

[35]

Ian Taylor. Workflow management research group - wfm-rg. GridNet2 Report - Open Grid Forum OGF22, February 2008.

[36]

Adrian Toth. Levels of the grid workflow interoperability. Open Grid Forum OGF20, May 2007.

[37]

S. Tuecke, K. Czajkowski, I. Foster, J. Frey, S. Graham, C. Kesselman, T. Maquire, T. Sandholm, D. Snelling, and P. Vanderbilt. Open grid services infrastructure (OGSI). In Global Grid Forum, 2003.

[38]

Cardiff University. The Triana Project. Available at: URL http://www.trianacode.org.

[39]

Cardiff University. School of Computer Science. 1883. Available at: URL http://www.cs.cf.ac.uk/.

[40]

Z. Zhao and Booms. Vle-wfbus: a scientific workflow bus for multi e-science domains. In Second IEEE International Conference on e-Science and Grid Computing, 2006., pages 11--11, 2006.

Digital Library

Cited By

Chard RPruyne JMcKee KBryan JRaumann BAnanthakrishnan RChard KFoster I(2023)Globus automation services: Research process automation across the space–time continuumFuture Generation Computer Systems10.1016/j.future.2023.01.010142(393-409)Online publication date: May-2023
https://doi.org/10.1016/j.future.2023.01.010
Llambias GRuggia R(2014)A middleware-based platform for the integration of bioinformatic services2014 XL Latin American Computing Conference (CLEI)10.1109/CLEI.2014.6965178(1-12)Online publication date: Sep-2014
https://doi.org/10.1109/CLEI.2014.6965178
Llambías GGonzález LRuggia R(2014)Towards an Integration Platform for Bioinformatics ServicesService-Oriented Computing – ICSOC 2013 Workshops10.1007/978-3-319-06859-6_39(445-456)Online publication date: 2014
https://doi.org/10.1007/978-3-319-06859-6_39
Show More Cited By

Index Terms

Publish/subscribe as a model for scientific workflow interoperability

Recommendations

A Survey of Data-Intensive Scientific Workflow Management

Nowadays, more and more computer-based scientific experiments need to handle massive amounts of data. Their data processing consists of multiple computational steps and dependencies within them. A data-intensive scientific workflow is useful for ...
A Formal Approach to Support Interoperability in Scientific Meta-workflows

Scientific workflows orchestrate the execution of complex experiments frequently using distributed computing platforms. Meta-workflows represent an emerging type of such workflows which aim to reuse existing workflows from potentially different workflow ...
A Definition and Analysis of the Role of Meta-workflows in Workflow Interoperability
IWSG '15: Proceedings of the 2015 7th International Workshop on Science Gateways

Scientific workflows orchestrate the execution of complex experiments on high performance computing platforms. Meta-workflows represent an emerging type of such workflows which aim to integrate multiple embedded workflows from potentially different ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

WORKS '09: Proceedings of the 4th Workshop on Workflows in Support of Large-Scale Science

November 2009

136 pages

ISBN:9781605587172

DOI:10.1145/1645164

Conference Chairs:
Ewa Deelman
University of Southern California
,
Ian Taylor
Cardiff University

Copyright © 2009 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 16 November 2009

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SC '09

Sponsor:

SIGARCH

SC '09: International Conference for High Performance Computing, Networking, Storage and Analysis

November 16, 2009

Oregon, Portland

Acceptance Rates

Overall Acceptance Rate 30 of 54 submissions, 56%

Upcoming Conference

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
287
Total Downloads

Downloads (Last 12 months)4
Downloads (Last 6 weeks)1

Reflects downloads up to 25 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Chard RPruyne JMcKee KBryan JRaumann BAnanthakrishnan RChard KFoster I(2023)Globus automation services: Research process automation across the space–time continuumFuture Generation Computer Systems10.1016/j.future.2023.01.010142(393-409)Online publication date: May-2023
https://doi.org/10.1016/j.future.2023.01.010
Llambias GRuggia R(2014)A middleware-based platform for the integration of bioinformatic services2014 XL Latin American Computing Conference (CLEI)10.1109/CLEI.2014.6965178(1-12)Online publication date: Sep-2014
https://doi.org/10.1109/CLEI.2014.6965178
Llambías GGonzález LRuggia R(2014)Towards an Integration Platform for Bioinformatics ServicesService-Oriented Computing – ICSOC 2013 Workshops10.1007/978-3-319-06859-6_39(445-456)Online publication date: 2014
https://doi.org/10.1007/978-3-319-06859-6_39
Morales ARobles TAlcarria RCedeño E(2013)On the Support of Scientific Workflows over Pub/Sub BrokersSensors10.3390/s13081095413:8(10954-10980)Online publication date: 20-Aug-2013
https://doi.org/10.3390/s130810954

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Table of Contents