Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content
SpringerLink
Log in

P-GRADE: A Grid Programming Environment

  • Published:
Journal of Grid Computing Aims and scope Submit manuscript

Abstract

P-GRADE provides a high-level graphical environment to develop parallel applications transparently both for parallel systems and the Grid. P-GRADE supports the interactive execution of parallel programs as well as the creation of a Condor, Condor-G or Globus job to execute parallel programs in the Grid. In P-GRADE, the user can generate either PVM or MPI code according to the underlying Grid where the parallel application should be executed. PVM applications generated by P-GRADE can migrate between different Grid sites and as a result P-GRADE guarantees reliable, fault-tolerant parallel program execution in the Grid. The GRM/PROVE performance monitoring and visualisation toolset has been extended towards the Grid and connected to a general Grid monitor (Mercury) developed in the EU GridLab project. Using the Mercury/GRM/PROVE Grid application monitoring infrastructure any parallel application launched by P-GRADE can be remotely monitored and analysed at run time even if the application migrates among Grid sites. P-GRADE supports workflow definition and co-ordinated multi-job execution for the Grid. Such workflow management can provide parallel execution at both inter-job and intra-job level. Automatic checkpoint mechanism for parallel programs supports the migration of parallel jobs inside the workflow providing a fault-tolerant workflow execution mechanism. The paper describes all of these features of P-GRADE and their implementation concepts.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

References

  1. D. van Albada and P. Sloot, "Surfing the Grid-Dynamic Task Migration in the Polder Metacomputer Project", Invited talk, EuroPVM/MPI'2002, Linz, 2002.

  2. G. Allen et al., "GridLab-A Grid Application Toolkit and Testbed", submitted and accepted for Special Issue on Grid Computing "Future Generation Computing Systems".

  3. APART Working Group, http://www.fz-juelich.de/apart-2/.

  4. Z. Balaton, P. Kacsuk, and N. Podhorszki, "Application Monitoring in the Grid with GRM and PROVE", in Proc. of the Int. Conf. on Computational Science-ICCS 2001, San Francisco, 2001, pp. 253–262.

  5. Z. Balaton, P. Kacsuk, N. Podhorszki, and F. Vajda, "From Cluster Monitoring to Grid Monitoring Based on GRM", in Proc. of EuroPar'2001, Manchester, 2001, pp. 874–881.

  6. Z. Balaton and G. Gombás, "Resource and Job Monitoring in the Grid", in Proc. of EuroPar'2003, Klagenfurt, 2003, pp. 404–411.

  7. M. Bubak et al., "The G-PM Tool for Grid-oriented Performance Analysis", in Proc. of the 1 st European Across Grids Conference, Santiago de Compostela, 2003.

  8. J. Casas, D. Clark, P. Galbiati, R. Konuru, S. Otto, R. Prouty, and J. Walpole, "MIST: PVM with Transparent Migration and Checkpointing", 1995.

  9. J. Casas, D. Clark, R. Konuru, S. Otto, R. Prouty, and J. Walpole, "MPVM: A Migration Transparent Version of PVM", Technical Report CSE–95–002, 1, 1995.

  10. L. Dikken, "DynamicPVM: Task Migration in PVM", Technical Report, Shell Research, ICS/155.1, November 1993.

  11. L. Dikken, F. van der Linden, J.J.J. Vesseur, and P.M.A. Sloot, "DynamicPVM: Dynamic Load Balancing on Parallel Systems", in W. Gentzsch and U. Harms (eds.), High Performance Computing and Networking, Vol. II, Networking and Tools, Munich, Germany, April 1994, Lecture Notes in Computer Sciences, Vol. 797, Springer-Verlag, 1994, pp. 273–277.

  12. E. Deelman et al., "Mapping Abstract Complex Workflows onto Grid Environments", Journal of Grid Computing,Vol.1, No. 1, 2003, pp. 9–23.

    Google Scholar 

  13. G. Dózsa et al., "Constructing and Executing Grid Workflow Applications by Grid Portal Technology", IEEE Int. Conf. on Cluster Computing, 2003.

  14. D. Drótos, G. Dózsa, and P. Kacsuk, "GRAPNEL to C Translation in the GRADE Environment", in C. Cunha, P. Kacsuk, and S.C. Winter (eds.), Parallel Program Development for Cluster Computing, Methodology, Tools and Integrated Environments, Nova Science Publishers, Inc., 2001, pp. 249–263.

  15. esky: A User-Space Sheckpointing System, http://ozlabs.org/ people/dgibson/esky/esky.html/.

  16. S. Fisher et al., "R-GMA: A Relational Grid Information and Monitoring System", 2nd Krakow Grid Workshop, Krakow, Poland, 2002.

  17. I. Foster, C. Kesselman, and S. Tuecke, "The Anatomy of the Grid. Enabling Scalable Virtual Organizations", International Journal of Supercomputer Applications, Vol. 15, No. 3, 2001.

  18. J. Frey, T. Tannenbaum, I. Foster, M. Livny, and S. Tuecke, "Condor-G: A Computation Management Agent for Multi-Institutional Grids", Journal of Cluster Computing, Vol. 5, pp. 237–246, 2002.

    Google Scholar 

  19. A. Geist, A. Beguelin, J. Dongarra, W. Jiang, B. Manchek, and V. Sunderam, PVM: Parallel Virtual Machine-a User's Guide and Tutorial for Network Parallel Computing, MIT Press, Cambridge, MA, 1994.

    Google Scholar 

  20. Genius, http://www.infn.it/grid.

  21. M. Gerndt et al., "Performance Tools for the Grid: State of the Art and Future APART White Paper", 2004, http://www.lpds. sztaki.hu/~zsnemeth/apart.

  22. A. Gourgoulis, P. Kacsuk, G. Terstyanszky, and S. Winter, "Using Clusters for Traffic Simulation", in Proc. of MIPRO'2003, Opatija, 2003.

  23. GridLab project home page: http://www.gridlab.org.

  24. Grid Portal Development Kit (GPDK), http://www. doesciencegrid.org/Grid.

  25. V. Huber, "UNICORE: A Grid Computing Environment for Distributed and Parallel Computing", in Proc. of 6 th Int. Conf. on Parallel Computing Technologies (PaCT), 2001.

  26. P. Kacsuk, "Visual Parallel Programming on SGI Machines", Invited paper, in Proc. of the SGI Users' Conference, Krakow, Poland, 2000, pp. 37–56.

  27. P. Kacsuk, "Systematic Macrostep Debugging of Message Passing Parallel Programs", Journal of Future Generation Computer Systems, Vol. 16, No. 6, pp. 609–624, 2000.

    Google Scholar 

  28. P. Kacsuk, "Performance Visualisation in the GRADE Par-allel Programming Environment", in Proc. of the Fourth Int. Conf. on High Performance Computing in Asia-Pacific Region (HPC'Asia 2000), Peking, 2000, pp. 446–450.

  29. P. Kacsuk, "Hungarian Supercomputing Grid", in Proc. of ICCS'2002, Amsterdam, Springer-Verlag, 2002, Part II, pp. 671–678.

    Google Scholar 

  30. J. Kovács and P. Kacsuk, "Server Based Migration of Parallel Applications", in Proc. of DAPSYS'2002, Linz, 2002, pp. 30–37.

  31. J. Léon, A.L. Fisher, and P. Steenkiste, "Fail-safe PVM: A Portable Package for Distributed Programming with Transparent Recovery", CMU-CS–93–124, February 1993.

  32. M.J. Litzkov, M. Livny, and M.W. Mutka, "Condor-A Hunter of Idle Workstations", in Proceedings of the 8 th IEEE Inter-national Conference on Distributed Computing Systems, 1988, pp. 104–111.

  33. M. Litzkow, T. Tannenbaum, J. Basney, and M. Livny, "Checkpoint and Migration of UNIX Processes in the Con-dor Distributed Processing System", Technical Report #1346, Computer Sciences Department, University of Wisconsin, April 1997.

  34. R. Lovas et al., "Application of P-GRADE Development En-vironment in Meteorology", in Proc. of DAPSYS'2002,Linz, 2002, pp. 30–37.

  35. T. Ludwig and R. Wismüller, "OMIS 2.0-A Universal Interface for Monitoring Systems", in Proc. 4 th European PVM/MPI Users' Group Meeting, Crakow, Lecture Notes in Computer Science, Vol. 1332, Springer-Verlag, 1997, pp. 267–276.

    Google Scholar 

  36. Message Passing Interface Forum, MPI: A Message Passing Interface Standard, 1994.

  37. P-GRADE Graphical Parallel Program Development Environment, http://www.lpds.sztaki.hu/projects/p-grade.

  38. J.S. Plank, M. Beck, G. Kingsley, and K. Li, "Libckpt: Transparent Checkpointing under Unix", in Proc. of Usenix Technical Conference 1995, New Orleans, LA, January 199

  39. R. Ribler, J. Vetter, H. Simitci, and D. Reed, "Autopilot: Adaptive Control of Distributed Applications", in Proc. 7 th IEEE Symposium on High Performance Distributed Computing, Chicago, Illinois, July 1998.

  40. P. Stefán, "The Hungarian ClusterGrid Project", in Proc. of MIPRO'2003, Opatija, 2003.

  41. G. Stellner, "Consistent Checkpoints of PVM Applications", in Proc. 1 st Euro. PVM Users Group Meeting, 1994.

  42. G. Stellner and J. Pruyne, "Resource Management and Check-pointing for PVM", in Proc. 2 nd European PVM User Group Meeting, Lyon, 1995.

  43. I. Taylor et al., "Distributed P2P Computing within Triana: A Galaxy Visualisation Test Case", IPDPS'2003, April 2003.

  44. D. Thain, T. Tannenbaum, and M. Livny, "Condor and the Grid", in F. Berman, A.J.G. Hey, and G. Fox (eds.), Grid Computing: Making The Global Infrastructure a Reality, Wiley, 2003.

  45. B. Tierney et al., "The NetLogger Methodology for High Performance Distributed Systems Performance Analyser", in Proc. of the IEEE HPDC-7, Chicago, IL, July 28–31, 1998, LBNL-42611.

  46. B. Tierney, R. Aydt, D. Gunter, W. Smith, V. Taylor, R. Wolski, and M. Swany, "A Grid Monitoring Architecture", GGF Informational Document, GFD-I.7, GGF, 2001.

  47. www.bode.cs.tum.edu/Par/tools/Projects/CoCheck.html

  48. www.cs.wisc.eduzandy/ckpt

  49. www.cs.wisc.edu/condor/manual

  50. www.gridforum.org/Documents/GFD/GFD-I.7.pdf

  51. www.pallas.com/e/products/vampir/index.htm

  52. wwws.sun.com/software/gridware/sgeee53/

  53. www-unix.globus.org/toolkit/

  54. G. Yagawa and T. Hirayama, "Japan IT-Based Laboratory", presentation at GGF-5, 2002.

  55. http://aszt.inf.elte.hurid/jinigrid.html.en

  56. http://www.cpc.wmin.ac.uk/ogsitestbed/index.html

  57. https://fn2.hpcc.sztaki.hu:8443/gridsphere/gridsphere

Download references

Author information

Authors and Affiliations

  1. MTA SZTAKI Lab. of Parallel and Distributed Systems, H-1518 Budapest, P.O. Box 63, Hungary

    P. Kacsuk, G. Dózsa, J. Kovács, R. Lovas, N. Podhorszki, Z. Balaton & G. Gombás

Authors
  1. P. Kacsuk
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. G. Dózsa
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. J. Kovács
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. R. Lovas
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. N. Podhorszki
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Z. Balaton
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. G. Gombás
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kacsuk, P., Dózsa, G., Kovács, J. et al. P-GRADE: A Grid Programming Environment. Journal of Grid Computing 1, 171–197 (2003). https://doi.org/10.1023/B:GRID.0000024073.65405.63

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/B:GRID.0000024073.65405.63

Search

Navigation