Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content

Integration of the JINR Hybrid Computing Resources with the DIRAC Interware for Data Intensive Applications

  • Conference paper
  • First Online:
Data Analytics and Management in Data Intensive Domains (DAMDID/RCDL 2019)

Abstract

Scientific data and computing-intensive applications become more and more widely used. Different computing solutions have different protocols and architectures, they should be chosen carefully in the design of computing projects of large scientific communities. In a modern world of diverse computing resources such as grids, clouds, and supercomputers the choice can be difficult. Therefore, software developed for integration of various computing and storage resources into a single infrastructure, the so-called interware, makes this choice easier. The DIRAC interware is one of these products. It proved to be an effective solution for many experiments in High Energy Physics and some other areas of science providing means for seamless access to distributed computing and storage resources. The DIRAC interware was deployed in the Joint Institute for Nuclear Research to serve the needs of different scientific groups by providing a single interface to a variety of computing resources: grid cluster, computing cloud, supercomputer Govorun, disk and tape storage systems. The DIRAC based solution was proposed for the currently operational Baryonic Matter at Nuclotron experiment as well as for the future experiment Multi-Purpose Detector at the Nuclotron-based Ion Collider fAcility. Both experiments have requirements making the use of heterogeneous computing resources necessary. A set of tests was introduced in order to demonstrate the performance of the JINR distributed computing system.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Bozzi, C., Roiser, S.: The LHCb software and computing upgrade for Run 3: opportunities and challenges. J. Phys.: Conf. Ser. 898, 112002 (2017). https://doi.org/10.1088/1742-6596/898/10/112002

  2. SKA Telescope. https://www.skatelescope.org/software-and-computing/. Accessed 19 Aug 2019

  3. Kalinichenko, L., et al.: Data access challenges for data intensive research in Russia. Inform. App. 10(1), 2–22 (2016). https://doi.org/10.14357/19922264160101

    Article  MathSciNet  Google Scholar 

  4. Korenkov, V., Pelevanyuk, I., Tsaregorodtsev, A.: DIRAC system as a mediator between hybrid resources and data intensive domains. In: Selected Papers of the XXI International Conference on Data Analytics and Management in Data Intensive Domains (DAMDID/RCDL 2019), vol. 2523, pp. 73–84, Kazan, Russia (2019)

    Google Scholar 

  5. France Grilles. http://www.france-grilles.fr. Accessed 01 Feb 2020

  6. Britton, D., et al.: GridPP: the UK grid for particle physics. Philos. Trans. R. Soc. A 367, 2447–2457 (2009)

    Article  Google Scholar 

  7. European Open Science Cloud. https://www.eosc-portal.eu. Accessed 19 Aug 2019

  8. Tsaregorodtsev, A.: DIRAC distributed computing services. J. Phys: Conf. Ser. 513(3), 032096 (2014). https://doi.org/10.1088/1742-6596/513/3/032096

    Article  Google Scholar 

  9. Gergel, V., Korenkov, V., Pelevanyuk, I., Sapunov, M., Tsaregorodtsev, A., Zrelov, P.: Hybrid distributed computing service based on the dirac interware. Commun. Comput. Inf. Sci. 706, 105–118 (2017). https://doi.org/10.1007/978-3-319-57135-5_8

    Article  Google Scholar 

  10. Baginyan, A., et al.: The CMS Tier1 at JINR: five years of operations. In: Proceedings of VIII International Conference on Distributed Computing and Grid-technologies in Science and Education, vol. 2267, pp. 1–10 (2018)

    Google Scholar 

  11. Baranov, A., et al.: New features of the JINR cloud. In: Proceedings of VIII International Conference on Distributed Computing and Grid-technologies in Science and Education, vol. 2267, pp. 257–261 (2018)

    Google Scholar 

  12. Adam, Gh., et al.: IT-ecosystem of the HybriLIT heterogeneous platform for high-performance computing and training of IT-specialists. In: Proceedings of VIII International Conference on Distributed Computing and Grid-technologies in Science and Education, vol. 2267, pp. 638–644 (2018)

    Google Scholar 

  13. Peters, A.J., et al.: EOS as the present and future solution for data storage at CERN. J. Phys.: Conf. Ser. 664, 042042 (2015). https://doi.org/10.1088/1742-6596/664/4/042042

  14. dCache, the Overview. https://www.dcache.org/manuals/dcache-whitepaper-light.pdf. Accessed 19 Aug 2019

  15. Michelotto, M., et al.: A comparison of HEP code with SPEC benchmarks on multi-core worker nodes. J. Phys.: Conf. Ser. 219, 052009 (2010). https://doi.org/10.1088/1742-6596/219/5/052009

  16. Charpentier, P.: Benchmarking worker nodes using LHCb productions and comparing with HEPSpec06. J. Phys.: Conf. Ser. 898, 082011 (2017). https://doi.org/10.1088/1742-6596/898/8/082011 (IOP Conf. Series)

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Igor Pelevanyuk .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Korenkov, V., Pelevanyuk, I., Tsaregorodtsev, A. (2020). Integration of the JINR Hybrid Computing Resources with the DIRAC Interware for Data Intensive Applications. In: Elizarov, A., Novikov, B., Stupnikov, S. (eds) Data Analytics and Management in Data Intensive Domains. DAMDID/RCDL 2019. Communications in Computer and Information Science, vol 1223. Springer, Cham. https://doi.org/10.1007/978-3-030-51913-1_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-51913-1_3

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-51912-4

  • Online ISBN: 978-3-030-51913-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics