-
Towards podio v1.0 -- A first stable release of the EDM toolkit
Authors:
Juan Miguel Carceller,
Frank Gaede,
Gerardo Ganis,
Benedikt Hegner,
Clement Helsens,
Thomas Madlener,
André Sailer,
Graeme A Stewart,
Valentin Volkl
Abstract:
A performant and easy-to-use event data model (EDM) is a key component of any HEP software stack. The podio EDM toolkit provides a user friendly way of generating such a performant implementation in C++ from a high level description in yaml format. Finalizing a few important developments, we are in the final stretches for release v1.0 of podio, a stable release with backward compatibility for data…
▽ More
A performant and easy-to-use event data model (EDM) is a key component of any HEP software stack. The podio EDM toolkit provides a user friendly way of generating such a performant implementation in C++ from a high level description in yaml format. Finalizing a few important developments, we are in the final stretches for release v1.0 of podio, a stable release with backward compatibility for datafiles written with podio from then on. We present an overview of the podio basics, and go into slighty more technical detail on the most important topics and developments. These include: schema evolution for generated EDMs, multithreading with podio generated EDMs, the implementation of them as well as the basics of I/O. Using EDM4hep, the common and shared EDM of the Key4hep project, we highlight a few of the smaller features in action as well as some lessons learned during the development of EDM4hep and podio. Finally, we show how podio has been integrated into the Gaudi based event processing framework that is used by Key4hep, before we conclude with a brief outlook on potential developments after v1.0.
△ Less
Submitted 13 December, 2023;
originally announced December 2023.
-
Of Frames and schema evolution -- The newest features of podio
Authors:
Placido Fernandez Declara,
Frank Gaede,
Gerardo Ganis,
Benedikt Hegner,
Clement Helsens,
Thomas Madlener,
Andre Sailer,
Graeme A Stewart,
Valentin Volkl
Abstract:
The podio event data model (EDM) toolkit provides an easy way to generate a performant implementation of an EDM from a high level description in yaml format. We present the most recent developments in podio, most importantly the inclusion of a schema evolution mechanism for generated EDMs as well as the "Frame", a thread safe, generalized event data container. For the former we discuss some of the…
▽ More
The podio event data model (EDM) toolkit provides an easy way to generate a performant implementation of an EDM from a high level description in yaml format. We present the most recent developments in podio, most importantly the inclusion of a schema evolution mechanism for generated EDMs as well as the "Frame", a thread safe, generalized event data container. For the former we discuss some of the technical aspects in relation with supporting different I/O backends and leveraging potentially existing schema evolution mechanisms provided by them. Regarding the Frame we introduce the basic concept and highlight some of the functionality as well as important aspects of its implementation. The usage of podio for generating different EDMs for future collider projects (most importantly EDM4hep, the common EDM for the Key4hep project) has inspired new features. We present some of those smaller new features and end with a brief overview on current developments towards a first stable version as well as an outlook on future developments beyond that.
△ Less
Submitted 13 December, 2023;
originally announced December 2023.
-
Key4hep: Progress Report on Integrations
Authors:
Erica Brondolin,
Juan Miguel Carceller,
Wouter Deconinck,
Wenxing Fang,
Brieuc Francois,
Frank-Dieter Gaede,
Gerardo Ganis,
Benedikt Hegner,
Clement Helsens,
Xingtao Huang,
Sylvester Joosten,
Sang Hyun Ko,
Tao Lin,
Teng Li,
Weidong Li,
Thomas Madlener,
Leonhard Reichenbach,
André Sailer,
Swathi Sasikumar,
Juraj Smiesko,
Graeme A Stewart,
Alvaro Tolosa-Delgado,
Valentin Volkl,
Xiaomei Zhang,
Jiaheng Zou
Abstract:
Detector studies for future experiments rely on advanced software tools to estimate performance and optimize their design and technology choices. The Key4hep project provides a flexible turnkey solution for the full experiment life-cycle based on established community tools such as ROOT, Geant4, DD4hep, Gaudi, podio and spack. Members of the CEPC, CLIC, EIC, FCC, and ILC communities have joined to…
▽ More
Detector studies for future experiments rely on advanced software tools to estimate performance and optimize their design and technology choices. The Key4hep project provides a flexible turnkey solution for the full experiment life-cycle based on established community tools such as ROOT, Geant4, DD4hep, Gaudi, podio and spack. Members of the CEPC, CLIC, EIC, FCC, and ILC communities have joined to develop this framework and have merged, or are in the progress of merging, their respective software environments into the Key4hep stack. These proceedings will give an overview over the recent progress in the Key4hep project: covering the developments towards adaptation of state-of-the-art tools for simulation (DD4hep, Gaussino), track and calorimeter reconstruction (ACTS, CLUE), particle flow (PandoraPFA), analysis via RDataFrame, and visualization with Phoenix, as well as tools for testing and validation.
△ Less
Submitted 13 December, 2023;
originally announced December 2023.
-
The Key4hep software stack: Beyond Future Higgs factories
Authors:
Andre Sailer,
Benedikt Hegner,
Clement Helsens,
Erica Brondolin,
Frank-Dieter Gaede,
Gerardo Ganis,
Graeme A Stewart,
Jiaheng Zou,
Juraj Smiesko,
Placido Fernandez Declara,
Sang Hyun Ko,
Sylvester Joosten,
Tao Lin,
Teng Li,
Thomas Madlener,
Valentin Volkl,
Weidong Li,
Wenxing Fang,
Wouter Deconinck,
Xingtao Huang,
Xiaomei Zhang
Abstract:
The Key4hep project aims to provide a turnkey software solution for the full experiment lifecycle, based on established community tools. Several future collider communities (CEPC, CLIC, EIC, FCC, and ILC) have joined to develop and adapt their workflows to use the common data model EDM4hep and common framework. Besides sharing of existing experiment workflows, one focus of the Key4hep project is t…
▽ More
The Key4hep project aims to provide a turnkey software solution for the full experiment lifecycle, based on established community tools. Several future collider communities (CEPC, CLIC, EIC, FCC, and ILC) have joined to develop and adapt their workflows to use the common data model EDM4hep and common framework. Besides sharing of existing experiment workflows, one focus of the Key4hep project is the development and integration of new experiment independent software libraries. Ongoing collaborations with projects such as ACTS, CLUE, PandoraPFA and the OpenDataDector show the potential of Key4hep as an experiment-independent testbed and development platform. In this talk, we present the challenges of an experiment-independent framework along with the lessons learned from discussions of interested communities (such as LUXE) and recent adopters of Key4hep in order to discuss how Key4hep could be of interest to the wider HEP community while staying true to its goal of supporting future collider designs studies.
△ Less
Submitted 13 December, 2023;
originally announced December 2023.
-
Key4hep, a framework for future HEP experiments and its use in FCC
Authors:
Gerardo Ganis,
Clément Helsens,
Valentin Völkl
Abstract:
The road map to the FCC Feasibility Study Report, for submission to the next Update of the European Strategy for Particle Physics, will require detailed simulation and advanced reconstruction algorithms to explore and maximise the physics reach of proposed detector solutions. The optimisation process will require maximal flexibility in changing detector geometries, materials and sensitive areas, a…
▽ More
The road map to the FCC Feasibility Study Report, for submission to the next Update of the European Strategy for Particle Physics, will require detailed simulation and advanced reconstruction algorithms to explore and maximise the physics reach of proposed detector solutions. The optimisation process will require maximal flexibility in changing detector geometries, materials and sensitive areas, and efficient tools to quantify the overall performance. To synergise such developments the CEPC, CLIC, FCC, ILC and SCT communities have engaged in the commissioning of a `Turnkey Software Stack' (Key4hep), which would provide all the necessary ingredients, from simulation to analysis, for future experiments. This approach is based on the positive experience of the linear collider projects ILC and CLIC, which have developed and used a common software stack (iLCSoft) over the last decade. Key4hep aims to cover most, if not all, future linear and circular machines colliding leptons (electrons, muons), and hadrons. The common software ecosystem will facilitate writing specific components for experiments ensuring coherency and maximising the re-use of established solutions. Project-specific software frameworks will require adaptation to fully profit from the common software base. In this essay we present the status and plans for re-framing the FCC software framework, FCCSW, around Key4hep and discuss the challenges associated with the transition.
△ Less
Submitted 18 November, 2021;
originally announced November 2021.
