-
Polynomial data compression for large-scale physics experiments
Authors:
Pierre Aubert,
Thomas Vuillaume,
Gilles Maurin,
Jean Jacquemier,
Giovanni Lamanna,
Nahid Emad
Abstract:
The new generation research experiments will introduce huge data surge to a continuously increasing data production by current experiments. This data surge necessitates efficient compression techniques. These compression techniques must guarantee an optimum tradeoff between compression rate and the corresponding compression /decompression speed ratio without affecting the data integrity.
This wo…
▽ More
The new generation research experiments will introduce huge data surge to a continuously increasing data production by current experiments. This data surge necessitates efficient compression techniques. These compression techniques must guarantee an optimum tradeoff between compression rate and the corresponding compression /decompression speed ratio without affecting the data integrity.
This work presents a lossless compression algorithm to compress physics data generated by Astronomy, Astrophysics and Particle Physics experiments.
The developed algorithms have been tuned and tested on a real use case~: the next generation ground-based high-energy gamma ray observatory, Cherenkov Telescope Array (CTA), requiring important compression performance. Stand-alone, the proposed compression method is very fast and reasonably efficient. Alternatively, applied as pre-compression algorithm, it can accelerate common methods like LZMA, keeping close performance.
△ Less
Submitted 3 May, 2018;
originally announced May 2018.
-
pschitt! - A Python package for the modelling of atmoSpheric Showers and CHerenkov Imaging Terrestrial Telescopes
Authors:
Thomas Vuillaume,
Florian Gaté,
Gilles Maurin,
Jean Jacquemier,
Giovanni Lamanna
Abstract:
The simulation of atmospheric showers through Monte-Carlo processes as well as their projection into Imaging Atmospheric Cherenkov Telescopes (IACT) is long and very computing intensive. As these simulations are the most advanced ones from a physics point of view, they are not suited for simple tests.
Here we present a Python package developed in order to model atmospheric showers using differen…
▽ More
The simulation of atmospheric showers through Monte-Carlo processes as well as their projection into Imaging Atmospheric Cherenkov Telescopes (IACT) is long and very computing intensive. As these simulations are the most advanced ones from a physics point of view, they are not suited for simple tests.
Here we present a Python package developed in order to model atmospheric showers using different profiles and to image them with an array of IACT. This allows for first order studies of the influence of the primary photon energy and angular direction on the stereoscopic images. Its simplicity also makes it convenient for public dissemination and outreach as well as for teaching purposes.
This package has been developed to make the most out of the simplicity of Python but has also been optimised for fast calculations. It is developed in the framework of the ASTERICS H2020 project and as such is available as an open-source software.
△ Less
Submitted 14 September, 2017;
originally announced September 2017.
-
Cherenkov Telescope Array Contributions to the 35th International Cosmic Ray Conference (ICRC2017)
Authors:
F. Acero,
B. S. Acharya,
V. Acín Portella,
C. Adams,
I. Agudo,
F. Aharonian,
I. Al Samarai,
A. Alberdi,
M. Alcubierre,
R. Alfaro,
J. Alfaro,
C. Alispach,
R. Aloisio,
R. Alves Batista,
J. -P. Amans,
E. Amato,
L. Ambrogi,
G. Ambrosi,
M. Ambrosio,
J. Anderson,
M. Anduze,
E. O. Angüner,
E. Antolini,
L. A. Antonelli,
V. Antonuccio
, et al. (1117 additional authors not shown)
Abstract:
List of contributions from the Cherenkov Telescope Array Consortium presented at the 35th International Cosmic Ray Conference, July 12-20 2017, Busan, Korea.
List of contributions from the Cherenkov Telescope Array Consortium presented at the 35th International Cosmic Ray Conference, July 12-20 2017, Busan, Korea.
△ Less
Submitted 24 October, 2017; v1 submitted 11 September, 2017;
originally announced September 2017.
-
Prospects for CTA observations of the young SNR RX J1713.7-3946
Authors:
The CTA Consortium,
:,
F. Acero,
R. Aloisio,
J. Amans,
E. Amato,
L. A. Antonelli,
C. Aramo,
T. Armstrong,
F. Arqueros,
K. Asano,
M. Ashley,
M. Backes,
C. Balazs,
A. Balzer,
A. Bamba,
M. Barkov,
J. A. Barrio,
W. Benbow,
K. Bernlöhr,
V. Beshley,
C. Bigongiari,
A. Biland,
A. Bilinsky,
E. Bissaldi
, et al. (359 additional authors not shown)
Abstract:
We perform simulations for future Cherenkov Telescope Array (CTA) observations of RX~J1713.7$-$3946, a young supernova remnant (SNR) and one of the brightest sources ever discovered in very-high-energy (VHE) gamma rays. Special attention is paid to explore possible spatial (anti-)correlations of gamma rays with emission at other wavelengths, in particular X-rays and CO/H{\sc i} emission. We presen…
▽ More
We perform simulations for future Cherenkov Telescope Array (CTA) observations of RX~J1713.7$-$3946, a young supernova remnant (SNR) and one of the brightest sources ever discovered in very-high-energy (VHE) gamma rays. Special attention is paid to explore possible spatial (anti-)correlations of gamma rays with emission at other wavelengths, in particular X-rays and CO/H{\sc i} emission. We present a series of simulated images of RX J1713.7$-$3946 for CTA based on a set of observationally motivated models for the gamma-ray emission. In these models, VHE gamma rays produced by high-energy electrons are assumed to trace the non-thermal X-ray emission observed by {\it XMM-Newton}, whereas those originating from relativistic protons delineate the local gas distributions. The local atomic and molecular gas distributions are deduced by the NANTEN team from CO and H{\sc i} observations. Our primary goal is to show how one can distinguish the emission mechanism(s) of the gamma rays (i.e., hadronic vs leptonic, or a mixture of the two) through information provided by their spatial distribution, spectra, and time variation. This work is the first attempt to quantitatively evaluate the capabilities of CTA to achieve various proposed scientific goals by observing this important cosmic particle accelerator.
△ Less
Submitted 13 April, 2017;
originally announced April 2017.
-
Contributions of the Cherenkov Telescope Array (CTA) to the 6th International Symposium on High-Energy Gamma-Ray Astronomy (Gamma 2016)
Authors:
The CTA Consortium,
:,
A. Abchiche,
U. Abeysekara,
Ó. Abril,
F. Acero,
B. S. Acharya,
C. Adams,
G. Agnetta,
F. Aharonian,
A. Akhperjanian,
A. Albert,
M. Alcubierre,
J. Alfaro,
R. Alfaro,
A. J. Allafort,
R. Aloisio,
J. -P. Amans,
E. Amato,
L. Ambrogi,
G. Ambrosi,
M. Ambrosio,
J. Anderson,
M. Anduze,
E. O. Angüner
, et al. (1387 additional authors not shown)
Abstract:
List of contributions from the Cherenkov Telescope Array (CTA) Consortium presented at the 6th International Symposium on High-Energy Gamma-Ray Astronomy (Gamma 2016), July 11-15, 2016, in Heidelberg, Germany.
List of contributions from the Cherenkov Telescope Array (CTA) Consortium presented at the 6th International Symposium on High-Energy Gamma-Ray Astronomy (Gamma 2016), July 11-15, 2016, in Heidelberg, Germany.
△ Less
Submitted 17 October, 2016;
originally announced October 2016.
-
The On-Site Analysis of the Cherenkov Telescope Array
Authors:
Andrea Bulgarelli,
Valentina Fioretti,
Andrea Zoli,
Alessio Aboudan,
Juan José Rodríguez-Vázquez,
Giovanni De Cesare,
Adriano De Rosa,
Gernot Maier,
Etienne Lyard,
Denis Bastieri,
Saverio Lombardi,
Gino Tosti,
Sonia Bergamaschi,
Domenico Beneventano,
Giovanni Lamanna,
Jean Jacquemier,
Karl Kosack,
Lucio Angelo Antonelli,
Catherine Boisson,
Jerzy Borkowski,
Sara Buson,
Alessandro Carosi,
Vito Conforti,
Pep Colomé,
Raquel de los Reyes
, et al. (32 additional authors not shown)
Abstract:
The Cherenkov Telescope Array (CTA) observatory will be one of the largest ground-based very high-energy gamma-ray observatories. The On-Site Analysis will be the first CTA scientific analysis of data acquired from the array of telescopes, in both northern and southern sites. The On-Site Analysis will have two pipelines: the Level-A pipeline (also known as Real-Time Analysis, RTA) and the level-B…
▽ More
The Cherenkov Telescope Array (CTA) observatory will be one of the largest ground-based very high-energy gamma-ray observatories. The On-Site Analysis will be the first CTA scientific analysis of data acquired from the array of telescopes, in both northern and southern sites. The On-Site Analysis will have two pipelines: the Level-A pipeline (also known as Real-Time Analysis, RTA) and the level-B one. The RTA performs data quality monitoring and must be able to issue automated alerts on variable and transient astrophysical sources within 30 seconds from the last acquired Cherenkov event that contributes to the alert, with a sensitivity not worse than the one achieved by the final pipeline by more than a factor of 3. The Level-B Analysis has a better sensitivity (not be worse than the final one by a factor of 2) and the results should be available within 10 hours from the acquisition of the data: for this reason this analysis could be performed at the end of an observation or next morning. The latency (in particular for the RTA) and the sensitivity requirements are challenging because of the large data rate, a few GByte/s. The remote connection to the CTA candidate site with a rather limited network bandwidth makes the issue of the exported data size extremely critical and prevents any kind of processing in real-time of the data outside the site of the telescopes. For these reasons the analysis will be performed on-site with infrastructures co-located with the telescopes, with limited electrical power availability and with a reduced possibility of human intervention. This means, for example, that the on-site hardware infrastructure should have low-power consumption. A substantial effort towards the optimization of high-throughput computing service is envisioned to provide hardware and software solutions with high-throughput, low-power consumption at a low-cost.
△ Less
Submitted 7 September, 2015;
originally announced September 2015.
-
Cherenkov Telescope Array Data Management
Authors:
G. Lamanna,
L. A. Antonelli,
J. L. Contreras,
J. Knödlseder,
K. Kosack,
N. Neyroud,
A. Aboudan,
L. Arrabito,
C. Barbier,
D. Bastieri,
C. Boisson,
S. Brau-Nogué,
J. Bregeon,
A. Bulgarelli,
A. Carosi,
A. Costa,
G. De Cesare,
R. de los Reyes,
V. Fioretti,
S. Gallozzi,
J. Jacquemier,
B. Khelifi,
J. Kocot,
S. Lombardi,
F. Lucarelli
, et al. (15 additional authors not shown)
Abstract:
Very High Energy gamma-ray astronomy with the Cherenkov Telescope Array (CTA) is evolving towards the model of a public observatory. Handling, processing and archiving the large amount of data generated by the CTA instruments and delivering scientific products are some of the challenges in designing the CTA Data Management. The participation of scientists from within CTA Consortium and from the gr…
▽ More
Very High Energy gamma-ray astronomy with the Cherenkov Telescope Array (CTA) is evolving towards the model of a public observatory. Handling, processing and archiving the large amount of data generated by the CTA instruments and delivering scientific products are some of the challenges in designing the CTA Data Management. The participation of scientists from within CTA Consortium and from the greater worldwide scientific community necessitates a sophisticated scientific analysis system capable of providing unified and efficient user access to data, software and computing resources. Data Management is designed to respond to three main issues: (i) the treatment and flow of data from remote telescopes; (ii) "big-data" archiving and processing; (iii) and open data access. In this communication the overall technical design of the CTA Data Management, current major developments and prototypes are presented.
△ Less
Submitted 3 September, 2015;
originally announced September 2015.
-
Modern middleware for the data acquisition of the Cherenkov Telescope Array
Authors:
Etienne Lyard,
Roland Walter,
Karl Kosack,
Jean Jacquemier,
Igor Oya,
Peter Wegner,
Matthias Fuessling,
Xin Wu
Abstract:
The data acquisition system (DAQ) of the future Cherenkov Telescope Array (CTA) must be ef- ficient, modular and robust to be able to cope with the very large data rate of up to 550 Gbps coming from many telescopes with different characteristics. The use of modern middleware, namely ZeroMQ and Protocol Buffers, can help to achieve these goals while keeping the development effort to a reasonable le…
▽ More
The data acquisition system (DAQ) of the future Cherenkov Telescope Array (CTA) must be ef- ficient, modular and robust to be able to cope with the very large data rate of up to 550 Gbps coming from many telescopes with different characteristics. The use of modern middleware, namely ZeroMQ and Protocol Buffers, can help to achieve these goals while keeping the development effort to a reasonable level. Protocol Buffers are used as an on-line data for- mat, while ZeroMQ is employed to communicate between processes. The DAQ will be controlled and monitored by the Alma Common Software (ACS). Protocol Buffers from Google are a way to define high-level data structures through an in- terface description language (IDL) and a meta-compiler. ZeroMQ is a middleware that augments the capabilities of TCP/IP sockets. It does not implement very high-level features like those found in CORBA for example, but makes use of sockets easier, more robust and almost as effective as raw TCP. The use of these two middlewares enabled us to rapidly develop a robust prototype of the DAQ including data persistence to compressed FITS files.
△ Less
Submitted 26 August, 2015;
originally announced August 2015.
-
CTA Contributions to the 34th International Cosmic Ray Conference (ICRC2015)
Authors:
The CTA Consortium,
:,
A. Abchiche,
U. Abeysekara,
Ó. Abril,
F. Acero,
B. S. Acharya,
M. Actis,
G. Agnetta,
J. A. Aguilar,
F. Aharonian,
A. Akhperjanian,
A. Albert,
M. Alcubierre,
R. Alfaro,
E. Aliu,
A. J. Allafort,
D. Allan,
I. Allekotte,
R. Aloisio,
J. -P. Amans,
E. Amato,
L. Ambrogi,
G. Ambrosi,
M. Ambrosio
, et al. (1290 additional authors not shown)
Abstract:
List of contributions from the CTA Consortium presented at the 34th International Cosmic Ray Conference, 30 July - 6 August 2015, The Hague, The Netherlands.
List of contributions from the CTA Consortium presented at the 34th International Cosmic Ray Conference, 30 July - 6 August 2015, The Hague, The Netherlands.
△ Less
Submitted 11 September, 2015; v1 submitted 24 August, 2015;
originally announced August 2015.
-
CTA contributions to the 33rd International Cosmic Ray Conference (ICRC2013)
Authors:
The CTA Consortium,
:,
O. Abril,
B. S. Acharya,
M. Actis,
G. Agnetta,
J. A. Aguilar,
F. Aharonian,
M. Ajello,
A. Akhperjanian,
M. Alcubierre,
J. Aleksic,
R. Alfaro,
E. Aliu,
A. J. Allafort,
D. Allan,
I. Allekotte,
R. Aloisio,
E. Amato,
G. Ambrosi,
M. Ambrosio,
J. Anderson,
E. O. Angüner,
L. A. Antonelli,
V. Antonuccio
, et al. (1082 additional authors not shown)
Abstract:
Compilation of CTA contributions to the proceedings of the 33rd International Cosmic Ray Conference (ICRC2013), which took place in 2-9 July, 2013, in Rio de Janeiro, Brazil
Compilation of CTA contributions to the proceedings of the 33rd International Cosmic Ray Conference (ICRC2013), which took place in 2-9 July, 2013, in Rio de Janeiro, Brazil
△ Less
Submitted 29 July, 2013; v1 submitted 8 July, 2013;
originally announced July 2013.
