-
The Online Observation Quality System Implementation for the ASTRI Mini-Array Project
Authors:
L. Castaldini,
N. Parmiggiani,
A. Bulgarelli,
L. Baroncelli,
V. Fioretti,
A. Di Piano,
I. Abu,
M. Capalbi,
O. Catalano,
V. Conforti,
M. Fiori,
F. Gianotti,
F. Lucarelli,
M. C. Maccarone,
T. Mineo,
S. Lombardi,
V. Pastore,
F. Russo,
P. Sangiorgi,
S. Scuderi,
G. Tosti,
M. Trifoglio,
L. Zampieri
Abstract:
The ASTRI Mini-Array project, led by the Italian National Institute for Astrophysics, aims to construct and operate nine Imaging Atmospheric Cherenkov Telescopes for high-energy gamma-ray source study and stellar intensity interferometry. Located at the Teide Astronomical Observatory in Tenerife, the project's software is essential for remote operation, emphasizing the need for prompt feedback on…
▽ More
The ASTRI Mini-Array project, led by the Italian National Institute for Astrophysics, aims to construct and operate nine Imaging Atmospheric Cherenkov Telescopes for high-energy gamma-ray source study and stellar intensity interferometry. Located at the Teide Astronomical Observatory in Tenerife, the project's software is essential for remote operation, emphasizing the need for prompt feedback on observations. This contribution introduces the Online Observation Quality System (OOQS) as part of the Supervisory Control And Data Acquisition (SCADA) software. OOQS performs real-time data quality checks on data from Cherenkov cameras and Intensity Interferometry instruments. It provides feedback to SCADA and operators, highlighting abnormal conditions and ensuring quick corrective actions for optimal observations. Results are archived for operator visualization and further analysis. The OOQS data quality pipeline prototype utilizes a distributed application with three main components to handle the maximum array data rate of 1.15 Gb/s. The first is a Kafka consumer that manages the data stream from the Array Data Acquisition System through Apache Kafka, handling the data serialization and deserialization involved in the transmission. The data stream is divided into batches of data written in files. The second component monitors new files and conducts analyses using the Slurm workload scheduler, leveraging its parallel processing capabilities and scalability. Finally, the process results are collected by the last component and stored in the Quality Archive.
△ Less
Submitted 2 April, 2024;
originally announced April 2024.
-
The Online Observation Quality System Software Architecture for the ASTRI Mini-Array Project
Authors:
N. Parmiggiani,
A. Bulgarelli,
L. Baroncelli,
A. Addis,
V. Fioretti,
A. Di Piano,
M. Capalbi,
O. Catalano,
V. Conforti,
M. Fiori,
F. Gianotti,
S. Iovenitti,
F. Lucarelli,
M. C. Maccarone,
T. Mineo,
S. Lombardi,
V. Pastore,
F. Russo,
P. Sangiorgi,
S. Scuderi,
G. Tosti,
M. Trifoglio,
L. Zampieri,
the ASTRI Project
Abstract:
The ASTRI Mini-Array is an international collaboration led by the Italian National Institute for Astrophysics. This project aims to construct and operate an array of nine Imaging Atmospheric Cherenkov Telescopes to study gamma-ray sources at very high energy (TeV) and perform stellar intensity interferometry observations. We describe the software architecture and the technologies used to implement…
▽ More
The ASTRI Mini-Array is an international collaboration led by the Italian National Institute for Astrophysics. This project aims to construct and operate an array of nine Imaging Atmospheric Cherenkov Telescopes to study gamma-ray sources at very high energy (TeV) and perform stellar intensity interferometry observations. We describe the software architecture and the technologies used to implement the Online Observation Quality System (OOQS) for the ASTRI Mini-Array project. The OOQS aims to execute data quality checks on the data acquired in real-time by the Cherenkov cameras and intensity interferometry instruments, and provides feedback to both the Central Control System and the Operator about abnormal conditions detected. The OOQS can notify other sub-systems, triggering their reaction to promptly correct anomalies. The results from the data quality analyses (e.g. camera plots, histograms, tables, and more) are stored in the Quality Archive for further investigation and they are summarised in reports available to the Operator. Once the OOQS results are stored, the operator can visualize them using the Human Machine Interface. The OOQS is designed to manage the high data rate generated by the instruments (up to 4.5 GB/s) and received from the Array Data Acquisition System through the Kafka service. The data are serialized and deserialized during the transmission using the Avro framework. The Slurm workload scheduler executes the analyses exploiting key features such as parallel analyses and scalability.
△ Less
Submitted 27 February, 2023;
originally announced February 2023.
-
The Monitoring Logging and Alarm System of the ASTRI Mini-Array gamma-ray air-Cherenkov experiment at the Observatorio del Teide
Authors:
Federico Incardona,
Alessandro Costa,
Kevin Munari,
Salvatore Gambadoro,
Stefano Germani,
Pietro Bruno,
Andrea Bulgarelli,
Vito Conforti,
Fulvio Gianotti,
Alessandro Grillo,
Valerio Pastore,
Federico Russo,
Joseph Schwarz,
Gino Tosti,
Salvatore Cavalieri,
for the ASTRI Project
Abstract:
The ASTRI Mini-Array is a project for the Cherenkov astronomy in the TeV energy range. ASTRI Mini-Array consists of nine Imaging Atmospheric Cherenkov telescopes located at the Teide Observatory (Canarias Islands). Large volumes of monitoring and logging data result from the operation of a large-scale astrophysical observatory. In the last few years, several "Big Data" technologies have been devel…
▽ More
The ASTRI Mini-Array is a project for the Cherenkov astronomy in the TeV energy range. ASTRI Mini-Array consists of nine Imaging Atmospheric Cherenkov telescopes located at the Teide Observatory (Canarias Islands). Large volumes of monitoring and logging data result from the operation of a large-scale astrophysical observatory. In the last few years, several "Big Data" technologies have been developed to deal with such volumes of data, especially in the Internet of Things (IoT) framework. We present the Monitoring, Logging, and Alarm (MLA) system for the ASTRI Mini-Array aimed at supporting the analysis of scientific data and improving the operational activities of the telescope facility. The MLA system was designed and built considering the latest software tools and concepts coming from Big Data and IoT to respond to the challenges posed by the operation of the array. A particular relevance has been given to satisfying the reliability, availability, and maintainability requirements towards all the array sub-systems and auxiliary devices. The system architecture has been designed to scale up with the number of devices to be monitored and with the number of software components to be considered in the distributed logging system.
△ Less
Submitted 13 July, 2022;
originally announced July 2022.
