-
PREGO: online mistake detection in PRocedural EGOcentric videos
Authors:
Alessandro Flaborea,
Guido Maria D'Amely di Melendugno,
Leonardo Plini,
Luca Scofano,
Edoardo De Matteis,
Antonino Furnari,
Giovanni Maria Farinella,
Fabio Galasso
Abstract:
Promptly identifying procedural errors from egocentric videos in an online setting is highly challenging and valuable for detecting mistakes as soon as they happen. This capability has a wide range of applications across various fields, such as manufacturing and healthcare. The nature of procedural mistakes is open-set since novel types of failures might occur, which calls for one-class classifier…
▽ More
Promptly identifying procedural errors from egocentric videos in an online setting is highly challenging and valuable for detecting mistakes as soon as they happen. This capability has a wide range of applications across various fields, such as manufacturing and healthcare. The nature of procedural mistakes is open-set since novel types of failures might occur, which calls for one-class classifiers trained on correctly executed procedures. However, no technique can currently detect open-set procedural mistakes online. We propose PREGO, the first online one-class classification model for mistake detection in PRocedural EGOcentric videos. PREGO is based on an online action recognition component to model the current action, and a symbolic reasoning module to predict the next actions. Mistake detection is performed by comparing the recognized current action with the expected future one. We evaluate PREGO on two procedural egocentric video datasets, Assembly101 and Epic-tent, which we adapt for online benchmarking of procedural mistake detection to establish suitable benchmarks, thus defining the Assembly101-O and Epic-tent-O datasets, respectively.
△ Less
Submitted 17 May, 2024; v1 submitted 2 April, 2024;
originally announced April 2024.
-
Staged Contact-Aware Global Human Motion Forecasting
Authors:
Luca Scofano,
Alessio Sampieri,
Elisabeth Schiele,
Edoardo De Matteis,
Laura Leal-Taixé,
Fabio Galasso
Abstract:
Scene-aware global human motion forecasting is critical for manifold applications, including virtual reality, robotics, and sports. The task combines human trajectory and pose forecasting within the provided scene context, which represents a significant challenge.
So far, only Mao et al. NeurIPS'22 have addressed scene-aware global motion, cascading the prediction of future scene contact points…
▽ More
Scene-aware global human motion forecasting is critical for manifold applications, including virtual reality, robotics, and sports. The task combines human trajectory and pose forecasting within the provided scene context, which represents a significant challenge.
So far, only Mao et al. NeurIPS'22 have addressed scene-aware global motion, cascading the prediction of future scene contact points and the global motion estimation. They perform the latter as the end-to-end forecasting of future trajectories and poses. However, end-to-end contrasts with the coarse-to-fine nature of the task and it results in lower performance, as we demonstrate here empirically.
We propose a STAGed contact-aware global human motion forecasting STAG, a novel three-stage pipeline for predicting global human motion in a 3D environment. We first consider the scene and the respective human interaction as contact points. Secondly, we model the human trajectory forecasting within the scene, predicting the coarse motion of the human body as a whole. The third and last stage matches a plausible fine human joint motion to complement the trajectory considering the estimated contacts.
Compared to the state-of-the-art (SoA), STAG achieves a 1.8% and 16.2% overall improvement in pose and trajectory prediction, respectively, on the scene-aware GTA-IM dataset. A comprehensive ablation study confirms the advantages of staged modeling over end-to-end approaches. Furthermore, we establish the significance of a newly proposed temporal counter called the "time-to-go", which tells how long it is before reaching scene contact and endpoints. Notably, STAG showcases its ability to generalize to datasets lacking a scene and achieves a new state-of-the-art performance on CMU-Mocap, without leveraging any social cues. Our code is released at: https://github.com/L-Scofano/STAG
△ Less
Submitted 16 September, 2023;
originally announced September 2023.
-
Best Practices for 2-Body Pose Forecasting
Authors:
Muhammad Rameez Ur Rahman,
Luca Scofano,
Edoardo De Matteis,
Alessandro Flaborea,
Alessio Sampieri,
Fabio Galasso
Abstract:
The task of collaborative human pose forecasting stands for predicting the future poses of multiple interacting people, given those in previous frames. Predicting two people in interaction, instead of each separately, promises better performance, due to their body-body motion correlations. But the task has remained so far primarily unexplored.
In this paper, we review the progress in human pose…
▽ More
The task of collaborative human pose forecasting stands for predicting the future poses of multiple interacting people, given those in previous frames. Predicting two people in interaction, instead of each separately, promises better performance, due to their body-body motion correlations. But the task has remained so far primarily unexplored.
In this paper, we review the progress in human pose forecasting and provide an in-depth assessment of the single-person practices that perform best for 2-body collaborative motion forecasting. Our study confirms the positive impact of frequency input representations, space-time separable and fully-learnable interaction adjacencies for the encoding GCN and FC decoding. Other single-person practices do not transfer to 2-body, so the proposed best ones do not include hierarchical body modeling or attention-based interaction encoding.
We further contribute a novel initialization procedure for the 2-body spatial interaction parameters of the encoder, which benefits performance and stability. Altogether, our proposed 2-body pose forecasting best practices yield a performance improvement of 21.9% over the state-of-the-art on the most recent ExPI dataset, whereby the novel initialization accounts for 3.5%. See our project page at https://www.pinlab.org/bestpractices2body
△ Less
Submitted 12 April, 2023;
originally announced April 2023.
-
Towards a Muon Collider
Authors:
Carlotta Accettura,
Dean Adams,
Rohit Agarwal,
Claudia Ahdida,
Chiara Aimè,
Nicola Amapane,
David Amorim,
Paolo Andreetto,
Fabio Anulli,
Robert Appleby,
Artur Apresyan,
Aram Apyan,
Sergey Arsenyev,
Pouya Asadi,
Mohammed Attia Mahmoud,
Aleksandr Azatov,
John Back,
Lorenzo Balconi,
Laura Bandiera,
Roger Barlow,
Nazar Bartosik,
Emanuela Barzi,
Fabian Batsch,
Matteo Bauce,
J. Scott Berg
, et al. (272 additional authors not shown)
Abstract:
A muon collider would enable the big jump ahead in energy reach that is needed for a fruitful exploration of fundamental interactions. The challenges of producing muon collisions at high luminosity and 10 TeV centre of mass energy are being investigated by the recently-formed International Muon Collider Collaboration. This Review summarises the status and the recent advances on muon colliders desi…
▽ More
A muon collider would enable the big jump ahead in energy reach that is needed for a fruitful exploration of fundamental interactions. The challenges of producing muon collisions at high luminosity and 10 TeV centre of mass energy are being investigated by the recently-formed International Muon Collider Collaboration. This Review summarises the status and the recent advances on muon colliders design, physics and detector studies. The aim is to provide a global perspective of the field and to outline directions for future work.
△ Less
Submitted 27 November, 2023; v1 submitted 15 March, 2023;
originally announced March 2023.
-
A Work Proposal for a Collaborative Study of Magnet Technology for a Future Muon Collider
Authors:
L. Bottura,
D. Aguglia,
B. Auchmann,
T. Arndt,
J. Beard,
A. Bersani,
F. Boattini,
M. Breschi,
B. Caiffi,
X. Chaud,
M. Dam,
F. Debray,
H. De Gersem,
E. De Matteis,
A. Dudarev,
S. Farinon,
A. Kario,
R. Losito,
S. Mariotto,
M. Mentink,
R. Musenich,
T. Ogitsu,
M. Prioli,
L. Quettier,
L. Rossi
, et al. (8 additional authors not shown)
Abstract:
In this paper we elaborate on the nature and challenges for the magnet systems of a muon collider as presently considered within the scope of the International Muon Collider Collaboration (IMCC). We outline the structure of the work proposed over the coming period of five years to study and demonstrate relevant magnet technology. The proposal, which is part of the overall work planned to establish…
▽ More
In this paper we elaborate on the nature and challenges for the magnet systems of a muon collider as presently considered within the scope of the International Muon Collider Collaboration (IMCC). We outline the structure of the work proposed over the coming period of five years to study and demonstrate relevant magnet technology. The proposal, which is part of the overall work planned to establish feasibility of a muon collider, is in direct response to the recent recommendations received from the Laboratories Directors Group (LDG). The plan is to profit from joint activities, within the scope of the IMCC and beyond, implemented through direct and EU-funded contributions.
△ Less
Submitted 29 March, 2022; v1 submitted 26 March, 2022;
originally announced March 2022.
-
A Muon Collider Facility for Physics Discovery
Authors:
D. Stratakis,
N. Mokhov,
M. Palmer,
N. Pastrone,
T. Raubenheimer,
C. Rogers,
D. Schulte,
V. Shiltsev,
J. Tang,
A. Yamamoto,
C. Aimè,
M. A. Mahmoud,
N. Bartosik,
E. Barzi,
A. Bersani,
A. Bertolin,
M. Bonesini,
B. Caiffi,
M. Casarsa,
M. G. Catanesi,
A. Cerri,
C. Curatolo,
M. Dam,
H. Damerau,
E. De Matteis
, et al. (44 additional authors not shown)
Abstract:
Muon colliders provide a unique route to deliver high energy collisions that enable discovery searches and precision measurements to extend our understanding of the fundamental laws of physics. The muon collider design aims to deliver physics reach at the highest energies with costs, power consumption and on a time scale that may prove favorable relative to other proposed facilities. In this conte…
▽ More
Muon colliders provide a unique route to deliver high energy collisions that enable discovery searches and precision measurements to extend our understanding of the fundamental laws of physics. The muon collider design aims to deliver physics reach at the highest energies with costs, power consumption and on a time scale that may prove favorable relative to other proposed facilities. In this context, a new international collaboration has formed to further extend the design concepts and performance studies of such a machine. This effort is focused on delivering the elements of a $\sim$10 TeV center of mass (CM) energy design to explore the physics energy frontier. The path to such a machine may pass through lower energy options. Currently a 3 TeV CM stage is considered. Other energy stages could also be explored, e.g. an s-channel Higgs Factory operating at 125 GeV CM. We describe the status of the R&D and design effort towards such a machine and lay out a plan to bring these concepts to maturity as a tool for the high energy physics community.
△ Less
Submitted 15 March, 2022;
originally announced March 2022.
-
The model of an anomaly detector for HiLumi LHC magnets based on Recurrent Neural Networks and adaptive quantization
Authors:
Maciej Wielgosz,
Matej Mertik,
Andrzej Skoczeń,
Ernesto De Matteis
Abstract:
This paper focuses on an examination of an applicability of Recurrent Neural Network models for detecting anomalous behavior of the CERN superconducting magnets. In order to conduct the experiments, the authors designed and implemented an adaptive signal quantization algorithm and a custom GRU-based detector and developed a method for the detector parameters selection. Three different datasets wer…
▽ More
This paper focuses on an examination of an applicability of Recurrent Neural Network models for detecting anomalous behavior of the CERN superconducting magnets. In order to conduct the experiments, the authors designed and implemented an adaptive signal quantization algorithm and a custom GRU-based detector and developed a method for the detector parameters selection. Three different datasets were used for testing the detector. Two artificially generated datasets were used to assess the raw performance of the system whereas the 231 MB dataset composed of the signals acquired from HiLumi magnets was intended for real-life experiments and model training. Several different setups of the developed anomaly detection system were evaluated and compared with state-of-the-art OC-SVM reference model operating on the same data. The OC-SVM model was equipped with a rich set of feature extractors accounting for a range of the input signal properties. It was determined in the course of the experiments that the detector, along with its supporting design methodology, reaches F1 equal or very close to 1 for almost all test sets. Due to the profile of the data, the best_length setup of the detector turned out to perform the best among all five tested configuration schemes of the detection system. The quantization parameters have the biggest impact on the overall performance of the detector with the best values of input/output grid equal to 16 and 8, respectively. The proposed solution of the detection significantly outperformed OC-SVM-based detector in most of the cases, with much more stable performance across all the datasets.
△ Less
Submitted 25 November, 2017; v1 submitted 28 September, 2017;
originally announced September 2017.
