Showing 1–11 of 11 results for author: Sorrenti, D

Uncertainty-Aware DNN for Multi-Modal Camera Localization

Authors: Matteo Vaghi, Augusto Luis Ballardini, Simone Fontana, Domenico Giorgio Sorrenti

Abstract: Camera localization, i.e., camera pose regression, represents an important task in computer vision since it has many practical applications such as in the context of intelligent vehicles and their localization. Having reliable estimates of the regression uncertainties is also important, as it would allow us to catch dangerous localization failures. In the literature, uncertainty estimation in Deep… ▽ More Camera localization, i.e., camera pose regression, represents an important task in computer vision since it has many practical applications such as in the context of intelligent vehicles and their localization. Having reliable estimates of the regression uncertainties is also important, as it would allow us to catch dangerous localization failures. In the literature, uncertainty estimation in Deep Neural Networks (DNNs) is often performed through sampling methods, such as Monte Carlo Dropout (MCD) and Deep Ensemble (DE), at the expense of undesirable execution time or an increase in hardware resources. In this work, we considered an uncertainty estimation approach named Deep Evidential Regression (DER) that avoids any sampling technique, providing direct uncertainty estimates. Our goal is to provide a systematic approach to intercept localization failures of camera localization systems based on DNNs architectures, by analyzing the generated uncertainties. We propose to exploit CMRNet, a DNN approach for multi-modal image to LiDAR map registration, by modifying its internal configuration to allow for extensive experimental activity on the KITTI dataset. The experimental section highlights CMRNet's major flaws and proves that our proposal does not compromise the original localization performances but also provides, at the same time, the necessary introspection measures that would allow end-users to act accordingly. △ Less

Submitted 9 March, 2023; v1 submitted 2 November, 2022; originally announced November 2022.

Effective exploitation of a geyser bubble-chamber equipment as a background-free fast neutron detector

Authors: R. Bertoni, G. Bruno, N. Burgio, M. Corcione, L. Cretara, M. Frullini, W. Fulgione, G. Palmerini, A. Quintino, N. Redaelli, A. Santagata, D. Sorrenti, L. Zanotti

Abstract: MOSCAB equipment, a geyser-concept bubble-chamber originally thought for the search of dark matter in the form of WIMPs, is employed for the detection of fast neutrons. Once the background-free operating conditions are determined such that the detector is sensitive only to neutrons, which occurs when the neutron energy threshold required for nucleation is higher than approximately 2.5 MeV, the d… ▽ More MOSCAB equipment, a geyser-concept bubble-chamber originally thought for the search of dark matter in the form of WIMPs, is employed for the detection of fast neutrons. Once the background-free operating conditions are determined such that the detector is sensitive only to neutrons, which occurs when the neutron energy threshold required for nucleation is higher than approximately 2.5 MeV, the detector response to fast neutrons is investigated using an AmBe neutron source. Sets of detection efficiency functions are then produced via Monte Carlo simulations and post-processing, their validation being performed experimentally and discussed. Finally, the use of the detector to measure the fast neutron activity of very weak n-sources in clean environments, as well as to monitor the cosmic ray variations through the neutron component of the Extensive Air Showers, is considered. △ Less

Submitted 25 June, 2021; originally announced June 2021.

Comments: 16 pages, 10 figures, submitted to EPJ C

A Termination Criterion for Probabilistic PointClouds Registration

Authors: Simone Fontana, Domenico G. Sorrenti

Abstract: Probabilistic Point Clouds Registration (PPCR) is an algorithm that, in its multi-iteration version, outperformed state of the art algorithms for local point clouds registration. However, its performances have been tested using a fixed high number of iterations. To be of practical usefulness, we think that the algorithm should decide by itself when to stop, to avoid an excessive number of iteratio… ▽ More Probabilistic Point Clouds Registration (PPCR) is an algorithm that, in its multi-iteration version, outperformed state of the art algorithms for local point clouds registration. However, its performances have been tested using a fixed high number of iterations. To be of practical usefulness, we think that the algorithm should decide by itself when to stop, to avoid an excessive number of iterations and, therefore, wasting computational time. With this work, we compare different termination criterion on several datasets and prove that the chosen one produce very good results that are comparable to those obtained using a very high number of iterations while saving computational time. △ Less

Submitted 10 October, 2020; originally announced October 2020.

CMRNet++: Map and Camera Agnostic Monocular Visual Localization in LiDAR Maps

Authors: Daniele Cattaneo, Domenico Giorgio Sorrenti, Abhinav Valada

Abstract: Localization is a critically essential and crucial enabler of autonomous robots. While deep learning has made significant strides in many computer vision tasks, it is still yet to make a sizeable impact on improving capabilities of metric visual localization. One of the major hindrances has been the inability of existing Convolutional Neural Network (CNN)-based pose regression methods to generaliz… ▽ More Localization is a critically essential and crucial enabler of autonomous robots. While deep learning has made significant strides in many computer vision tasks, it is still yet to make a sizeable impact on improving capabilities of metric visual localization. One of the major hindrances has been the inability of existing Convolutional Neural Network (CNN)-based pose regression methods to generalize to previously unseen places. Our recently introduced CMRNet effectively addresses this limitation by enabling map independent monocular localization in LiDAR-maps. In this paper, we now take it a step further by introducing CMRNet++, which is a significantly more robust model that not only generalizes to new places effectively, but is also independent of the camera parameters. We enable this capability by combining deep learning with geometric techniques, and by moving the metric reasoning outside the learning process. In this way, the weights of the network are not tied to a specific camera. Extensive evaluations of CMRNet++ on three challenging autonomous driving datasets, i.e., KITTI, Argoverse, and Lyft5, show that CMRNet++ outperforms CMRNet as well as other baselines by a large margin. More importantly, for the first-time, we demonstrate the ability of a deep learning approach to accurately localize without any retraining or fine-tuning in a completely new environment and independent of the camera parameters. △ Less

Submitted 22 May, 2020; v1 submitted 20 April, 2020; originally announced April 2020.

Comments: Spotlight talk at IEEE ICRA 2020 Workshop on Emerging Learning and Algorithmic Methods for Data Association in Robotics

A Benchmark for Point Clouds Registration Algorithms

Authors: Simone Fontana, Daniele Cattaneo, Augusto Luis Ballardini, Matteo Vaghi, Domenico Giorgio Sorrenti

Abstract: Point clouds registration is a fundamental step of many point clouds processing pipelines; however, most algorithms are tested on data that are collected ad-hoc and not shared with the research community. These data often cover only a very limited set of use cases; therefore, the results cannot be generalised. Public datasets proposed until now, taken individually, cover only a few kinds of enviro… ▽ More Point clouds registration is a fundamental step of many point clouds processing pipelines; however, most algorithms are tested on data that are collected ad-hoc and not shared with the research community. These data often cover only a very limited set of use cases; therefore, the results cannot be generalised. Public datasets proposed until now, taken individually, cover only a few kinds of environment and mostly a single sensor. For these reasons, we developed a benchmark, for localization and mapping applications, using multiple publicly available datasets. In this way, we are able to cover many kinds of environment and many kinds of sensor that can produce point clouds. Furthermore, the ground truth has been thoroughly inspected and evaluated to ensure its quality. For some of the datasets, the accuracy of the ground truth measuring system was not reported by the original authors, therefore we estimated it with our own novel method, based on an iterative registration algorithm. Along with the data, we provide a broad set of registration problems, chosen to cover different types of initial misalignment, various degrees of overlap, and different kinds of registration problems. Lastly, we propose a metric to measure the performances of registration algorithms: it combines the commonly used rotation and translation errors together, to allow an objective comparison of the alignments. This work aims at encouraging authors to use a public and shared benchmark, instead of data collected ad-hoc, to ensure objectivity and repeatability, two fundamental characteristics in any scientific field. △ Less

Submitted 26 April, 2022; v1 submitted 28 March, 2020; originally announced March 2020.

Journal ref: Robotics and Autonomous Systems, 2021, 140: 103734

Vehicle Ego-Lane Estimation with Sensor Failure Modeling

Authors: Augusto Luis Ballardini, Daniele Cattaneo, Rubén Izquierdo, Ignacio Parra Alonso, Andrea Piazzoni, Miguel Ángel Sotelo, Domenico Giorgio Sorrenti

Abstract: We present a probabilistic ego-lane estimation algorithm for highway-like scenarios that is designed to increase the accuracy of the ego-lane estimate, which can be obtained relying only on a noisy line detector and tracker. The contribution relies on a Hidden Markov Model (HMM) with a transient failure model. The proposed algorithm exploits the OpenStreetMap (or other cartographic services) road… ▽ More We present a probabilistic ego-lane estimation algorithm for highway-like scenarios that is designed to increase the accuracy of the ego-lane estimate, which can be obtained relying only on a noisy line detector and tracker. The contribution relies on a Hidden Markov Model (HMM) with a transient failure model. The proposed algorithm exploits the OpenStreetMap (or other cartographic services) road property lane number as the expected number of lanes and leverages consecutive, possibly incomplete, observations. The algorithm effectiveness is proven by employing different line detectors and showing we could achieve much more usable, i.e. stable and reliable, ego-lane estimates over more than 100 Km of highway scenarios, recorded both in Italy and Spain. Moreover, as we could not find a suitable dataset for a quantitative comparison with other approaches, we collected datasets and manually annotated the Ground Truth about the vehicle ego-lane. Such datasets are made publicly available for usage from the scientific community. △ Less

Submitted 6 February, 2020; v1 submitted 5 February, 2020; originally announced February 2020.

Comments: preprint

Global visual localization in LiDAR-maps through shared 2D-3D embedding space

Authors: Daniele Cattaneo, Matteo Vaghi, Simone Fontana, Augusto Luis Ballardini, Domenico Giorgio Sorrenti

Abstract: Global localization is an important and widely studied problem for many robotic applications. Place recognition approaches can be exploited to solve this task, e.g., in the autonomous driving field. While most vision-based approaches match an image w.r.t. an image database, global visual localization within LiDAR-maps remains fairly unexplored, even though the path toward high definition 3D maps,… ▽ More Global localization is an important and widely studied problem for many robotic applications. Place recognition approaches can be exploited to solve this task, e.g., in the autonomous driving field. While most vision-based approaches match an image w.r.t. an image database, global visual localization within LiDAR-maps remains fairly unexplored, even though the path toward high definition 3D maps, produced mainly from LiDARs, is clear. In this work we leverage Deep Neural Network (DNN) approaches to create a shared embedding space between images and LiDAR-maps, allowing for image to 3D-LiDAR place recognition. We trained a 2D and a 3D DNN that create embeddings, respectively from images and from point clouds, that are close to each other whether they refer to the same place. An extensive experimental activity is presented to assess the effectiveness of the approach w.r.t. different learning paradigms, network architectures, and loss functions. All the evaluations have been performed using the Oxford Robotcar Dataset, which encompasses a wide range of weather and light conditions. △ Less

Submitted 10 March, 2020; v1 submitted 2 October, 2019; originally announced October 2019.

Comments: Accepted for presentation at IEEE ICRA 2020

CMRNet: Camera to LiDAR-Map Registration

Authors: Daniele Cattaneo, Matteo Vaghi, Augusto Luis Ballardini, Simone Fontana, Domenico Giorgio Sorrenti, Wolfram Burgard

Abstract: In this paper we present CMRNet, a realtime approach based on a Convolutional Neural Network to localize an RGB image of a scene in a map built from LiDAR data. Our network is not trained in the working area, i.e. CMRNet does not learn the map. Instead it learns to match an image to the map. We validate our approach on the KITTI dataset, processing each frame independently without any tracking pro… ▽ More In this paper we present CMRNet, a realtime approach based on a Convolutional Neural Network to localize an RGB image of a scene in a map built from LiDAR data. Our network is not trained in the working area, i.e. CMRNet does not learn the map. Instead it learns to match an image to the map. We validate our approach on the KITTI dataset, processing each frame independently without any tracking procedure. CMRNet achieves 0.27m and 1.07deg median localization accuracy on the sequence 00 of the odometry dataset, starting from a rough pose estimate displaced up to 3.5m and 17deg. To the best of our knowledge this is the first CNN-based approach that learns to match images from a monocular camera to a given, preexisting 3D LiDAR-map. △ Less

Submitted 9 July, 2021; v1 submitted 24 June, 2019; originally announced June 2019.

Comments: Accepted for presentation at IEEE ITSC2019

Journal ref: 2019 IEEE Intelligent Transportation Systems Conference (ITSC) pp. 1283-1289

A dataset for benchmarking vision-based localization at intersections

Authors: Augusto L. Ballardini, Daniele Cattaneo, Domenico G. Sorrenti

Abstract: In this report we present the work performed in order to build a dataset for benchmarking vision-based localization at intersections, i.e., a set of stereo video sequences taken from a road vehicle that is approaching an intersection, altogether with a reliable measure of the observer position. This report is meant to complement our paper "Vision-Based Localization at Intersections using Digital M… ▽ More In this report we present the work performed in order to build a dataset for benchmarking vision-based localization at intersections, i.e., a set of stereo video sequences taken from a road vehicle that is approaching an intersection, altogether with a reliable measure of the observer position. This report is meant to complement our paper "Vision-Based Localization at Intersections using Digital Maps" submitted to ICRA2019. It complements the paper because the paper uses the dataset, but it had no space for describing the work done to obtain it. Moreover, the dataset is of interest for all those tackling the task of online localization at intersections for road vehicles, e.g., for a quantitative comparison with the proposal in our submitted paper, and it is therefore appropriate to put the dataset description in a separate report. We considered all datasets from road vehicles that we could find as for the end of August 2018. After our evaluation, we kept only sub-sequences from the KITTI dataset. In the future we will increase the collection of sequences with data from our vehicle. △ Less

Submitted 3 November, 2018; originally announced November 2018.

Comments: 7 pages, 26 figures, report describing the work done to prepare a dataset of sequences of a vehicle approaching an intersection, using the sequences recorded in the KITTI dataset

MOSCAB: A geyser-concept bubble chamber to be used in a dark matter search

Authors: The MOSCAB Collaboration, A. Antonicci, M. Ardid, R. Bertoni, G. Bruno, N. Burgio, G. Caruso, D. Cattaneo, F. Chignoli, M. Clemenza, M. Corcione, L. Cretara, D. Cudy, I. Felis, M. Frullini, W. Fulgione, G. Lucchini, L. Manara, M. Maspero, A. Papagni, M. Perego, R. Podviyanuk, A. Pullia, A. Quintino, N. Redaelli , et al. (4 additional authors not shown)

Abstract: The MOSCAB experiment (Materia OSCura A Bolle) uses the "geyser technique", a variant of the superheated liquid technique of extreme simplicity. Operating principles of the new dark matter detector and technical solutions of the device are reported in detail. First results obtained in a series of test runs taken in laboratory demonstrate that we have successfully built and tested a geyser-concept… ▽ More The MOSCAB experiment (Materia OSCura A Bolle) uses the "geyser technique", a variant of the superheated liquid technique of extreme simplicity. Operating principles of the new dark matter detector and technical solutions of the device are reported in detail. First results obtained in a series of test runs taken in laboratory demonstrate that we have successfully built and tested a geyser-concept bubble chamber that can be used in particle physics, especially in dark matter searches, and that we are ready to move underground for extensive data taking. △ Less

Submitted 31 July, 2017; originally announced August 2017.

Comments: 11pages, 7 figures, 1 table

ira_laser_tools: a ROS LaserScan manipulation toolbox

Authors: Augusto Luis Ballardini, Simone Fontana, Axel Furlan, Domenico G. Sorrenti

Abstract: Laser scanners are sensors of widespread use in robotic applications. Under the Robot Operating System (ROS) the information generated by laser scanners can be conveyed by either LaserScan messages or in the form of PointClouds. Many publicly available algorithms (mapping, localization, navigation, etc.) rely on LaserScan messages, yet a tool for handling multiple lasers, merging their measurement… ▽ More Laser scanners are sensors of widespread use in robotic applications. Under the Robot Operating System (ROS) the information generated by laser scanners can be conveyed by either LaserScan messages or in the form of PointClouds. Many publicly available algorithms (mapping, localization, navigation, etc.) rely on LaserScan messages, yet a tool for handling multiple lasers, merging their measurements, or to generate generic LaserScan messages from PointClouds, is not available. This report describes two tools, in the form of ROS nodes, which we release as open source under the BSD license, which allow to either merge multiple single-plane laser scans or to generate virtual laser scans from a point cloud. A short tutorial, along with the main advantages and limitations of these tools are presented. △ Less

Submitted 4 November, 2014; originally announced November 2014.