Showing 1–7 of 7 results for author: Cisneros, I

FoundLoc: Vision-based Onboard Aerial Localization in the Wild

Authors: Yao He, Ivan Cisneros, Nikhil Keetha, Jay Patrikar, Zelin Ye, Ian Higgins, Yaoyu Hu, Parv Kapoor, Sebastian Scherer

Abstract: Robust and accurate localization for Unmanned Aerial Vehicles (UAVs) is an essential capability to achieve autonomous, long-range flights. Current methods either rely heavily on GNSS, face limitations in visual-based localization due to appearance variances and stylistic dissimilarities between camera and reference imagery, or operate under the assumption of a known initial pose. In this paper, we… ▽ More Robust and accurate localization for Unmanned Aerial Vehicles (UAVs) is an essential capability to achieve autonomous, long-range flights. Current methods either rely heavily on GNSS, face limitations in visual-based localization due to appearance variances and stylistic dissimilarities between camera and reference imagery, or operate under the assumption of a known initial pose. In this paper, we developed a GNSS-denied localization approach for UAVs that harnesses both Visual-Inertial Odometry (VIO) and Visual Place Recognition (VPR) using a foundation model. This paper presents a novel vision-based pipeline that works exclusively with a nadir-facing camera, an Inertial Measurement Unit (IMU), and pre-existing satellite imagery for robust, accurate localization in varied environments and conditions. Our system demonstrated average localization accuracy within a $20$-meter range, with a minimum error below $1$ meter, under real-world conditions marked by drastic changes in environmental appearance and with no assumption of the vehicle's initial pose. The method is proven to be effective and robust, addressing the crucial need for reliable UAV localization in GNSS-denied environments, while also being computationally efficient enough to be deployed on resource-constrained platforms. △ Less

Submitted 24 October, 2023; originally announced October 2023.

iSimLoc: Visual Global Localization for Previously Unseen Environments with Simulated Images

Authors: Peng Yin, Ivan Cisneros, Ji Zhang, Howie Choset, Sebastian Scherer

Abstract: The visual camera is an attractive device in beyond visual line of sight (B-VLOS) drone operation, since they are low in size, weight, power, and cost, and can provide redundant modality to GPS failures. However, state-of-the-art visual localization algorithms are unable to match visual data that have a significantly different appearance due to illuminations or viewpoints. This paper presents iSim… ▽ More The visual camera is an attractive device in beyond visual line of sight (B-VLOS) drone operation, since they are low in size, weight, power, and cost, and can provide redundant modality to GPS failures. However, state-of-the-art visual localization algorithms are unable to match visual data that have a significantly different appearance due to illuminations or viewpoints. This paper presents iSimLoc, a condition/viewpoint consistent hierarchical global re-localization approach. The place features of iSimLoc can be utilized to search target images under changing appearances and viewpoints. Additionally, our hierarchical global re-localization module refines in a coarse-to-fine manner, allowing iSimLoc to perform a fast and accurate estimation. We evaluate our method on one dataset with appearance variations and one dataset that focuses on demonstrating large-scale matching over a long flight in complicated environments. On our two datasets, iSimLoc achieves 88.7\% and 83.8\% successful retrieval rates with 1.5s inferencing time, compared to 45.8% and 39.7% using the next best method. These results demonstrate robust localization in a range of environments. △ Less

Submitted 13 September, 2022; originally announced September 2022.

Comments: 17 pages, 16 Figures, Conditional accpted by IEEE Transactions on Robotics

General Place Recognition Survey: Towards the Real-world Autonomy Age

Authors: Peng Yin, Shiqi Zhao, Ivan Cisneros, Abulikemu Abuduweili, Guoquan Huang, Micheal Milford, Changliu Liu, Howie Choset, Sebastian Scherer

Abstract: Place recognition is the fundamental module that can assist Simultaneous Localization and Mapping (SLAM) in loop-closure detection and re-localization for long-term navigation. The place recognition community has made astonishing progress over the last $20$ years, and this has attracted widespread research interest and application in multiple fields such as computer vision and robotics. However, f… ▽ More Place recognition is the fundamental module that can assist Simultaneous Localization and Mapping (SLAM) in loop-closure detection and re-localization for long-term navigation. The place recognition community has made astonishing progress over the last $20$ years, and this has attracted widespread research interest and application in multiple fields such as computer vision and robotics. However, few methods have shown promising place recognition performance in complex real-world scenarios, where long-term and large-scale appearance changes usually result in failures. Additionally, there is a lack of an integrated framework amongst the state-of-the-art methods that can handle all of the challenges in place recognition, which include appearance changes, viewpoint differences, robustness to unknown areas, and efficiency in real-world applications. In this work, we survey the state-of-the-art methods that target long-term localization and discuss future directions and opportunities. We start by investigating the formulation of place recognition in long-term autonomy and the major challenges in real-world environments. We then review the recent works in place recognition for different sensor modalities and current strategies for dealing with various place recognition challenges. Finally, we review the existing datasets for long-term localization and introduce our datasets and evaluation API for different approaches. This paper can be a tutorial for researchers new to the place recognition community and those who care about long-term robotics autonomy. We also provide our opinion on the frequently asked question in robotics: Do robots need accurate localization for long-term autonomy? A summary of this work and our datasets and evaluation API is publicly available to the robotics community at: https://github.com/MetaSLAM/GPRS. △ Less

Submitted 9 September, 2022; originally announced September 2022.

Comments: 20 pages, 10 figures. Submitted to IEEE T-RO survey paper

ALTO: A Large-Scale Dataset for UAV Visual Place Recognition and Localization

Authors: Ivan Cisneros, Peng Yin, Ji Zhang, Howie Choset, Sebastian Scherer

Abstract: We present the ALTO dataset, a vision-focused dataset for the development and benchmarking of Visual Place Recognition and Localization methods for Unmanned Aerial Vehicles. The dataset is composed of two long (approximately 150km and 260km) trajectories flown by a helicopter over Ohio and Pennsylvania, and it includes high precision GPS-INS ground truth location data, high precision accelerometer… ▽ More We present the ALTO dataset, a vision-focused dataset for the development and benchmarking of Visual Place Recognition and Localization methods for Unmanned Aerial Vehicles. The dataset is composed of two long (approximately 150km and 260km) trajectories flown by a helicopter over Ohio and Pennsylvania, and it includes high precision GPS-INS ground truth location data, high precision accelerometer readings, laser altimeter readings, and RGB downward facing camera imagery. In addition, we provide reference imagery over the flight paths, which makes this dataset suitable for VPR benchmarking and other tasks common in Localization, such as image registration and visual odometry. To the author's knowledge, this is the largest real-world aerial-vehicle dataset of this kind. Our dataset is available at https://github.com/MetaSLAM/ALTO. △ Less

Submitted 19 July, 2022; originally announced July 2022.

Comments: UAV Localization dataset paper

ALITA: A Large-scale Incremental Dataset for Long-term Autonomy

Authors: Peng Yin, Shiqi Zhao, Ruohai Ge, Ivan Cisneros, Ruijie Fu, Ji Zhang, Howie Choset, Sebastian Scherer

Abstract: For long-term autonomy, most place recognition methods are mainly evaluated on simplified scenarios or simulated datasets, which cannot provide solid evidence to evaluate the readiness for current Simultaneous Localization and Mapping (SLAM). In this paper, we present a long-term place recognition dataset for use in mobile localization under large-scale dynamic environments. This dataset includes… ▽ More For long-term autonomy, most place recognition methods are mainly evaluated on simplified scenarios or simulated datasets, which cannot provide solid evidence to evaluate the readiness for current Simultaneous Localization and Mapping (SLAM). In this paper, we present a long-term place recognition dataset for use in mobile localization under large-scale dynamic environments. This dataset includes a campus-scale track and a city-scale track: 1) the campus-track focuses the long-term property, we record LiDAR device and an omnidirectional camera on 10 trajectories, and each trajectory are repeatly recorded 8 times under variant illumination conditions. 2) the city-track focuses the large-scale property, we mount the LiDAR device on the vehicle and traversing through a 120km trajectories, which contains open streets, residential areas, natural terrains, etc. They includes 200 hours of raw data of all kinds scenarios within urban environments. The ground truth position for both tracks are provided on each trajectory, which is obtained from the Global Position System with an additional General ICP based point cloud refinement. To simplify the evaluation procedure, we also provide the Python-API with a set of place recognition metrics is proposed to quickly load our dataset and evaluate the recognition performance against different methods. This dataset targets at finding methods with high place recognition accuracy and robustness, and providing real robotic system with long-term autonomy. The dataset and the provided tools can be accessed from https://github.com/MetaSLAM/ALITA. △ Less

Submitted 9 September, 2022; v1 submitted 22 May, 2022; originally announced May 2022.

Comments: 6 pages, 5 figures, Submitted for IJRR dataset paper

An Updated Distance to the Cygnus Loop based on Gaia Early DR3

Authors: Robert A. Fesen, Kathryn E. Weil, Ignacio Cisneros, William P. Blair, John C. Raymond

Abstract: We present a revised distance to the Cygnus Loop supernova remnant of $725\pm15$ pc based on Gaia Early Data Release 3 parallax measurements (EDR3) for several stars previously found to be located either inside or behind the supernova based on the presence of high-velocity absorption lines in their spectra. This revised distance estimate and error means the Cygnus Loop remnant now has an estimated… ▽ More We present a revised distance to the Cygnus Loop supernova remnant of $725\pm15$ pc based on Gaia Early Data Release 3 parallax measurements (EDR3) for several stars previously found to be located either inside or behind the supernova based on the presence of high-velocity absorption lines in their spectra. This revised distance estimate and error means the Cygnus Loop remnant now has an estimated distance uncertainty comparable to that of its $\simeq$18 pc radius. △ Less

Submitted 11 September, 2021; originally announced September 2021.

Comments: 3 pages, 1 table

Journal ref: 2021, MNRAS, 507, 244-245

The Cygnus Loop's Distance, Properties, and Environment Driven Morphology

Authors: Robert A. Fesen, Kathryn E. Weil, Ignacio A. Cisneros, William P. Blair, John C. Raymond

Abstract: The Cygnus Loop is among the brightest and best studied evolved Galactic supernova remnants. However, its distance has remained uncertain thus undermining quantitative understanding about many of its fundamental properties. Here we present moderate-dispersion spectra of stars with projected locations toward the remnant. Spectra of three stars revealed Na I 5890,5896 A and Ca II 3934 A absorption f… ▽ More The Cygnus Loop is among the brightest and best studied evolved Galactic supernova remnants. However, its distance has remained uncertain thus undermining quantitative understanding about many of its fundamental properties. Here we present moderate-dispersion spectra of stars with projected locations toward the remnant. Spectra of three stars revealed Na I 5890,5896 A and Ca II 3934 A absorption features associated with the remnant's expanding shell, with velocities ranging from -160 to +240 km/s. Combining Gaia DR2 parallax measurements for these stars with other recent observations, we find the distance to the Cygnus Loop's centre is 735 +/-25 pc, only a bit less than the 770 pc value proposed by Minkowski some 60 years ago. Using this new distance, we discuss the remnant's physical properties including size, SN explosion energy, and shock velocities. We also present multi-wavelength emission maps which reveal that, instead of being located in a progenitor wind-driven cavity as has long been assumed, the Cygnus Loop lies in an extended, low density region. Rather than wind-driven cavity walls, these images reveal in unprecedented clarity the sizes and locations of local interstellar clouds with which the remnant is interacting, giving rise to its large-scale morphology. △ Less

Submitted 8 October, 2018; v1 submitted 5 September, 2018; originally announced September 2018.

Comments: 14 pages, 9 figures; minor changes to match published MNRAS version

Journal ref: 2018 MNRAS, 481, 1786