Showing 1–13 of 13 results for author: Blumberg, A J

Resampling and averaging coordinates on data

Authors: Andrew J. Blumberg, Mathieu Carriere, Jun Hou Fung, Michael A. Mandell

Abstract: We introduce algorithms for robustly computing intrinsic coordinates on point clouds. Our approach relies on generating many candidate coordinates by subsampling the data and varying hyperparameters of the embedding algorithm (e.g., manifold learning). We then identify a subset of representative embeddings by clustering the collection of candidate coordinates and using shape descriptors from topol… ▽ More We introduce algorithms for robustly computing intrinsic coordinates on point clouds. Our approach relies on generating many candidate coordinates by subsampling the data and varying hyperparameters of the embedding algorithm (e.g., manifold learning). We then identify a subset of representative embeddings by clustering the collection of candidate coordinates and using shape descriptors from topological data analysis. The final output is the embedding obtained as an average of the representative embeddings using generalized Procrustes analysis. We validate our algorithm on both synthetic data and experimental measurements from genomics, demonstrating robustness to noise and outliers. △ Less

Submitted 2 August, 2024; originally announced August 2024.

An Intrinsic Approach to Scalar-Curvature Estimation for Point Clouds

Authors: Abigail Hickok, Andrew J. Blumberg

Abstract: We introduce an intrinsic estimator for the scalar curvature of a data set presented as a finite metric space. Our estimator depends only on the metric structure of the data and not on an embedding in $\mathbb{R}^n$. We show that the estimator is consistent in the sense that for points sampled from a probability measure on a compact Riemannian manifold, the estimator converges to the scalar curvat… ▽ More We introduce an intrinsic estimator for the scalar curvature of a data set presented as a finite metric space. Our estimator depends only on the metric structure of the data and not on an embedding in $\mathbb{R}^n$. We show that the estimator is consistent in the sense that for points sampled from a probability measure on a compact Riemannian manifold, the estimator converges to the scalar curvature as the number of points increases. To justify its use in applications, we show that the estimator is stable with respect to perturbations of the metric structure, e.g., noise in the sample or error estimating the intrinsic metric. We validate our estimator experimentally on synthetic data that is sampled from manifolds with specified curvature. △ Less

Submitted 4 August, 2023; originally announced August 2023.

Comments: 37 pages, 5 figures

A Framework for Fast and Stable Representations of Multiparameter Persistent Homology Decompositions

Authors: David Loiseaux, Mathieu Carrière, Andrew J. Blumberg

Abstract: Topological data analysis (TDA) is an area of data science that focuses on using invariants from algebraic topology to provide multiscale shape descriptors for geometric data sets such as point clouds. One of the most important such descriptors is {\em persistent homology}, which encodes the change in shape as a filtration parameter changes; a typical parameter is the feature scale. For many data… ▽ More Topological data analysis (TDA) is an area of data science that focuses on using invariants from algebraic topology to provide multiscale shape descriptors for geometric data sets such as point clouds. One of the most important such descriptors is {\em persistent homology}, which encodes the change in shape as a filtration parameter changes; a typical parameter is the feature scale. For many data sets, it is useful to simultaneously vary multiple filtration parameters, for example feature scale and density. While the theoretical properties of single parameter persistent homology are well understood, less is known about the multiparameter case. In particular, a central question is the problem of representing multiparameter persistent homology by elements of a vector space for integration with standard machine learning algorithms. Existing approaches to this problem either ignore most of the multiparameter information to reduce to the one-parameter case or are heuristic and potentially unstable in the face of noise. In this article, we introduce a new general representation framework that leverages recent results on {\em decompositions} of multiparameter persistent homology. This framework is rich in information, fast to compute, and encompasses previous approaches. Moreover, we establish theoretical stability guarantees under this framework as well as efficient algorithms for practical computation, making this framework an applicable and versatile tool for analyzing geometric and point cloud data. We validate our stability results and algorithms with numerical experiments that demonstrate statistical convergence, prediction accuracy, and fast running times on several real data sets. △ Less

Submitted 19 June, 2023; originally announced June 2023.

A statistical framework for analyzing shape in a time series of random geometric objects

Authors: Anne van Delft, Andrew J. Blumberg

Abstract: We introduce a new framework to analyze shape descriptors that capture the geometric features of an ensemble of point clouds. At the core of our approach is the point of view that the data arises as sampled recordings from a metric space-valued stochastic process, possibly of nonstationary nature, thereby integrating geometric data analysis into the realm of functional time series analysis. We foc… ▽ More We introduce a new framework to analyze shape descriptors that capture the geometric features of an ensemble of point clouds. At the core of our approach is the point of view that the data arises as sampled recordings from a metric space-valued stochastic process, possibly of nonstationary nature, thereby integrating geometric data analysis into the realm of functional time series analysis. We focus on the descriptors coming from topological data analysis. Our framework allows for natural incorporation of spatial-temporal dynamics, heterogeneous sampling, and the study of convergence rates. Further, we derive complete invariants for classes of metric space-valued stochastic processes in the spirit of Gromov, and relate these invariants to so-called ball volume processes. Under mild dependence conditions, a weak invariance principle in $D([0,1]\times [0,\mathscr{R}])$ is established for sequential empirical versions of the latter, assuming the probabilistic structure possibly changes over time. Finally, we use this result to introduce novel test statistics for topological change, which are distribution free in the limit under the hypothesis of stationarity. △ Less

Submitted 18 September, 2023; v1 submitted 4 April, 2023; originally announced April 2023.

Comments: Submission version

MSC Class: Primary 62M99; 62R20; 62R40; secondary 60B05; 60F17; 62M10

Fast, Stable and Efficient Approximation of Multi-parameter Persistence Modules with MMA

Authors: David Loiseaux, Mathieu Carrière, Andrew J. Blumberg

Abstract: In this article, we introduce a new parameterized family of topological invariants, taking the form of candidate decompositions, for multi-parameter persistence modules. We prove that our candidate decompositions are controllable approximations: when restricting to modules that can be decomposed into interval summands, we establish theoretical results about the approximation error between our cand… ▽ More In this article, we introduce a new parameterized family of topological invariants, taking the form of candidate decompositions, for multi-parameter persistence modules. We prove that our candidate decompositions are controllable approximations: when restricting to modules that can be decomposed into interval summands, we establish theoretical results about the approximation error between our candidate decompositions and the true underlying module in terms of the standard interleaving and bottleneck distances. Moreover, even when the underlying module does not admit such a decomposition, our candidate decompositions are nonetheless stable invariants; small perturbations in the underlying module lead to small perturbations in the candidate decomposition. Then, we introduce MMA (Multipersistence Module Approximation): an algorithm for computing stable instances of such invariants, which is based on fibered barcodes and exact matchings, two constructions that stem from the theory of single-parameter persistence. By design, MMA can handle an arbitrary number of filtrations, and has bounded complexity and running time. Finally, we present empirical evidence validating the generalization capabilities and running time speed-ups of MMA on several data sets. △ Less

Submitted 19 June, 2023; v1 submitted 4 June, 2022; originally announced June 2022.

Stability of 2-Parameter Persistent Homology

Authors: Andrew J. Blumberg, Michael Lesnick

Abstract: The Čech and Rips constructions of persistent homology are stable with respect to perturbations of the input data. However, neither is robust to outliers, and both can be insensitive to topological structure of high-density regions of the data. A natural solution is to consider 2-parameter persistence. This paper studies the stability of 2-parameter persistent homology: We show that several relate… ▽ More The Čech and Rips constructions of persistent homology are stable with respect to perturbations of the input data. However, neither is robust to outliers, and both can be insensitive to topological structure of high-density regions of the data. A natural solution is to consider 2-parameter persistence. This paper studies the stability of 2-parameter persistent homology: We show that several related density-sensitive constructions of bifiltrations from data satisfy stability properties accommodating the addition and removal of outliers. Specifically, we consider the multicover bifiltration, Sheehy's subdivision bifiltrations, and the degree bifiltrations. For the multicover and subdivision bifiltrations, we get 1-Lipschitz stability results closely analogous to the standard stability results for 1-parameter persistent homology. Our results for the degree bifiltrations are weaker, but they are tight, in a sense. As an application of our theory, we prove a law of large numbers for subdivision bifiltrations of random data. △ Less

Submitted 27 April, 2022; v1 submitted 19 October, 2020; originally announced October 2020.

Comments: 46 pages

MREC: a fast and versatile framework for aligning and matching point clouds with applications to single cell molecular data

Authors: Andrew J. Blumberg, Mathieu Carriere, Michael A. Mandell, Raul Rabadan, Soledad Villar

Abstract: Comparing and aligning large datasets is a pervasive problem occurring across many different knowledge domains. We introduce and study MREC, a recursive decomposition algorithm for computing matchings between data sets. The basic idea is to partition the data, match the partitions, and then recursively match the points within each pair of identified partitions. The matching itself is done using bl… ▽ More Comparing and aligning large datasets is a pervasive problem occurring across many different knowledge domains. We introduce and study MREC, a recursive decomposition algorithm for computing matchings between data sets. The basic idea is to partition the data, match the partitions, and then recursively match the points within each pair of identified partitions. The matching itself is done using black box matching procedures that are too expensive to run on the entire data set. Using an absolute measure of the quality of a matching, the framework supports optimization over parameters including partitioning procedures and matching algorithms. By design, MREC can be applied to extremely large data sets. We analyze the procedure to describe when we can expect it to work well and demonstrate its flexibility and power by applying it to a number of alignment problems arising in the analysis of single cell molecular data. △ Less

Submitted 20 February, 2020; v1 submitted 6 January, 2020; originally announced January 2020.

Testing to distinguish measures on metric spaces

Authors: Andrew J. Blumberg, Prithwish Bhaumik, Stephen G. Walker

Abstract: We study the problem of distinguishing between two distributions on a metric space; i.e., given metric measure spaces $({\mathbb X}, d, μ_1)$ and $({\mathbb X}, d, μ_2)$, we are interested in the problem of determining from finite data whether or not $μ_1$ is $μ_2$. The key is to use pairwise distances between observations and, employing a reconstruction theorem of Gromov, we can perform such a te… ▽ More We study the problem of distinguishing between two distributions on a metric space; i.e., given metric measure spaces $({\mathbb X}, d, μ_1)$ and $({\mathbb X}, d, μ_2)$, we are interested in the problem of determining from finite data whether or not $μ_1$ is $μ_2$. The key is to use pairwise distances between observations and, employing a reconstruction theorem of Gromov, we can perform such a test using a two sample Kolmogorov--Smirnov test. A real analysis using phylogenetic trees and flu data is presented. △ Less

Submitted 4 February, 2018; originally announced February 2018.

Universality of the Homotopy Interleaving Distance

Authors: Andrew J. Blumberg, Michael Lesnick

Abstract: As a step towards establishing homotopy-theoretic foundations for topological data analysis (TDA), we introduce and study homotopy interleavings between filtered topological spaces. These are homotopy-invariant analogues of interleavings, objects commonly used in TDA to articulate stability and inference theorems. Intuitively, whereas a strict interleaving between filtered spaces $X$ and $Y$ certi… ▽ More As a step towards establishing homotopy-theoretic foundations for topological data analysis (TDA), we introduce and study homotopy interleavings between filtered topological spaces. These are homotopy-invariant analogues of interleavings, objects commonly used in TDA to articulate stability and inference theorems. Intuitively, whereas a strict interleaving between filtered spaces $X$ and $Y$ certifies that $X$ and $Y$ are approximately isomorphic, a homotopy interleaving between $X$ and $Y$ certifies that $X$ and $Y$ are approximately weakly equivalent. The main results of this paper are that homotopy interleavings induce an extended pseudometric $d_{HI}$ on filtered spaces, and that this is the universal pseudometric satisfying natural stability and homotopy invariance axioms. To motivate these axioms, we also observe that $d_{HI}$ (or more generally, any pseudometric satisfying these two axioms and an additional "homology bounding" axiom) can be used to formulate lifts of several fundamental TDA theorems from the algebraic (homological) level to the level of filtered spaces. Finally, we consider the problem of establishing a persistent Whitehead theorem in terms of homotopy interleavings. We provide a counterexample to a naive formulation of the result. △ Less

Submitted 29 April, 2022; v1 submitted 3 May, 2017; originally announced May 2017.

Comments: Major revision: Improved exposition and expanded discussion of applications. 40 pages

A polynomial-time relaxation of the Gromov-Hausdorff distance

Authors: Soledad Villar, Afonso S. Bandeira, Andrew J. Blumberg, Rachel Ward

Abstract: The Gromov-Hausdorff distance provides a metric on the set of isometry classes of compact metric spaces. Unfortunately, computing this metric directly is believed to be computationally intractable. Motivated by applications in shape matching and point-cloud comparison, we study a semidefinite programming relaxation of the Gromov-Hausdorff metric. This relaxation can be computed in polynomial time,… ▽ More The Gromov-Hausdorff distance provides a metric on the set of isometry classes of compact metric spaces. Unfortunately, computing this metric directly is believed to be computationally intractable. Motivated by applications in shape matching and point-cloud comparison, we study a semidefinite programming relaxation of the Gromov-Hausdorff metric. This relaxation can be computed in polynomial time, and somewhat surprisingly is itself a pseudometric. We describe the induced topology on the set of compact metric spaces. Finally, we demonstrate the numerical performance of various algorithms for computing the relaxed distance and apply these algorithms to several relevant data sets. In particular we propose a greedy algorithm for finding the best correspondence between finite metric spaces that can handle hundreds of points. △ Less

Submitted 18 October, 2016; v1 submitted 17 October, 2016; originally announced October 2016.

Comments: 15 pages

Defending against malicious peripherals with Cinch

Authors: Sebastian Angel, Riad S. Wahby, Max Howald, Joshua B. Leners, Michael Spilo, Zhen Sun, Andrew J. Blumberg, Michael Walfish

Abstract: Malicious peripherals designed to attack their host computers are a growing problem. Inexpensive and powerful peripherals that attach to plug-and-play buses have made such attacks easy to mount. Making matters worse, commodity operating systems lack coherent defenses, and users are often unaware of the scope of the problem. We present Cinch, a pragmatic response to this threat. Cinch uses virtuali… ▽ More Malicious peripherals designed to attack their host computers are a growing problem. Inexpensive and powerful peripherals that attach to plug-and-play buses have made such attacks easy to mount. Making matters worse, commodity operating systems lack coherent defenses, and users are often unaware of the scope of the problem. We present Cinch, a pragmatic response to this threat. Cinch uses virtualization to attach peripheral devices to a logically separate, untrusted machine, and includes an interposition layer between the untrusted machine and the protected one. This layer regulates interaction with devices according to user-configured policies. Cinch integrates with existing OSes, enforces policies that thwart real-world attacks, and has low overhead. △ Less

Submitted 29 June, 2016; v1 submitted 3 June, 2015; originally announced June 2015.

Comments: 18 pages, 7 figures

Journal ref: Proc. USENIX Security (2016), 397--414

Quantitative Homotopy Theory in Topological Data Analysis

Authors: Andrew J. Blumberg, Michael A. Mandell

Abstract: This paper lays the foundations of an approach to applying Gromov's ideas on quantitative topology to topological data analysis. We introduce the "contiguity complex", a simplicial complex of maps between simplicial complexes defined in terms of the combinatorial notion of contiguity. We generalize the Simplicial Approximation Theorem to show that the contiguity complex approximates the homotopy t… ▽ More This paper lays the foundations of an approach to applying Gromov's ideas on quantitative topology to topological data analysis. We introduce the "contiguity complex", a simplicial complex of maps between simplicial complexes defined in terms of the combinatorial notion of contiguity. We generalize the Simplicial Approximation Theorem to show that the contiguity complex approximates the homotopy type of the mapping space as we subdivide the domain. We describe algorithms for approximating the rate of growth of the components of the contiguity complex under subdivision of the domain; this procedure allows us to computationally distinguish spaces with isomorphic homology but different homotopy types. △ Less

Submitted 25 September, 2013; originally announced September 2013.

MSC Class: 55U10; 68U05

Journal ref: Found. Comput. Math. 13 (2013), no. 6, 885-911

Robust statistics, hypothesis testing, and confidence intervals for persistent homology on metric measure spaces

Authors: Andrew J. Blumberg, Itamar Gal, Michael A. Mandell, Matthew Pancia

Abstract: We study distributions of persistent homology barcodes associated to taking subsamples of a fixed size from metric measure spaces. We show that such distributions provide robust invariants of metric measure spaces, and illustrate their use in hypothesis testing and providing confidence intervals for topological data analysis. We study distributions of persistent homology barcodes associated to taking subsamples of a fixed size from metric measure spaces. We show that such distributions provide robust invariants of metric measure spaces, and illustrate their use in hypothesis testing and providing confidence intervals for topological data analysis. △ Less

Submitted 17 January, 2014; v1 submitted 20 June, 2012; originally announced June 2012.