-
An almost linear time algorithm testing whether the Markoff graph modulo $p$ is connected
Authors:
Colby Austin Brown
Abstract:
The Markoff graph modulo $p$ is known to be connected for all but finitely many primes $p$ (see Eddy, Fuchs, Litman, Martin, Tripeny, and Vanyo [arxiv:2308.07579]), and it is conjectured that these graphs are connected for all primes. In this paper, we provide an algorithmic realization of the process introduced by Bourgain, Gamburd, and Sarnak [arxiv:1607.01530] to test whether the Markoff graph…
▽ More
The Markoff graph modulo $p$ is known to be connected for all but finitely many primes $p$ (see Eddy, Fuchs, Litman, Martin, Tripeny, and Vanyo [arxiv:2308.07579]), and it is conjectured that these graphs are connected for all primes. In this paper, we provide an algorithmic realization of the process introduced by Bourgain, Gamburd, and Sarnak [arxiv:1607.01530] to test whether the Markoff graph modulo $p$ is connected for arbitrary primes. Our algorithm runs in $o(p^{1 + ε})$ time for every $ε> 0$. We demonstrate this algorithm by confirming that the Markoff graph modulo $p$ is connected for all primes less than one million.
△ Less
Submitted 25 January, 2024; v1 submitted 31 December, 2023;
originally announced January 2024.
-
Unravelling Metastable Markovian Open Quantum Systems
Authors:
Calum A. Brown,
Katarzyna Macieszczak,
Robert L. Jack
Abstract:
We analyse the dynamics of metastable Markovian open quantum systems by unravelling their average dynamics into stochastic trajectories. We use quantum reset processes as examples to illustrate metastable phenomenology, including a simple three-state model whose metastability is of classical type, and a two-qubit model that features a metastable decoherence free subspace. In the three-state model,…
▽ More
We analyse the dynamics of metastable Markovian open quantum systems by unravelling their average dynamics into stochastic trajectories. We use quantum reset processes as examples to illustrate metastable phenomenology, including a simple three-state model whose metastability is of classical type, and a two-qubit model that features a metastable decoherence free subspace. In the three-state model, the trajectories exhibit classical metastable phenomenology: fast relaxation into distinct phases and slow transitions between them. This extends the existing correspondence between classical and quantum metastability. It enables the computation of committors for the quantum phases, and the mechanisms of rare transitions between them. For the two-qubit model, the decoherence-free subspace appears in the unravelled trajectories as a slow manifold on which the quantum state has a continuous slow evolution. This provides a classical (non-metastable) analogue of this quantum effect. We discuss the general implications of these results, and we highlight the useful role of quantum reset processes for analysis of quantum trajectories in metastable systems.
△ Less
Submitted 5 April, 2024; v1 submitted 27 August, 2023;
originally announced August 2023.
-
Relating Regularization and Generalization through the Intrinsic Dimension of Activations
Authors:
Bradley C. A. Brown,
Jordan Juravsky,
Anthony L. Caterini,
Gabriel Loaiza-Ganem
Abstract:
Given a pair of models with similar training set performance, it is natural to assume that the model that possesses simpler internal representations would exhibit better generalization. In this work, we provide empirical evidence for this intuition through an analysis of the intrinsic dimension (ID) of model activations, which can be thought of as the minimal number of factors of variation in the…
▽ More
Given a pair of models with similar training set performance, it is natural to assume that the model that possesses simpler internal representations would exhibit better generalization. In this work, we provide empirical evidence for this intuition through an analysis of the intrinsic dimension (ID) of model activations, which can be thought of as the minimal number of factors of variation in the model's representation of the data. First, we show that common regularization techniques uniformly decrease the last-layer ID (LLID) of validation set activations for image classification models and show how this strongly affects generalization performance. We also investigate how excessive regularization decreases a model's ability to extract features from data in earlier layers, leading to a negative effect on validation accuracy even while LLID continues to decrease and training accuracy remains near-perfect. Finally, we examine the LLID over the course of training of models that exhibit grokking. We observe that well after training accuracy saturates, when models ``grok'' and validation accuracy suddenly improves from random to perfect, there is a co-occurent sudden drop in LLID, thus providing more insight into the dynamics of sudden generalization.
△ Less
Submitted 23 November, 2022;
originally announced November 2022.
-
Verifying the Union of Manifolds Hypothesis for Image Data
Authors:
Bradley C. A. Brown,
Anthony L. Caterini,
Brendan Leigh Ross,
Jesse C. Cresswell,
Gabriel Loaiza-Ganem
Abstract:
Deep learning has had tremendous success at learning low-dimensional representations of high-dimensional data. This success would be impossible if there was no hidden low-dimensional structure in data of interest; this existence is posited by the manifold hypothesis, which states that the data lies on an unknown manifold of low intrinsic dimension. In this paper, we argue that this hypothesis does…
▽ More
Deep learning has had tremendous success at learning low-dimensional representations of high-dimensional data. This success would be impossible if there was no hidden low-dimensional structure in data of interest; this existence is posited by the manifold hypothesis, which states that the data lies on an unknown manifold of low intrinsic dimension. In this paper, we argue that this hypothesis does not properly capture the low-dimensional structure typically present in image data. Assuming that data lies on a single manifold implies intrinsic dimension is identical across the entire data space, and does not allow for subregions of this space to have a different number of factors of variation. To address this deficiency, we consider the union of manifolds hypothesis, which states that data lies on a disjoint union of manifolds of varying intrinsic dimensions. We empirically verify this hypothesis on commonly-used image datasets, finding that indeed, observed data lies on a disconnected set and that intrinsic dimension is not constant. We also provide insights into the implications of the union of manifolds hypothesis in deep learning, both supervised and unsupervised, showing that designing models with an inductive bias for this structure improves performance across classification and generative modelling tasks. Our code is available at https://github.com/layer6ai-labs/UoMH.
△ Less
Submitted 2 March, 2023; v1 submitted 6 July, 2022;
originally announced July 2022.
-
The Sortability of Graphs and Matrices under Context Directed Swaps
Authors:
C. A. Brown,
C. S. Carrillo Vazquez,
R. Goswami,
S. Heil,
M. Scheepers
Abstract:
The study of sorting permutations by block interchanges has recently been stimulated by a phenomenon observed in the genome maintenance of certain ciliate species. The result was the identification of a block interchange operation that applies only under certain constraints. Interestingly, this constrained block interchange operation can be generalized naturally to simple graphs and to an operatio…
▽ More
The study of sorting permutations by block interchanges has recently been stimulated by a phenomenon observed in the genome maintenance of certain ciliate species. The result was the identification of a block interchange operation that applies only under certain constraints. Interestingly, this constrained block interchange operation can be generalized naturally to simple graphs and to an operation on square matrices. This more general context provides numerous techniques applicable to the original context. In this paper we consider the more general context, and obtain an enumeration, in closed form, of all simple graphs on n vertices that are ``sortable" by the graph analogue of the constrained version of block interchanges. We also obtain asymptotic results on the proportion of graphs on n vertices that are so sortable.
△ Less
Submitted 5 April, 2019;
originally announced April 2019.
-
A Critique of "Solving the P/NP Problem Under Intrinsic Uncertainty", arXiv:0811.0463
Authors:
Andrew Keenan Richardson,
Cole Arthur Brown
Abstract:
Although whether P equals NP is an important, open problem in computer science, and although Jaeger's 2008 paper, "Solving the P/NP Problem Under Intrinsic Uncertainty" (arXiv:0811.0463) presents an attempt at tackling the problem by discussing the possibility that all computation is uncertain to some degree, there are a number of logical oversights present in that paper which preclude it from s…
▽ More
Although whether P equals NP is an important, open problem in computer science, and although Jaeger's 2008 paper, "Solving the P/NP Problem Under Intrinsic Uncertainty" (arXiv:0811.0463) presents an attempt at tackling the problem by discussing the possibility that all computation is uncertain to some degree, there are a number of logical oversights present in that paper which preclude it from serious consideration toward having resolved P-versus-NP. There are several differences between the model of computation presented in Jaeger's paper and the standard model, as well as several bold assumptions that are not well supported in Jaeger's paper or in the literature. In addition, we find several omissions of rigorous proof that ultimately weaken this paper to a point where it cannot be considered a candidate solution to the P-versus-NP problem.
△ Less
Submitted 24 April, 2009;
originally announced April 2009.
