Showing 1–50 of 122 results for author: Smith, J S

SGP-RI: A Real-Time-Trainable and Decentralized IoT Indoor Localization Model Based on Sparse Gaussian Process with Reduced-Dimensional Inputs

Authors: Zhe Tang, Sihao Li, Zichen Huang, Guandong Yang, Kyeong Soo Kim, Jeremy S. Smith

Abstract: Internet of Things (IoT) devices are deployed in the filed, there is an enormous amount of untapped potential in local computing on those IoT devices. Harnessing this potential for indoor localization, therefore, becomes an exciting research area. Conventionally, the training and deployment of indoor localization models are based on centralized servers with substantial computational resources. Thi… ▽ More Internet of Things (IoT) devices are deployed in the filed, there is an enormous amount of untapped potential in local computing on those IoT devices. Harnessing this potential for indoor localization, therefore, becomes an exciting research area. Conventionally, the training and deployment of indoor localization models are based on centralized servers with substantial computational resources. This centralized approach faces several challenges, including the database's inability to accommodate the dynamic and unpredictable nature of the indoor electromagnetic environment, the model retraining costs, and the susceptibility of centralized servers to security breaches. To mitigate these challenges we aim to amalgamate the offline and online phases of traditional indoor localization methods using a real-time-trainable and decentralized IoT indoor localization model based on Sparse Gaussian Process with Reduced-dimensional Inputs (SGP-RI), where the number and dimension of the input data are reduced through reference point and wireless access point filtering, respectively. The experimental results based on a multi-building and multi-floor static database as well as a single-building and single-floor dynamic database, demonstrate that the proposed SGP-RI model with less than half the training samples as inducing inputs can produce comparable localization performance to the standard Gaussian Process model with the whole training samples. The SGP-RI model enables the decentralization of indoor localization, facilitating its deployment to resource-constrained IoT devices, and thereby could provide enhanced security and privacy, reduced costs, and network dependency. Also, the model's capability of real-time training makes it possible to quickly adapt to the time-varying indoor electromagnetic environment. △ Less

Submitted 24 August, 2024; originally announced September 2024.

Comments: 10 pages, 4 figures, under review for journal publication

MoDeGPT: Modular Decomposition for Large Language Model Compression

Authors: Chi-Heng Lin, Shangqian Gao, James Seale Smith, Abhishek Patel, Shikhar Tuli, Yilin Shen, Hongxia Jin, Yen-Chang Hsu

Abstract: Large Language Models (LLMs) have reshaped the landscape of artificial intelligence by demonstrating exceptional performance across various tasks. However, substantial computational requirements make their deployment challenging on devices with limited resources. Recently, compression methods using low-rank matrix techniques have shown promise, yet these often lead to degraded accuracy or introduc… ▽ More Large Language Models (LLMs) have reshaped the landscape of artificial intelligence by demonstrating exceptional performance across various tasks. However, substantial computational requirements make their deployment challenging on devices with limited resources. Recently, compression methods using low-rank matrix techniques have shown promise, yet these often lead to degraded accuracy or introduce significant overhead in parameters and inference latency. This paper introduces \textbf{Mo}dular \textbf{De}composition (MoDeGPT), a novel structured compression framework that does not need recovery fine-tuning while resolving the above drawbacks. MoDeGPT partitions the Transformer block into modules comprised of matrix pairs and reduces the hidden dimensions via reconstructing the module-level outputs. MoDeGPT is developed based on a theoretical framework that utilizes three well-established matrix decomposition algorithms -- Nyström approximation, CR decomposition, and SVD -- and applies them to our redefined transformer modules. Our comprehensive experiments show MoDeGPT, without backward propagation, matches or surpasses previous structured compression methods that rely on gradient information, and saves 98% of compute costs on compressing a 13B model. On \textsc{Llama}-2/3 and OPT models, MoDeGPT maintains 90-95% zero-shot performance with 25-30% compression rates. Moreover, the compression can be done on a single GPU within a few hours and increases the inference throughput by up to 46%. △ Less

Submitted 20 August, 2024; v1 submitted 18 August, 2024; originally announced August 2024.

Comments: 31 pages, 9 figures

MSC Class: 15A23 (Primary) ACM Class: I.2.7

Mean Teacher based SSL Framework for Indoor Localization Using Wi-Fi RSSI Fingerprinting

Authors: Sihao Li, Zhe Tang, Kyeong Soo Kim, Jeremy S. Smith

Abstract: Wi-Fi fingerprinting is widely applied for indoor localization due to the widespread availability of Wi-Fi devices. However, traditional methods are not ideal for multi-building and multi-floor environments due to the scalability issues. Therefore, more and more researchers have employed deep learning techniques to enable scalable indoor localization. This paper introduces a novel semi-supervised… ▽ More Wi-Fi fingerprinting is widely applied for indoor localization due to the widespread availability of Wi-Fi devices. However, traditional methods are not ideal for multi-building and multi-floor environments due to the scalability issues. Therefore, more and more researchers have employed deep learning techniques to enable scalable indoor localization. This paper introduces a novel semi-supervised learning framework for neural networks based on wireless access point selection, noise injection, and Mean Teacher model, which leverages unlabeled fingerprints to enhance localization performance. The proposed framework can manage hybrid in/outsourcing and voluntarily contributed databases and continually expand the fingerprint database with newly submitted unlabeled fingerprints during service. The viability of the proposed framework was examined using two established deep-learning models with the UJIIndoorLoc database. The experimental results suggest that the proposed framework significantly improves localization performance compared to the supervised learning-based approach in terms of floor-level coordinate estimation using EvAAL metric. It shows enhancements up to 10.99% and 8.98% in the former scenario and 4.25% and 9.35% in the latter, respectively with additional studies highlight the importance of the essential components of the proposed framework. △ Less

Submitted 18 July, 2024; originally announced July 2024.

Comments: 12 pages, 10 figures, under preparation for a journal publication

Hierarchical Stage-Wise Training of Linked Deep Neural Networks for Multi-Building and Multi-Floor Indoor Localization Based on Wi-Fi RSSI Fingerprinting

Authors: Sihao Li, Kyeong Soo Kim, Zhe Tang, Graduate, Jeremy S. Smith

Abstract: In this paper, we present a new solution to the problem of large-scale multi-building and multi-floor indoor localization based on linked neural networks, where each neural network is dedicated to a sub-problem and trained under a hierarchical stage-wise training framework. When the measured data from sensors have a hierarchical representation as in multi-building and multi-floor indoor localizati… ▽ More In this paper, we present a new solution to the problem of large-scale multi-building and multi-floor indoor localization based on linked neural networks, where each neural network is dedicated to a sub-problem and trained under a hierarchical stage-wise training framework. When the measured data from sensors have a hierarchical representation as in multi-building and multi-floor indoor localization, it is important to exploit the hierarchical nature in data processing to provide a scalable solution. In this regard, the hierarchical stage-wise training framework extends the original stage-wise training framework to the case of multiple linked networks by training a lower-hierarchy network based on the prior knowledge gained from the training of higher-hierarchy networks. The experimental results with the publicly-available UJIIndoorLoc multi-building and multi-floor Wi-Fi RSSI fingerprint database demonstrate that the linked neural networks trained under the proposed hierarchical stage-wise training framework can achieve a three-dimensional localization error of 8.19 m, which, to the best of the authors' knowledge, is the most accurate result ever obtained for neural network-based models trained and evaluated with the full datasets of the UJIIndoorLoc database, and that, when applied to a model based on hierarchical convolutional neural networks, the proposed training framework can also significantly reduce the three-dimensional localization error from 11.78 m to 8.71 m. △ Less

Submitted 18 July, 2024; originally announced July 2024.

Comments: 9 pages, 5 figures, under review for journal publication

Adaptive Memory Replay for Continual Learning

Authors: James Seale Smith, Lazar Valkov, Shaunak Halbe, Vyshnavi Gutta, Rogerio Feris, Zsolt Kira, Leonid Karlinsky

Abstract: Foundation Models (FMs) have become the hallmark of modern AI, however, these models are trained on massive data, leading to financially expensive training. Updating FMs as new data becomes available is important, however, can lead to `catastrophic forgetting', where models underperform on tasks related to data sub-populations observed too long ago. This continual learning (CL) phenomenon has been… ▽ More Foundation Models (FMs) have become the hallmark of modern AI, however, these models are trained on massive data, leading to financially expensive training. Updating FMs as new data becomes available is important, however, can lead to `catastrophic forgetting', where models underperform on tasks related to data sub-populations observed too long ago. This continual learning (CL) phenomenon has been extensively studied, but primarily in a setting where only a small amount of past data can be stored. We advocate for the paradigm where memory is abundant, allowing us to keep all previous data, but computational resources are limited. In this setting, traditional replay-based CL approaches are outperformed by a simple baseline which replays past data selected uniformly at random, indicating that this setting necessitates a new approach. We address this by introducing a framework of adaptive memory replay for continual learning, where sampling of past data is phrased as a multi-armed bandit problem. We utilize Bolzmann sampling to derive a method which dynamically selects past data for training conditioned on the current task, assuming full data access and emphasizing training efficiency. Through extensive evaluations on both vision and language pre-training tasks, we demonstrate the effectiveness of our approach, which maintains high performance while reducing forgetting by up to 10% at no training efficiency cost. △ Less

Submitted 18 April, 2024; originally announced April 2024.

Comments: CVPR-W 2024 (Spotlight)

Low-symmetry polymorph of GaP upends bonding paradigms of metallic high-pressure III-V compounds

Authors: Barbara Lavina, Enrique Zanardi, Andrés Mujica, Hyunchae Cynn, Yue Meng, Vitali Prakapenka, Jesse S. Smith

Abstract: The pressure-induced polymorphism of binary octect compounds has long been considered a settled problem although the possible atomic disordering of some phases remains a puzzling observation. Taking GaP as a case study, we conclude, through x-ray microdiffraction and first-principles calculations, that its high-pressure phase II (previously reported as being disordered) adopts in fact an ordered b… ▽ More The pressure-induced polymorphism of binary octect compounds has long been considered a settled problem although the possible atomic disordering of some phases remains a puzzling observation. Taking GaP as a case study, we conclude, through x-ray microdiffraction and first-principles calculations, that its high-pressure phase II (previously reported as being disordered) adopts in fact an ordered base-centered monoclinic structure previously unknown in this class of compounds. The formation of layered patterns with variable degrees of interlayer dimerization, as observed in GaP, marks a paradigm shift of our understanding of ordering in octect high-pressure phases which calls for a more extensive re-examination. A rich polymorphism with fine tuning of chemical and physical properties can be envisioned. △ Less

Submitted 11 April, 2024; originally announced April 2024.

Static vs. Dynamic Databases for Indoor Localization based on Wi-Fi Fingerprinting: A Discussion from a Data Perspective

Authors: Zhe Tang, Ruocheng Gu, Sihao Li, Kyeong Soo Kim, Jeremy S. Smith

Abstract: Wi-Fi fingerprinting has emerged as the most popular approach to indoor localization. The use of ML algorithms has greatly improved the localization performance of Wi-Fi fingerprinting, but its success depends on the availability of fingerprint databases composed of a large number of RSSIs, the MAC addresses of access points, and the other measurement information. However, most fingerprint databas… ▽ More Wi-Fi fingerprinting has emerged as the most popular approach to indoor localization. The use of ML algorithms has greatly improved the localization performance of Wi-Fi fingerprinting, but its success depends on the availability of fingerprint databases composed of a large number of RSSIs, the MAC addresses of access points, and the other measurement information. However, most fingerprint databases do not reflect well the time varying nature of electromagnetic interferences in complicated modern indoor environment. This could result in significant changes in statistical characteristics of training/validation and testing datasets, which are often constructed at different times, and even the characteristics of the testing datasets could be different from those of the data submitted by users during the operation of localization systems after their deployment. In this paper, we consider the implications of time-varying Wi-Fi fingerprints on indoor localization from a data-centric point of view and discuss the differences between static and dynamic databases. As a case study, we have constructed a dynamic database covering three floors of the IR building of XJTLU based on RSSI measurements, over 44 days, and investigated the differences between static and dynamic databases in terms of statistical characteristics and localization performance. The analyses based on variance calculations and Isolation Forest show the temporal shifts in RSSIs, which result in a noticeable trend of the increase in the localization error of a Gaussian process regression model with the maximum error of 6.65 m after 14 days of training without model adjustments. The results of the case study with the XJTLU dynamic database clearly demonstrate the limitations of static databases and the importance of the creation and adoption of dynamic databases for future indoor localization research and real-world deployment. △ Less

Submitted 20 February, 2024; originally announced February 2024.

Comments: 10 pages, 5 figures, Invited paper with Excellent Paper Award to be presented at ICAIIC 2024, Osaka, Japan, Feb. 19--22, 2023

Phase Boundaries, Isotope Effect and Superconductivity of Lithium Under Hydrostatic Conditions

Authors: Stefano Racioppi, Iren Saffarian-Deemyad, William Holle, Francesco Belli, Richard Ferry, Curtis Kenney-Benson, Jesse S. Smith, Eva Zurek, Shanti Deemyad

Abstract: We present theoretical and experimental studies of superconductivity and low temperature structural phase boundaries in lithium. We mapped the structural phase diagram of 6Li and 7Li under hydrostatic conditions between 5 top 55GPa and within the temperature range of 15 to 75K, observing the FCC-hR1-cI16 phase transitions. 6Li and 7Li show some differences at the structural boundaries, with a pote… ▽ More We present theoretical and experimental studies of superconductivity and low temperature structural phase boundaries in lithium. We mapped the structural phase diagram of 6Li and 7Li under hydrostatic conditions between 5 top 55GPa and within the temperature range of 15 to 75K, observing the FCC-hR1-cI16 phase transitions. 6Li and 7Li show some differences at the structural boundaries, with a potential shift of the phase boundaries of 6Li to lower pressures. Density functional theory calculations and topological analysis of the electron density elucidates the superconducting properties and interatomic interactions within these phases of lithium. △ Less

Submitted 4 January, 2024; v1 submitted 29 December, 2023; originally announced December 2023.

Comments: (24 pages, 10 figures, 2 tables, 2 parts including main manuscript and the supplementary information section)

Continual Diffusion with STAMINA: STack-And-Mask INcremental Adapters

Authors: James Seale Smith, Yen-Chang Hsu, Zsolt Kira, Yilin Shen, Hongxia Jin

Abstract: Recent work has demonstrated a remarkable ability to customize text-to-image diffusion models to multiple, fine-grained concepts in a sequential (i.e., continual) manner while only providing a few example images for each concept. This setting is known as continual diffusion. Here, we ask the question: Can we scale these methods to longer concept sequences without forgetting? Although prior work mi… ▽ More Recent work has demonstrated a remarkable ability to customize text-to-image diffusion models to multiple, fine-grained concepts in a sequential (i.e., continual) manner while only providing a few example images for each concept. This setting is known as continual diffusion. Here, we ask the question: Can we scale these methods to longer concept sequences without forgetting? Although prior work mitigates the forgetting of previously learned concepts, we show that its capacity to learn new tasks reaches saturation over longer sequences. We address this challenge by introducing a novel method, STack-And-Mask INcremental Adapters (STAMINA), which is composed of low-ranked attention-masked adapters and customized MLP tokens. STAMINA is designed to enhance the robust fine-tuning properties of LoRA for sequential concept learning via learnable hard-attention masks parameterized with low rank MLPs, enabling precise, scalable learning via sparse adaptation. Notably, all introduced trainable parameters can be folded back into the model after training, inducing no additional inference parameter costs. We show that STAMINA outperforms the prior SOTA for the setting of text-to-image continual customization on a 50-concept benchmark composed of landmarks and human faces, with no stored replay data. Additionally, we extended our method to the setting of continual learning for image classification, demonstrating that our gains also translate to state-of-the-art performance in this standard benchmark. △ Less

Submitted 2 May, 2024; v1 submitted 30 November, 2023; originally announced November 2023.

Comments: CVPR-W 2024

The influence of pinholes and weak-points in aluminium-oxide Josephson junctions

Authors: K. Bayros, M. J. Cyster, J. S. Smith, J. H. Cole

Abstract: Josephson junctions are the key components used in superconducting qubits for quantum computing. The advancement of quantum computing is limited by a lack of stability and reproducibility of qubits which ultimately originates in the amorphous tunnel barrier of the Josephson junctions and other material imperfections. Pinholes in the junction have been suggested as one of the possible contributors… ▽ More Josephson junctions are the key components used in superconducting qubits for quantum computing. The advancement of quantum computing is limited by a lack of stability and reproducibility of qubits which ultimately originates in the amorphous tunnel barrier of the Josephson junctions and other material imperfections. Pinholes in the junction have been suggested as one of the possible contributors to these instabilities, but evidence of their existence and the effect they might have on transport is unclear. We use molecular dynamics to create three-dimensional atomistic models to describe Al-AlOx-Al tunnel junctions, showing that pinholes form when oxidation of the barrier is incomplete. Following this we use the atomistic model and simulate the electronic transport properties for tunnel junctions with different barrier thicknesses using the non-equilibrium Green's function formalism. We observe that pinholes may contribute to excess quasiparticle current flow in Al-AlOx-Al tunnel junctions with thinner barriers, and in thicker barriers we observe weak-points which facilitate leakage currents even when the oxide is continuous. We find that the disordered nature of the amorphous barrier results in significant variations in the transport properties. Additionally, we determine the current-phase relationship for our atomistic structures, confirming that devices with pinholes and weak-points cause a deviation from the ideal sinusoidal Josephson relationship. △ Less

Submitted 29 February, 2024; v1 submitted 27 November, 2023; originally announced November 2023.

Comments: 17 pages, 15 figures

Journal ref: Phys. Rev. Materials 8, 046202 (2024)

Model-independent extraction of form factors and $|V_{cb}|$ in $\overline{B} \rightarrow D \ell^- \overlineν_\ell$ with hadronic tagging at BaBar

Authors: BaBar Collaboration, J. P. Lees, V. Poireau, V. Tisserand, E. Grauges, A. Palano, G. Eigen, D. N. Brown, Yu. G. Kolomensky, M. Fritsch, H. Koch, R. Cheaib, C. Hearty, T. S. Mattison, J. A. McKenna, R. Y. So, V. E. Blinov, A. R. Buzykaev, V. P. Druzhinin, E. A. Kozyrev, E. A. Kravchenko, S. I. Serednyakov, Yu. I. Skovpen, E. P. Solodov, K. Yu. Todyshev , et al. (186 additional authors not shown)

Abstract: Using the entire BaBar $Υ(4S)$ data set, the first two-dimensional unbinned angular analysis of the semileptonic decay $\overline{B} \rightarrow D \ell^- \overlineν_\ell$ is performed, employing hadronic reconstruction of the tag-side $B$ meson from $Υ(4S)\to B\overline{B}$. Here, $\ell$ denotes the light charged leptons $e$ and $μ$. A novel data-driven signal-background separation procedure with… ▽ More Using the entire BaBar $Υ(4S)$ data set, the first two-dimensional unbinned angular analysis of the semileptonic decay $\overline{B} \rightarrow D \ell^- \overlineν_\ell$ is performed, employing hadronic reconstruction of the tag-side $B$ meson from $Υ(4S)\to B\overline{B}$. Here, $\ell$ denotes the light charged leptons $e$ and $μ$. A novel data-driven signal-background separation procedure with minimal dependence on simulation is developed. This procedure preserves all multi-dimensional correlations present in the data. The expected $\sin^2θ_\ell$ dependence of the differential decay rate in the Standard Model is demonstrated, where $θ_\ell$ is the lepton helicity angle. Including input from the latest lattice QCD calculations and previously available experimental data, the underlying form factors are extracted using both model-independent (BGL) and dependent (CLN) methods. Comparisons with lattice calculations show flavor SU(3) symmetry to be a good approximation in the $B_{(s)}\to D_{(s)}$ sector. Using the BGL results, the CKM matrix element $|V_{cb}|=(41.09\pm 1.16)\times 10^{-3}$ and the Standard Model prediction of the lepton-flavor universality violation variable $\mathcal{R}(D)=0.300\pm 0.004$, are extracted. The value of $|V_{cb}|$ from $\overline{B} \rightarrow D \ell^- \overlineν_\ell$ tends to be higher than that extracted using $\overline{B} \rightarrow D \ell^- \overlineν_\ell$. The Standard Model $\mathcal{R}(D)$ calculation is at a $1.97σ$ tension with the latest HFLAV experimental average. △ Less

Submitted 25 November, 2023; originally announced November 2023.

Fast Trainable Projection for Robust Fine-Tuning

Authors: Junjiao Tian, Yen-Cheng Liu, James Seale Smith, Zsolt Kira

Abstract: Robust fine-tuning aims to achieve competitive in-distribution (ID) performance while maintaining the out-of-distribution (OOD) robustness of a pre-trained model when transferring it to a downstream task. Recently, projected gradient descent has been successfully used in robust fine-tuning by constraining the deviation from the initialization of the fine-tuned model explicitly through projection.… ▽ More Robust fine-tuning aims to achieve competitive in-distribution (ID) performance while maintaining the out-of-distribution (OOD) robustness of a pre-trained model when transferring it to a downstream task. Recently, projected gradient descent has been successfully used in robust fine-tuning by constraining the deviation from the initialization of the fine-tuned model explicitly through projection. However, algorithmically, two limitations prevent this method from being adopted more widely, scalability and efficiency. In this paper, we propose a new projection-based fine-tuning algorithm, Fast Trainable Projection (FTP) for computationally efficient learning of per-layer projection constraints, resulting in an average $35\%$ speedup on our benchmarks compared to prior works. FTP can be combined with existing optimizers such as AdamW, and be used in a plug-and-play fashion. Finally, we show that FTP is a special instance of hyper-optimizers that tune the hyper-parameters of optimizers in a learnable manner through nested differentiation. Empirically, we show superior robustness on OOD datasets, including domain shifts and natural corruptions, across four different vision tasks with five different pre-trained models. Additionally, we demonstrate that FTP is broadly applicable and beneficial to other learning scenarios such as low-label and continual learning settings thanks to its easy adaptability. The code will be available at https://github.com/GT-RIPL/FTP.git. △ Less

Submitted 29 October, 2023; originally announced October 2023.

Comments: Accepted to NeurIPS 2023

Machine learning potentials with Iterative Boltzmann Inversion: training to experiment

Authors: Sakib Matin, Alice Allen, Justin S. Smith, Nicholas Lubbers, Ryan B. Jadrich, Richard A. Messerly, Benjamin T. Nebgen, Ying Wai Li, Sergei Tretiak, Kipton Barros

Abstract: Methodologies for training machine learning potentials (MLPs) to quantum-mechanical simulation data have recently seen tremendous progress. Experimental data has a very different character than simulated data, and most MLP training procedures cannot be easily adapted to incorporate both types of data into the training process. We investigate a training procedure based on Iterative Boltzmann Invers… ▽ More Methodologies for training machine learning potentials (MLPs) to quantum-mechanical simulation data have recently seen tremendous progress. Experimental data has a very different character than simulated data, and most MLP training procedures cannot be easily adapted to incorporate both types of data into the training process. We investigate a training procedure based on Iterative Boltzmann Inversion that produces a pair potential correction to an existing MLP, using equilibrium radial distribution function data. By applying these corrections to a MLP for pure aluminum based on Density Functional Theory, we observe that the resulting model largely addresses previous overstructuring in the melt phase. Interestingly, the corrected MLP also exhibits improved performance in predicting experimental diffusion constants, which are not included in the training procedure. The presented method does not require auto-differentiating through a molecular dynamics solver, and does not make assumptions about the MLP architecture. The results suggest a practical framework of incorporating experimental data into machine learning models to improve accuracy of molecular dynamics simulations. △ Less

Submitted 10 July, 2023; originally announced July 2023.

Signatures of pressure-enhanced helimagnetic order in van der Waals multiferroic NiI$_2$

Authors: Connor A. Occhialini, Luiz G. P. Martins, Qian Song, Jesse S. Smith, Jesse Kapeghian, Danila Amoroso, Joshua J. Sanchez, Paolo Barone, Bertrand Dupé, Matthieu j. Verstraete, Jing Kong, Antia S. Botana, Riccardo Comin

Abstract: The van der Waals (vdW) type-II multiferroic NiI$_2$ has emerged as a candidate for exploring non-collinear magnetism and magnetoelectric effects in the 2D limit. Frustrated intralayer exchange interactions on a triangular lattice result in a helimagnetic ground state, with spin-induced improper ferroelectricity stabilized by the interlayer interactions. Here we investigate the magnetic and struct… ▽ More The van der Waals (vdW) type-II multiferroic NiI$_2$ has emerged as a candidate for exploring non-collinear magnetism and magnetoelectric effects in the 2D limit. Frustrated intralayer exchange interactions on a triangular lattice result in a helimagnetic ground state, with spin-induced improper ferroelectricity stabilized by the interlayer interactions. Here we investigate the magnetic and structural phase transitions in bulk NiI$_2$, using high-pressure Raman spectroscopy, optical linear dichroism, and x-ray diffraction. We obtain evidence for a significant pressure enhancement of the antiferromagnetic and helimagnetic transition temperatures, at rates of $\sim15.3/14.4$ K/GPa, respectively. These enhancements are attributed to a cooperative effect of pressure-enhanced interlayer and third-nearest-neighbor intralayer exchange. These results reveal a general path for obtaining high-temperature type-II multiferroicity via high pressures in vdW materials. △ Less

Submitted 20 June, 2023; originally announced June 2023.

HePCo: Data-Free Heterogeneous Prompt Consolidation for Continual Federated Learning

Authors: Shaunak Halbe, James Seale Smith, Junjiao Tian, Zsolt Kira

Abstract: In this paper, we focus on the important yet understudied problem of Continual Federated Learning (CFL), where a server communicates with a set of clients to incrementally learn new concepts over time without sharing or storing any data. The complexity of this problem is compounded by challenges from both the Continual and Federated Learning perspectives. Specifically, models trained in a CFL setu… ▽ More In this paper, we focus on the important yet understudied problem of Continual Federated Learning (CFL), where a server communicates with a set of clients to incrementally learn new concepts over time without sharing or storing any data. The complexity of this problem is compounded by challenges from both the Continual and Federated Learning perspectives. Specifically, models trained in a CFL setup suffer from catastrophic forgetting which is exacerbated by data heterogeneity across clients. Existing attempts at this problem tend to impose large overheads on clients and communication channels or require access to stored data which renders them unsuitable for real-world use due to privacy. In this paper, we attempt to tackle forgetting and heterogeneity while minimizing overhead costs and without requiring access to any stored data. We achieve this by leveraging a prompting based approach (such that only prompts and classifier heads have to be communicated) and proposing a novel and lightweight generation and distillation scheme to consolidate client models at the server. We formulate this problem for image classification and establish strong baselines for comparison, conduct experiments on CIFAR-100 as well as challenging, large-scale datasets like ImageNet-R and DomainNet. Our approach outperforms both existing methods and our own baselines by as much as 7% while significantly reducing communication and client-level computation costs. △ Less

Submitted 16 June, 2023; originally announced June 2023.

Effects of Pressure on the Electronic and Magnetic Properties of Bulk NiI$_{2}$

Authors: Jesse Kapeghian, Danila Amoroso, Connor A. Occhialini, Luiz G. P. Martins, Qian Song, Jesse S. Smith, Joshua J. Sanchez, Jing Kong, Riccardo Comin, Paolo Barone, Bertrand Dupé, Matthieu J. Verstraete, Antia S. Botana

Abstract: Transition metal dihalides have recently garnered interest in the context of two-dimensional van der Waals magnets as their underlying geometrically frustrated triangular lattice leads to interesting competing exchange interactions. In particular, NiI$_{2}$ is a magnetic semiconductor that has been long known for its exotic helimagnetism in the bulk. Recent experiments have shown that the helimagn… ▽ More Transition metal dihalides have recently garnered interest in the context of two-dimensional van der Waals magnets as their underlying geometrically frustrated triangular lattice leads to interesting competing exchange interactions. In particular, NiI$_{2}$ is a magnetic semiconductor that has been long known for its exotic helimagnetism in the bulk. Recent experiments have shown that the helimagnetic state survives down to the monolayer limit with a layer-dependent magnetic transition temperature that suggests a relevant role of the interlayer coupling. Here, we explore the effects of hydrostatic pressure as a means to enhance this interlayer exchange and ultimately tune the electronic and magnetic response of NiI$_{2}$. We study first the evolution of the structural parameters as a function of external pressure using first-principles calculations combined with x-ray diffraction measurements. We then examine the evolution of the electronic structure and magnetic exchange interactions via first-principles calculations and Monte Carlo simulations. We find that the leading interlayer coupling is an antiferromagnetic second-nearest neighbor interaction that increases monotonically with pressure. The ratio between isotropic third- and first-nearest neighbor intralayer exchanges, which controls the magnetic frustration and determines the magnetic propagation vector $\mathbf{q}$ of the helimagnetic ground state, is also enhanced by pressure. As a consequence, our Monte Carlo simulations show a monotonic increase in the magnetic transition temperature, indicating that pressure is an effective means to tune the magnetic response of NiI$_{2}$. △ Less

Submitted 7 June, 2023; originally announced June 2023.

Assessing the stability fields of molecular and polymeric CO2

Authors: Alexander F. Goncharov, Elena Bykova, Maxim Bykov, Eric Edmund, Jesse S. Smith, Stella Chariton, Vitali B. Prakapenka

Abstract: We investigated the stability of polymeric CO2 over a wide range of pressures, temperatures, and chemical environments. We find that the I-42d polymeric structure, consisting of a three-dimensional network of corner sharing CO4 tetrahedra, forms at 40-140 GPa and from a CO-N2 mixture at 39 GPa. An exceptional stability field of 0 to 286 GPa and 100 to 2500 K is documented for this structure, makin… ▽ More We investigated the stability of polymeric CO2 over a wide range of pressures, temperatures, and chemical environments. We find that the I-42d polymeric structure, consisting of a three-dimensional network of corner sharing CO4 tetrahedra, forms at 40-140 GPa and from a CO-N2 mixture at 39 GPa. An exceptional stability field of 0 to 286 GPa and 100 to 2500 K is documented for this structure, making it a viable candidate for planetary interiors. The stability of the tetrahedral polymeric motif of CO2-V is a consequence of the rigidity of sp3 hybridized orbitals of carbon in a closed-packed oxygen sublattice. △ Less

Submitted 21 April, 2023; originally announced April 2023.

Comments: 15 pages, 9 figures Supplementary Materials 6 pages, 1 table

Continual Diffusion: Continual Customization of Text-to-Image Diffusion with C-LoRA

Authors: James Seale Smith, Yen-Chang Hsu, Lingyu Zhang, Ting Hua, Zsolt Kira, Yilin Shen, Hongxia Jin

Abstract: Recent works demonstrate a remarkable ability to customize text-to-image diffusion models while only providing a few example images. What happens if you try to customize such models using multiple, fine-grained concepts in a sequential (i.e., continual) manner? In our work, we show that recent state-of-the-art customization of text-to-image models suffer from catastrophic forgetting when new conce… ▽ More Recent works demonstrate a remarkable ability to customize text-to-image diffusion models while only providing a few example images. What happens if you try to customize such models using multiple, fine-grained concepts in a sequential (i.e., continual) manner? In our work, we show that recent state-of-the-art customization of text-to-image models suffer from catastrophic forgetting when new concepts arrive sequentially. Specifically, when adding a new concept, the ability to generate high quality images of past, similar concepts degrade. To circumvent this forgetting, we propose a new method, C-LoRA, composed of a continually self-regularized low-rank adaptation in cross attention layers of the popular Stable Diffusion model. Furthermore, we use customization prompts which do not include the word of the customized object (i.e., "person" for a human face dataset) and are initialized as completely random embeddings. Importantly, our method induces only marginal additional parameter costs and requires no storage of user data for replay. We show that C-LoRA not only outperforms several baselines for our proposed setting of text-to-image continual customization, which we refer to as Continual Diffusion, but that we achieve a new state-of-the-art in the well-established rehearsal-free continual learning setting for image classification. The high achieving performance of C-LoRA in two separate domains positions it as a compelling solution for a wide range of applications, and we believe it has significant potential for practical impact. Project page: https://jamessealesmith.github.io/continual-diffusion/ △ Less

Submitted 2 May, 2024; v1 submitted 12 April, 2023; originally announced April 2023.

Comments: Transactions on Machine Learning Research (TMLR) 2024

Going Beyond Nouns With Vision & Language Models Using Synthetic Data

Authors: Paola Cascante-Bonilla, Khaled Shehada, James Seale Smith, Sivan Doveh, Donghyun Kim, Rameswar Panda, Gül Varol, Aude Oliva, Vicente Ordonez, Rogerio Feris, Leonid Karlinsky

Abstract: Large-scale pre-trained Vision & Language (VL) models have shown remarkable performance in many applications, enabling replacing a fixed set of supported classes with zero-shot open vocabulary reasoning over (almost arbitrary) natural language prompts. However, recent works have uncovered a fundamental weakness of these models. For example, their difficulty to understand Visual Language Concepts (… ▽ More Large-scale pre-trained Vision & Language (VL) models have shown remarkable performance in many applications, enabling replacing a fixed set of supported classes with zero-shot open vocabulary reasoning over (almost arbitrary) natural language prompts. However, recent works have uncovered a fundamental weakness of these models. For example, their difficulty to understand Visual Language Concepts (VLC) that go 'beyond nouns' such as the meaning of non-object words (e.g., attributes, actions, relations, states, etc.), or difficulty in performing compositional reasoning such as understanding the significance of the order of the words in a sentence. In this work, we investigate to which extent purely synthetic data could be leveraged to teach these models to overcome such shortcomings without compromising their zero-shot capabilities. We contribute Synthetic Visual Concepts (SyViC) - a million-scale synthetic dataset and data generation codebase allowing to generate additional suitable data to improve VLC understanding and compositional reasoning of VL models. Additionally, we propose a general VL finetuning strategy for effectively leveraging SyViC towards achieving these improvements. Our extensive experiments and ablations on VL-Checklist, Winoground, and ARO benchmarks demonstrate that it is possible to adapt strong pre-trained VL models with synthetic data significantly enhancing their VLC understanding (e.g. by 9.9% on ARO and 4.3% on VL-Checklist) with under 1% drop in their zero-shot accuracy. △ Less

Submitted 30 August, 2023; v1 submitted 30 March, 2023; originally announced March 2023.

Comments: Accepted to ICCV 2023. Project page: https://synthetic-vic.github.io/

Search for $B$ Mesogenesis at BABAR

Authors: BABAR Collaboration, J. P. Lees, V. Poireau, V. Tisserand, E. Grauges, A. Palano, G. Eigen, D. N. Brown, Yu. G. Kolomensky, M. Fritsch, H. Koch, R. Cheaib, C. Hearty, T. S. Mattison, J. A. McKenna, R. Y. So, V. E. Blinov, A. R. Buzykaev, V. P. Druzhinin, V. B. Golubev, E. A. Kozyrev, E. A. Kravchenko, A. P. Onuchin, S. I. Serednyakov, Yu. I. Skovpen , et al. (218 additional authors not shown)

Abstract: A new mechanism has been proposed to simultaneously explain the presence of dark matter and the matter-antimatter asymmetry in the universe. This scenario predicts exotic $B$ meson decays into a baryon and a dark sector anti-baryon ($ψ_D$) with branching fractions accessible at $B$ factories. We present a search for $B \rightarrow Λψ_D$ decays using data collected by the $BABAR$ experiment at SLAC… ▽ More A new mechanism has been proposed to simultaneously explain the presence of dark matter and the matter-antimatter asymmetry in the universe. This scenario predicts exotic $B$ meson decays into a baryon and a dark sector anti-baryon ($ψ_D$) with branching fractions accessible at $B$ factories. We present a search for $B \rightarrow Λψ_D$ decays using data collected by the $BABAR$ experiment at SLAC. This reaction is identified by fully reconstructing the accompanying $B$ meson and requiring the presence of a single $Λ$ baryon in the remaining particles. No significant signal is observed, and bounds on the $B \rightarrow Λψ_D$ branching fraction are derived in the range $0.13 - 5.2\times 10^{-5}$ for $1.0 < m_{ψ_D} < 4.2$ GeV/$c^{2}$. These results set strong constraints on the parameter space allowed by the theory. △ Less

Submitted 31 January, 2023; originally announced February 2023.

Journal ref: PHYS. REV. D 107, 092001 (2023)

The James Webb Space Telescope Mission: Optical Telescope Element Design, Development, and Performance

Authors: Michael W. McElwain, Lee D. Feinberg, Marshall D. Perrin, Mark Clampin, C. Matt Mountain, Matthew D. Lallo, Charles-Philippe Lajoie, Randy A. Kimble, Charles W. Bowers, Christopher C. Stark, D. Scott Acton, Ken Aiello, Charles Atkinson, Beth Barinek, Allison Barto, Scott Basinger, Tracy Beck, Matthew D. Bergkoetter, Marcel Bluth, Rene A. Boucarut, Gregory R. Brady, Keira J. Brooks, Bob Brown, John Byard, Larkin Carey , et al. (104 additional authors not shown)

Abstract: The James Webb Space Telescope (JWST) is a large, infrared space telescope that has recently started its science program which will enable breakthroughs in astrophysics and planetary science. Notably, JWST will provide the very first observations of the earliest luminous objects in the Universe and start a new era of exoplanet atmospheric characterization. This transformative science is enabled by… ▽ More The James Webb Space Telescope (JWST) is a large, infrared space telescope that has recently started its science program which will enable breakthroughs in astrophysics and planetary science. Notably, JWST will provide the very first observations of the earliest luminous objects in the Universe and start a new era of exoplanet atmospheric characterization. This transformative science is enabled by a 6.6 m telescope that is passively cooled with a 5-layer sunshield. The primary mirror is comprised of 18 controllable, low areal density hexagonal segments, that were aligned and phased relative to each other in orbit using innovative image-based wavefront sensing and control algorithms. This revolutionary telescope took more than two decades to develop with a widely distributed team across engineering disciplines. We present an overview of the telescope requirements, architecture, development, superb on-orbit performance, and lessons learned. JWST successfully demonstrates a segmented aperture space telescope and establishes a path to building even larger space telescopes. △ Less

Submitted 4 January, 2023; originally announced January 2023.

Comments: accepted by PASP for JWST Overview Special Issue; 34 pages, 25 figures

Lightweight and Effective Tensor Sensitivity for Atomistic Neural Networks

Authors: Michael Chigaev, Justin S. Smith, Steven Anaya, Benjamin Nebgen, Matthew Bettencourt, Kipton Barros, Nicholas Lubbers

Abstract: Atomistic machine learning focuses on the creation of models which obey fundamental symmetries of atomistic configurations, such as permutation, translation, and rotation invariances. In many of these schemes, translation and rotation invariance are achieved by building on scalar invariants, e.g., distances between atom pairs. There is growing interest in molecular representations that work intern… ▽ More Atomistic machine learning focuses on the creation of models which obey fundamental symmetries of atomistic configurations, such as permutation, translation, and rotation invariances. In many of these schemes, translation and rotation invariance are achieved by building on scalar invariants, e.g., distances between atom pairs. There is growing interest in molecular representations that work internally with higher rank rotational tensors, e.g., vector displacements between atoms, and tensor products thereof. Here we present a framework for extending the Hierarchically Interacting Particle Neural Network (HIP-NN) with Tensor Sensitivity information (HIP-NN-TS) from each local atomic environment. Crucially, the method employs a weight tying strategy that allows direct incorporation of many-body information while adding very few model parameters. We show that HIP-NN-TS is more accurate than HIP-NN, with negligible increase in parameter count, for several datasets and network sizes. As the dataset becomes more complex, tensor sensitivities provide greater improvements to model accuracy. In particular, HIP-NN-TS achieves a record mean absolute error of 0.927 kcal/mol for conformational energy variation on the challenging COMP6 benchmark, which includes a broad set of organic molecules. We also compare the computational performance of HIP-NN-TS to HIP-NN and other models in the literature. △ Less

Submitted 26 April, 2023; v1 submitted 6 December, 2022; originally announced December 2022.

CODA-Prompt: COntinual Decomposed Attention-based Prompting for Rehearsal-Free Continual Learning

Authors: James Seale Smith, Leonid Karlinsky, Vyshnavi Gutta, Paola Cascante-Bonilla, Donghyun Kim, Assaf Arbelle, Rameswar Panda, Rogerio Feris, Zsolt Kira

Abstract: Computer vision models suffer from a phenomenon known as catastrophic forgetting when learning novel concepts from continuously shifting training data. Typical solutions for this continual learning problem require extensive rehearsal of previously seen data, which increases memory costs and may violate data privacy. Recently, the emergence of large-scale pre-trained vision transformer models has e… ▽ More Computer vision models suffer from a phenomenon known as catastrophic forgetting when learning novel concepts from continuously shifting training data. Typical solutions for this continual learning problem require extensive rehearsal of previously seen data, which increases memory costs and may violate data privacy. Recently, the emergence of large-scale pre-trained vision transformer models has enabled prompting approaches as an alternative to data-rehearsal. These approaches rely on a key-query mechanism to generate prompts and have been found to be highly resistant to catastrophic forgetting in the well-established rehearsal-free continual learning setting. However, the key mechanism of these methods is not trained end-to-end with the task sequence. Our experiments show that this leads to a reduction in their plasticity, hence sacrificing new task accuracy, and inability to benefit from expanded parameter capacity. We instead propose to learn a set of prompt components which are assembled with input-conditioned weights to produce input-conditioned prompts, resulting in a novel attention-based end-to-end key-query scheme. Our experiments show that we outperform the current SOTA method DualPrompt on established benchmarks by as much as 4.5% in average final accuracy. We also outperform the state of art by as much as 4.4% accuracy on a continual learning benchmark which contains both class-incremental and domain-incremental task shifts, corresponding to many practical settings. Our code is available at https://github.com/GT-RIPL/CODA-Prompt △ Less

Submitted 30 March, 2023; v1 submitted 23 November, 2022; originally announced November 2022.

Comments: Accepted by the 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2023)

On the Transferability of Visual Features in Generalized Zero-Shot Learning

Authors: Paola Cascante-Bonilla, Leonid Karlinsky, James Seale Smith, Yanjun Qi, Vicente Ordonez

Abstract: Generalized Zero-Shot Learning (GZSL) aims to train a classifier that can generalize to unseen classes, using a set of attributes as auxiliary information, and the visual features extracted from a pre-trained convolutional neural network. While recent GZSL methods have explored various techniques to leverage the capacity of these features, there has been an extensive growth of representation learn… ▽ More Generalized Zero-Shot Learning (GZSL) aims to train a classifier that can generalize to unseen classes, using a set of attributes as auxiliary information, and the visual features extracted from a pre-trained convolutional neural network. While recent GZSL methods have explored various techniques to leverage the capacity of these features, there has been an extensive growth of representation learning techniques that remain under-explored. In this work, we investigate the utility of different GZSL methods when using different feature extractors, and examine how these models' pre-training objectives, datasets, and architecture design affect their feature representation ability. Our results indicate that 1) methods using generative components for GZSL provide more advantages when using recent feature extractors; 2) feature extractors pre-trained using self-supervised learning objectives and knowledge distillation provide better feature representations, increasing up to 15% performance when used with recent GZSL techniques; 3) specific feature extractors pre-trained with larger datasets do not necessarily boost the performance of GZSL methods. In addition, we investigate how GZSL methods fare against CLIP, a more recent multi-modal pre-trained model with strong zero-shot performance. We found that GZSL tasks still benefit from generative-based GZSL methods along with CLIP's internet-scale pre-training to achieve state-of-the-art performance in fine-grained datasets. We release a modular framework for analyzing representation learning issues in GZSL here: https://github.com/uvavision/TV-GZSL △ Less

Submitted 22 November, 2022; originally announced November 2022.

ConStruct-VL: Data-Free Continual Structured VL Concepts Learning

Authors: James Seale Smith, Paola Cascante-Bonilla, Assaf Arbelle, Donghyun Kim, Rameswar Panda, David Cox, Diyi Yang, Zsolt Kira, Rogerio Feris, Leonid Karlinsky

Abstract: Recently, large-scale pre-trained Vision-and-Language (VL) foundation models have demonstrated remarkable capabilities in many zero-shot downstream tasks, achieving competitive results for recognizing objects defined by as little as short text prompts. However, it has also been shown that VL models are still brittle in Structured VL Concept (SVLC) reasoning, such as the ability to recognize object… ▽ More Recently, large-scale pre-trained Vision-and-Language (VL) foundation models have demonstrated remarkable capabilities in many zero-shot downstream tasks, achieving competitive results for recognizing objects defined by as little as short text prompts. However, it has also been shown that VL models are still brittle in Structured VL Concept (SVLC) reasoning, such as the ability to recognize object attributes, states, and inter-object relations. This leads to reasoning mistakes, which need to be corrected as they occur by teaching VL models the missing SVLC skills; often this must be done using private data where the issue was found, which naturally leads to a data-free continual (no task-id) VL learning setting. In this work, we introduce the first Continual Data-Free Structured VL Concepts Learning (ConStruct-VL) benchmark and show it is challenging for many existing data-free CL strategies. We, therefore, propose a data-free method comprised of a new approach of Adversarial Pseudo-Replay (APR) which generates adversarial reminders of past tasks from past task models. To use this method efficiently, we also propose a continual parameter-efficient Layered-LoRA (LaLo) neural architecture allowing no-memory-cost access to all past models at train time. We show this approach outperforms all data-free methods by as much as ~7% while even matching some levels of experience-replay (prohibitive for applications where data-privacy must be preserved). Our code is publicly available at https://github.com/jamessealesmith/ConStruct-VL △ Less

Submitted 30 March, 2023; v1 submitted 17 November, 2022; originally announced November 2022.

Comments: Accepted by the 2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2023)

FedFOR: Stateless Heterogeneous Federated Learning with First-Order Regularization

Authors: Junjiao Tian, James Seale Smith, Zsolt Kira

Abstract: Federated Learning (FL) seeks to distribute model training across local clients without collecting data in a centralized data-center, hence removing data-privacy concerns. A major challenge for FL is data heterogeneity (where each client's data distribution can differ) as it can lead to weight divergence among local clients and slow global convergence. The current SOTA FL methods designed for data… ▽ More Federated Learning (FL) seeks to distribute model training across local clients without collecting data in a centralized data-center, hence removing data-privacy concerns. A major challenge for FL is data heterogeneity (where each client's data distribution can differ) as it can lead to weight divergence among local clients and slow global convergence. The current SOTA FL methods designed for data heterogeneity typically impose regularization to limit the impact of non-IID data and are stateful algorithms, i.e., they maintain local statistics over time. While effective, these approaches can only be used for a special case of FL involving only a small number of reliable clients. For the more typical applications of FL where the number of clients is large (e.g., edge-device and mobile applications), these methods cannot be applied, motivating the need for a stateless approach to heterogeneous FL which can be used for any number of clients. We derive a first-order gradient regularization to penalize inconsistent local updates due to local data heterogeneity. Specifically, to mitigate weight divergence, we introduce a first-order approximation of the global data distribution into local objectives, which intuitively penalizes updates in the opposite direction of the global update. The end result is a stateless FL algorithm that achieves 1) significantly faster convergence (i.e., fewer communication rounds) and 2) higher overall converged performance than SOTA methods under non-IID data distribution. Importantly, our approach does not impose unrealistic limits on the client size, enabling learning from a large number of clients as is typical in most FL applications. △ Less

Submitted 21 September, 2022; originally announced September 2022.

Ambient temperature pressure driven alkane dehydrogenation by palladium metal

Authors: Mungo Frost, Emma E. McBride, Dean Smith, Jesse S. Smith, Siegfried Glenzer

Abstract: Dehydrogenation of alkanes is of increasing importance in fulfilling global demand for olefins and offers a potential source of carbon-neutral hydrogen as a co-product. Currently commercial dehydrogenation processes occur at high-temperatures (500-900$^\circ$C) which is energy intensive and results in side reactions and rapid coking of the catalysts. In addition the hydrogen produced is often burn… ▽ More Dehydrogenation of alkanes is of increasing importance in fulfilling global demand for olefins and offers a potential source of carbon-neutral hydrogen as a co-product. Currently commercial dehydrogenation processes occur at high-temperatures (500-900$^\circ$C) which is energy intensive and results in side reactions and rapid coking of the catalysts. In addition the hydrogen produced is often burned to maintain temperature and to inhibit the back reaction. Here we demonstrate pressure as a parameter to enable novel chemical catalytic processes and demonstrate ambient-temperature dehydrogenation of alkanes by palladium at 50-100 MPa pressures, with both hydrogen gas and olefins recovered on decompression. This reaction follows a fundamentally different path to current commercial high-temperature low-pressure dehydrogenation processes with the palladium catalyst reversibly forming a hydride intermediate. △ Less

Submitted 26 July, 2022; originally announced July 2022.

Comments: Main article: 12 pages and 8 figures, Supplemental follows main article with 4 pages and 3 figures

3D Random Occlusion and Multi-Layer Projection for Deep Multi-Camera Pedestrian Localization

Authors: Rui Qiu, Ming Xu, Yuyao Yan, Jeremy S. Smith, Xi Yang

Abstract: Although deep-learning based methods for monocular pedestrian detection have made great progress, they are still vulnerable to heavy occlusions. Using multi-view information fusion is a potential solution but has limited applications, due to the lack of annotated training samples in existing multi-view datasets, which increases the risk of overfitting. To address this problem, a data augmentation… ▽ More Although deep-learning based methods for monocular pedestrian detection have made great progress, they are still vulnerable to heavy occlusions. Using multi-view information fusion is a potential solution but has limited applications, due to the lack of annotated training samples in existing multi-view datasets, which increases the risk of overfitting. To address this problem, a data augmentation method is proposed to randomly generate 3D cylinder occlusions, on the ground plane, which are of the average size of pedestrians and projected to multiple views, to relieve the impact of overfitting in the training. Moreover, the feature map of each view is projected to multiple parallel planes at different heights, by using homographies, which allows the CNNs to fully utilize the features across the height of each pedestrian to infer the locations of pedestrians on the ground plane. The proposed 3DROM method has a greatly improved performance in comparison with the state-of-the-art deep-learning based methods for multi-view pedestrian detection. △ Less

Submitted 25 July, 2022; v1 submitted 22 July, 2022; originally announced July 2022.

Journal ref: European Conference on Computer Vision 2022

Incremental Learning with Differentiable Architecture and Forgetting Search

Authors: James Seale Smith, Zachary Seymour, Han-Pang Chiu

Abstract: As progress is made on training machine learning models on incrementally expanding classification tasks (i.e., incremental learning), a next step is to translate this progress to industry expectations. One technique missing from incremental learning is automatic architecture design via Neural Architecture Search (NAS). In this paper, we show that leveraging NAS for incremental learning results in… ▽ More As progress is made on training machine learning models on incrementally expanding classification tasks (i.e., incremental learning), a next step is to translate this progress to industry expectations. One technique missing from incremental learning is automatic architecture design via Neural Architecture Search (NAS). In this paper, we show that leveraging NAS for incremental learning results in strong performance gains for classification tasks. Specifically, we contribute the following: first, we create a strong baseline approach for incremental learning based on Differentiable Architecture Search (DARTS) and state-of-the-art incremental learning strategies, outperforming many existing strategies trained with similar-sized popular architectures; second, we extend the idea of architecture search to regularize architecture forgetting, boosting performance past our proposed baseline. We evaluate our method on both RF signal and image classification tasks, and demonstrate we can achieve up to a 10% performance increase over state-of-the-art methods. Most importantly, our contribution enables learning from continuous distributions on real-world application data for which the complexity of the data distribution is unknown, or the modality less explored (such as RF signal classification). △ Less

Submitted 19 May, 2022; originally announced May 2022.

Comments: Accepted by the 2022 International Joint Conference on Neural Networks (IJCNN 2022)

A Closer Look at Rehearsal-Free Continual Learning

Authors: James Seale Smith, Junjiao Tian, Shaunak Halbe, Yen-Chang Hsu, Zsolt Kira

Abstract: Continual learning is a setting where machine learning models learn novel concepts from continuously shifting training data, while simultaneously avoiding degradation of knowledge on previously seen classes which may disappear from the training data for extended periods of time (a phenomenon known as the catastrophic forgetting problem). Current approaches for continual learning of a single expand… ▽ More Continual learning is a setting where machine learning models learn novel concepts from continuously shifting training data, while simultaneously avoiding degradation of knowledge on previously seen classes which may disappear from the training data for extended periods of time (a phenomenon known as the catastrophic forgetting problem). Current approaches for continual learning of a single expanding task (aka class-incremental continual learning) require extensive rehearsal of previously seen data to avoid this degradation of knowledge. Unfortunately, rehearsal comes at a cost to memory, and it may also violate data-privacy. Instead, we explore combining knowledge distillation and parameter regularization in new ways to achieve strong continual learning performance without rehearsal. Specifically, we take a deep dive into common continual learning techniques: prediction distillation, feature distillation, L2 parameter regularization, and EWC parameter regularization. We first disprove the common assumption that parameter regularization techniques fail for rehearsal-free continual learning of a single, expanding task. Next, we explore how to leverage knowledge from a pre-trained model in rehearsal-free continual learning and find that vanilla L2 parameter regularization outperforms EWC parameter regularization and feature distillation. Finally, we explore the recently popular ImageNet-R benchmark, and show that L2 parameter regularization implemented in self-attention blocks of a ViT transformer outperforms recent popular prompting for continual learning methods. △ Less

Submitted 3 April, 2023; v1 submitted 31 March, 2022; originally announced March 2022.

Comments: Accepted by the 2023 IEEE/CVF Conference on Computer Vision and Pattern (CVPR) Workshop on Continual Learning in Computer Vision (CLVision 2023)

Microscopic quantum point contact formation as the electromigration mechanism in granular superconductor nanowires

Authors: T. C. Bartolo, J. S. Smith, Yannick Schön, Jan Nicolas Voss, M. J. Cyster, A. V. Ustinov, H. Rotzinger, J. H. Cole

Abstract: Granular aluminium is a high kinetic inductance thin film superconductor which, when formed into nanowires can undergo an intrinsic electromigration process. We use a combination of experimental and computational approaches to investigate the role of grain morphology and distribution in granular aluminium thin films, when formed into nanowire constrictions. Treating the granular aluminium film as… ▽ More Granular aluminium is a high kinetic inductance thin film superconductor which, when formed into nanowires can undergo an intrinsic electromigration process. We use a combination of experimental and computational approaches to investigate the role of grain morphology and distribution in granular aluminium thin films, when formed into nanowire constrictions. Treating the granular aluminium film as a network of randomly distributed resistors with parameters motivated by the film microstructure allows us to model the electrical characteristics of the nanowires. This model provides estimates of the dependence of sheet resistance on grain size and distribution, and the resulting device to device variation for superconducting nanowires. By fabricating a series of different length nanowires, we study the electromigration process as a function of applied current, and then compare directly to the results of our computational model. In doing so we show that the electromigration is driven by the formation of quantum point contacts between metallic aluminium grains. △ Less

Submitted 24 November, 2021; originally announced November 2021.

Comments: 11 pages, 11 figures

Structure and vibrational properties of methane up to 71 GPa

Authors: Maxim Bykov, Elena Bykova, Chris J. Pickard, Miguel Martinez-Canales, Konstantin Glazyrin, Jesse S. Smith, Alexander F. Goncharov

Abstract: Single-crystal synchrotron X-ray diffraction, Raman spectroscopy, and first principles calculations have been used to identify the structure of the high-pressure (HP) phase of molecular methane above 20 GPa up to 71 GPa. The structure of HP phase is trigonal R3, which can be represented as a distortion of the cubic phase B, previously documented at 7-15 GPa and confirmed here. The positions of hyd… ▽ More Single-crystal synchrotron X-ray diffraction, Raman spectroscopy, and first principles calculations have been used to identify the structure of the high-pressure (HP) phase of molecular methane above 20 GPa up to 71 GPa. The structure of HP phase is trigonal R3, which can be represented as a distortion of the cubic phase B, previously documented at 7-15 GPa and confirmed here. The positions of hydrogen atoms in HP phase have been 19 obtained from first principles calculations. The molecules occupy four different crystallographic sites in phases B and eleven sites in the HP phase, which result in splitting of molecular stretching modes detected in Raman spectroscopy and assigned here based on 22 a good agreement with the Raman spectra calculated from the first principles. △ Less

Submitted 14 October, 2021; originally announced October 2021.

Comments: 29 pages, 7 figures, 3 tables, supplemental material

Pressure-induced insulator-metal transition in two-dimensional Mott insulator NiPS3

Authors: Takahiro Matsuoka, Amanda Haglund, Rui Xue, Jesse S. Smith, Maik Lang, Antonio M. dos Santos, David Mandrus

Abstract: The pressure-induced insulator to metal transition (IMT) of layered magnetic nickel phosphorous tri-sulfide NiPS3 was studied in-situ under quasi-uniaxial conditions by means of electrical resistance (R) and X-ray diffraction (XRD) measurements. This sluggish transition is shown to occur at 35 GPa. Transport measurements show no evidence of superconductivity to the lowest measured temperature (~ 2… ▽ More The pressure-induced insulator to metal transition (IMT) of layered magnetic nickel phosphorous tri-sulfide NiPS3 was studied in-situ under quasi-uniaxial conditions by means of electrical resistance (R) and X-ray diffraction (XRD) measurements. This sluggish transition is shown to occur at 35 GPa. Transport measurements show no evidence of superconductivity to the lowest measured temperature (~ 2 K). The structure results presented here differ from earlier in-situ work that subjected the sample to a different pressure state, suggesting that in NiPS3 the phase stability fields are highly dependent on strain. It is suggested that careful control of the strain is essential when studying the electronic and magnetic properties of layered van der Waals solids. △ Less

Submitted 26 August, 2021; originally announced August 2021.

Quantum-based Molecular Dynamics Simulations Using Tensor Cores

Authors: Joshua Finkelstein, Justin S. Smith, Susan M. Mniszewski, Kipton Barros, Christian F. A. Negre, Emanuel H. Rubensson, Anders M. N. Niklasson

Abstract: Tensor cores, along with tensor processing units, represent a new form of hardware acceleration specifically designed for deep neural network calculations in artificial intelligence applications. Tensor cores provide extraordinary computational speed and energy efficiency, but with the caveat that they were designed for tensor contractions (matrix-matrix multiplications) using only low-precision f… ▽ More Tensor cores, along with tensor processing units, represent a new form of hardware acceleration specifically designed for deep neural network calculations in artificial intelligence applications. Tensor cores provide extraordinary computational speed and energy efficiency, but with the caveat that they were designed for tensor contractions (matrix-matrix multiplications) using only low-precision floating point operations. In spite of this, we demonstrate how tensor cores can be applied with high efficiency to the challenging and numerically sensitive problem of quantum-based Born-Oppenheimer molecular dynamics, which requires highly accurate electronic structure optimizations and conservative force evaluations. The interatomic forces are calculated on-the-fly from an electronic structure that is obtained from a generalized deep neural network, where the computational structure naturally takes advantage of the exceptional processing power of the tensor cores and allows for high performance in excess of 100 Tflops on the tensor cores of a single Nvidia A100 GPU. Stable molecular dynamics trajectories are generated using the framework of extended Lagrangian Born-Oppenheimer molecular dynamics, which combines computational efficiency with long-term stability, even when using approximate charge relaxations and force evaluations that are limited in accuracy by the numerically noisy conditions caused by the low precision tensor core floating-point operations. A canonical ensemble simulation scheme is also presented, where the additional numerical noise in the calculated forces is absorbed into a Langevin-like dynamics. △ Less

Submitted 10 September, 2021; v1 submitted 6 July, 2021; originally announced July 2021.

Comments: 20 pages, 9 figures

Report number: LA-UR-21-25427

Influence of device geometry and imperfections on the interpretation of transverse magnetic focusing experiments

Authors: Yik K. Lee, Jackson S. Smith, Jared H. Cole

Abstract: Spatially separating electrons of different spins and efficiently generating spin currents are crucial steps towards building practical spintronics devices. Transverse magnetic focusing is a potential technique to accomplish both those tasks. In a material where there is significant Rashba spin--orbit interaction, electrons of different spins will traverse different paths in the presence of an ext… ▽ More Spatially separating electrons of different spins and efficiently generating spin currents are crucial steps towards building practical spintronics devices. Transverse magnetic focusing is a potential technique to accomplish both those tasks. In a material where there is significant Rashba spin--orbit interaction, electrons of different spins will traverse different paths in the presence of an external magnetic field. Experiments have demonstrated the viability of this technique by measuring conductance spectra that indicate the separation of spin-up and spin-down electrons. However the effect that the geometry of the leads has on these measurements is not well understood. We show that the resolution of features in the conductance spectra is affected by the shape, separation and width of the leads. Furthermore, the number of subbands occupied by the electrons in the leads affects the ratio between the amplitudes of the spin-split peaks in the spectra. We simulated devices with random onsite potentials and observed that transverse magnetic focusing devices are sensitive to disorder. Ultimately we show that careful choice and characterisation of device geometry is crucial for correctly interpreting the results of transverse magnetic focusing experiments. △ Less

Submitted 18 March, 2022; v1 submitted 26 April, 2021; originally announced April 2021.

Comments: 13 pages, 13 figures. Final version with minor revisions from previous version

NavTuner: Learning a Scene-Sensitive Family of Navigation Policies

Authors: Haoxin Ma, Justin S. Smith, Patricio A. Vela

Abstract: The advent of deep learning has inspired research into end-to-end learning for a variety of problem domains in robotics. For navigation, the resulting methods may not have the generalization properties desired let alone match the performance of traditional methods. Instead of learning a navigation policy, we explore learning an adaptive policy in the parameter space of an existing navigation modul… ▽ More The advent of deep learning has inspired research into end-to-end learning for a variety of problem domains in robotics. For navigation, the resulting methods may not have the generalization properties desired let alone match the performance of traditional methods. Instead of learning a navigation policy, we explore learning an adaptive policy in the parameter space of an existing navigation module. Having adaptive parameters provides the navigation module with a family of policies that can be dynamically reconfigured based on the local scene structure, and addresses the common assertion in machine learning that engineered solutions are inflexible. Of the methods tested, reinforcement learning (RL) is shown to provide a significant performance boost to a modern navigation method through reduced sensitivity of its success rate to environmental clutter. The outcomes indicate that RL as a meta-policy learner, or dynamic parameter tuner, effectively robustifies algorithms sensitive to external, measurable nuisance factors. △ Less

Submitted 1 March, 2021; originally announced March 2021.

Implications of an improved water equation of state for water-rich planets

Authors: Chenliang Huang, David R. Rice, Zachary M. Grande, Dean Smith, Jesse S. Smith, John H. Boisvert, Oliver Tschauner, Ashkan Salamat, Jason H. Steffen

Abstract: Water (H$_{2}$O), in all forms, is an important constituent in planetary bodies, controlling habitability and influencing geological activity. Under conditions found in the interior of many planets, as the pressure increases, the H-bonds in water gradually weaken and are replaced by ionic bonds. Recent experimental measurements of the water equation of state (EOS) showed both a new phase of H-bond… ▽ More Water (H$_{2}$O), in all forms, is an important constituent in planetary bodies, controlling habitability and influencing geological activity. Under conditions found in the interior of many planets, as the pressure increases, the H-bonds in water gradually weaken and are replaced by ionic bonds. Recent experimental measurements of the water equation of state (EOS) showed both a new phase of H-bonded water ice, ice-VII$_t$, and a relatively low transition pressure just above 30 GPa to ionic bonded ice-X, which has a bulk modulus 2.5 times larger. The higher bulk modulus of ice-X produces larger planets for a given mass, thereby either reducing the atmospheric contribution to the volume of many exoplanets or limiting their water content. We investigate the impact of the new EOS measurements on the planetary mass-radius relation and interior structure for water-rich planets. We find that the change in the planet mass-radius relation caused by the systematic differences between previous and new experimental EOS measurements are comparable to the observational uncertainties in some planet sizes -- an issue that will become more important as observations continue to improve. △ Less

Submitted 1 March, 2021; originally announced March 2021.

Comments: 9 pages, 4 figures. Accepted for publication in MNRAS

Localized Wannier function based tight-binding models for two-dimensional allotropes of bismuth

Authors: Qile Li, Jackson S. Smith, Yuefeng Yin, Chutian Wang, Mykhailo V. Klymenko, Jared H. Cole, Nikhil V. Medhekar

Abstract: With its monoelemental composition, various crystalline forms and an inherently strong spin-orbit coupling, bismuth has been regarded as an ideal prototype material to expand our understanding of topological electronic structures. In particular, two-dimensional bismuth thin films have attracted a growing interest due to potential applications in topological transistors and spintronics. This calls… ▽ More With its monoelemental composition, various crystalline forms and an inherently strong spin-orbit coupling, bismuth has been regarded as an ideal prototype material to expand our understanding of topological electronic structures. In particular, two-dimensional bismuth thin films have attracted a growing interest due to potential applications in topological transistors and spintronics. This calls for an effective physical model to give an accurate interpretation of the novel topological phenomena shown by two-dimensional bismuth. However, the conventional semi-empirical approach of adapting bulk bismuth hoppings fails to capture the topological features of two-dimensional bismuth allotropes because the electronic band topology is heavily influenced by crystalline symmetries as well as atom spacings. Here we provide a new parameterization using localized Wannier functions derived from the Bloch states in first-principles calculations. We construct new tight-binding models for three types of two-dimensional bismuth allotropes: a Bi (111) bilayer, bismuthene and a Bi(110) bilayer. We demonstrate that our tight-binding models can successfully reproduce the band structures, symmetries and topological features of these two-dimensional allotropes. We anticipate that these models can be extended to other similar two-dimensional topological structures such as antimonene and arsenene. Moreover, these models can serve as a starting point for investigating the electron/spin transport and electromagnetic response in low-dimensional topological devices. △ Less

Submitted 22 February, 2021; originally announced February 2021.

Comments: 20 pages, 6 figures

Journal ref: New J. Phys. 23, 063042 (2021)

High-pressure synthesis of Dirac materials: layered van der Waals bonded BeN$_4$ polymorph

Authors: Maxim Bykov, Timofey Fedotenko, Stella Chariton, Dominique Laniel, Konstantin Glazyrin, Michael Hanfland, Jesse S. Smith, Vitali B. Prakapenka, Mohammad F. Mahmood, Alexander F. Goncharov, Alena V. Ponomareva, Ferenc Tasnádi, Alexei I. Abrikosov, Talha Bin Masood, Ingrid Hotz, Alexander N. Rudenko, Mikhail I. Katsnelson, Natalia Dubrovinskaia, Leonid Dubrovinsky, Igor A. Abrikosov

Abstract: High pressure chemistry is known to inspire the creation of unexpected new classes of compounds with exceptional properties. Here we report the synthesis at ~90 GPa of novel beryllium polynitrides, monoclinic and triclinic BeN4. The triclinic phase, upon decompression to ambient conditions, transforms into a compound with atomic-thick BeN4 layers interconnected via weak van der Waals bonds consist… ▽ More High pressure chemistry is known to inspire the creation of unexpected new classes of compounds with exceptional properties. Here we report the synthesis at ~90 GPa of novel beryllium polynitrides, monoclinic and triclinic BeN4. The triclinic phase, upon decompression to ambient conditions, transforms into a compound with atomic-thick BeN4 layers interconnected via weak van der Waals bonds consisting of polyacetylene-like nitrogen chains with conjugated π-systems and Be atoms in square-planar coordination. Theoretical calculations for a single BeN4 layer show that its electronic lattice is described by a slightly distorted honeycomb structure reminiscent of the graphene lattice and the presence of Dirac points in the electronic band structure at the Fermi level. The BeN4 layer, i.e. beryllonitrene, represents a qualitatively new class of 2D materials that can be built of a metal atom and polymeric nitrogen chains and host anisotropic Dirac fermions. △ Less

Submitted 8 March, 2021; v1 submitted 29 October, 2020; originally announced October 2020.

Journal ref: Phys. Rev. Lett. 126, 175501 (2021)

NanoNET: an extendable Python framework for semi-empirical tight-binding models

Authors: M. V. Klymenko, J. A. Vaitkus, J. S. Smith, J. H. Cole

Abstract: We present a novel open-source Python framework called NanoNET (Nanoscale Non-equilibrium Electron Transport) for modelling electronic structure and transport. Our method is based on the tight-binding method and non-equilibrium Green's function theory. The core functionality of the framework is providing facilities for efficient construction of tight-binding Hamiltonian matrices from a list of ato… ▽ More We present a novel open-source Python framework called NanoNET (Nanoscale Non-equilibrium Electron Transport) for modelling electronic structure and transport. Our method is based on the tight-binding method and non-equilibrium Green's function theory. The core functionality of the framework is providing facilities for efficient construction of tight-binding Hamiltonian matrices from a list of atomic coordinates and a lookup table of the two-center integrals in dense, sparse, or block-tridiagonal forms. The framework implements a method based on $kd$-tree nearest-neighbour search and is applicable to isolated atomic clusters and periodic structures. A set of subroutines for detecting the block-tridiagonal structure of a Hamiltonian matrix and splitting it into series of diagonal and off-diagonal blocks is based on a new greedy algorithm with recursion. Additionally the developed software is equipped with a set of programs for computing complex band structure, self-energies of elastic scattering processes, and Green's functions. Examples of usage and capabilities of the computational framework are illustrated by computing the band structure and transport properties of a silicon nanowire as well as the band structure of bulk bismuth. △ Less

Submitted 14 October, 2020; originally announced October 2020.

Good Graph to Optimize: Cost-Effective, Budget-Aware Bundle Adjustment in Visual SLAM

Authors: Yipu Zhao, Justin S. Smith, Patricio A. Vela

Abstract: The cost-efficiency of visual(-inertial) SLAM (VSLAM) is a critical characteristic of resource-limited applications. While hardware and algorithm advances have been significantly improved the cost-efficiency of VSLAM front-ends, the cost-efficiency of VSLAM back-ends remains a bottleneck. This paper describes a novel, rigorous method to improve the cost-efficiency of local BA in a BA-based VSLAM b… ▽ More The cost-efficiency of visual(-inertial) SLAM (VSLAM) is a critical characteristic of resource-limited applications. While hardware and algorithm advances have been significantly improved the cost-efficiency of VSLAM front-ends, the cost-efficiency of VSLAM back-ends remains a bottleneck. This paper describes a novel, rigorous method to improve the cost-efficiency of local BA in a BA-based VSLAM back-end. An efficient algorithm, called Good Graph, is developed to select size-reduced graphs optimized in local BA with condition preservation. To better suit BA-based VSLAM back-ends, the Good Graph predicts future estimation needs, dynamically assigns an appropriate size budget, and selects a condition-maximized subgraph for BA estimation. Evaluations are conducted on two scenarios: 1) VSLAM as standalone process, and 2) VSLAM as part of closed-loop navigation system. Results from the first scenario show Good Graph improves accuracy and robustness of VSLAM estimation, when computational limits exist. Results from the second scenario, indicate that Good Graph benefits the trajectory tracking performance of VSLAM-based closed-loop navigation systems, which is a primary application of VSLAM. △ Less

Submitted 23 August, 2020; originally announced August 2020.

Comments: 20 pages, 14 figures, 8 tables. Submitted to IEEE Transactions on Robotics, for the provided open-source software see https://github.com/ivalab/gf_orb_slam2

Aharonov-Bohm interference as a probe of Majorana fermions

Authors: T. C. Bartolo, J. S. Smith, B. Muralidharan, C. Müller, T. M. Stace, J. H. Cole

Abstract: Majorana fermions act as their own antiparticle, and they have long been thought to be confined to the realm of pure theory. However, interest in them has recently resurfaced, as it was realized through the work of Kitaev that some experimentally accessible condensed matter systems can host these exotic excitations as bound states on the boundaries of 1D chains, and that their topological and non-… ▽ More Majorana fermions act as their own antiparticle, and they have long been thought to be confined to the realm of pure theory. However, interest in them has recently resurfaced, as it was realized through the work of Kitaev that some experimentally accessible condensed matter systems can host these exotic excitations as bound states on the boundaries of 1D chains, and that their topological and non-abelian nature holds promise for quantum computation. Unambiguously detecting the experimental signatures of Majorana bound states has turned out to be challenging, as many other phenomena lead to similar experimental behaviour. Here, we computationally study a ring comprised of two Kitaev model chains with tunnel coupling between them, where an applied magnetic field allows for Aharonov-Bohm interference in transport through the resulting ring structure. We use a non-equilibrium Green's function technique to analyse the transport properties of the ring in both the presence and absence of Majorana zero modes. Further, we show that these results are robust against weak disorder in the presence of an applied magnetic field. This computational model suggests another signature for the presence of these topologically protected bound states can be found in the magnetic field dependence of devices with loop geometries. △ Less

Submitted 13 August, 2021; v1 submitted 28 June, 2020; originally announced June 2020.

Comments: 12 pages, 10 figures. Included new section about disorder in the nanowires and the effect of this on our results

Journal ref: Phys. Rev. Research 2, 043430 (2020)

Simple and efficient algorithms for training machine learning potentials to force data

Authors: Justin S. Smith, Nicholas Lubbers, Aidan P. Thompson, Kipton Barros

Abstract: Abstract Machine learning models, trained on data from ab initio quantum simulations, are yielding molecular dynamics potentials with unprecedented accuracy. One limiting factor is the quantity of available training data, which can be expensive to obtain. A quantum simulation often provides all atomic forces, in addition to the total energy of the system. These forces provide much more information… ▽ More Abstract Machine learning models, trained on data from ab initio quantum simulations, are yielding molecular dynamics potentials with unprecedented accuracy. One limiting factor is the quantity of available training data, which can be expensive to obtain. A quantum simulation often provides all atomic forces, in addition to the total energy of the system. These forces provide much more information than the energy alone. It may appear that training a model to this large quantity of force data would introduce significant computational costs. Actually, training to all available force data should only be a few times more expensive than training to energies alone. Here, we present a new algorithm for efficient force training, and benchmark its accuracy by training to forces from real-world datasets for organic chemistry and bulk aluminum. △ Less

Submitted 9 June, 2020; originally announced June 2020.

Pressure-induced suppression of ferromagnetism in the itinerant ferromagnet LaCrSb$_3$

Authors: Z. E. Brubaker, J. S. Harvey, J. R. Badger, R. R. Ullah, D. J. Campbell, Y. Xiao, P. Chow, C. Kenney-Benson, J. S. Smith, C. Reynolds, J. Paglione, R. J. Zieve, J. R. Jeffries, V. Taufour

Abstract: We have performed an extensive pressure-dependent structural, spectroscopic, and electrical transport study of LaCrSb$_3$. The ferromagnetic phase (T$_C$ = 120 K at p = 0 GPa) is fully suppressed by p = 26.5 GPa and the Cr-moment decreases steadily with increasing pressure. The unit cell volume decreases smoothly up to p = 55 GPa. We find that the bulk modulus and suppression of the magnetism are… ▽ More We have performed an extensive pressure-dependent structural, spectroscopic, and electrical transport study of LaCrSb$_3$. The ferromagnetic phase (T$_C$ = 120 K at p = 0 GPa) is fully suppressed by p = 26.5 GPa and the Cr-moment decreases steadily with increasing pressure. The unit cell volume decreases smoothly up to p = 55 GPa. We find that the bulk modulus and suppression of the magnetism are in good agreement with theoretical predictions, but the Cr-moment decreases smoothly with pressure, in contrast to steplike drops predicted by theory. The ferromagnetic ordering temperature appears to be driven by the Cr-moment. △ Less

Submitted 22 May, 2020; originally announced May 2020.

Comments: 8 pages, 8 figures

Simulating the fabrication of aluminium oxide tunnel junctions

Authors: M. J. Cyster, J. S. Smith, N. Vogt, G. Opletal, S. P. Russo, J. H. Cole

Abstract: Aluminium oxide (AlO$_\mathrm{x}$) tunnel junctions are important components in a range of nanoelectric devices including superconducting qubits where they can be used as Josephson junctions. While many improvements in the reproducibility and reliability of qubits have been made possible through new circuit designs, there are still knowledge gaps in the relevant materials science. A better underst… ▽ More Aluminium oxide (AlO$_\mathrm{x}$) tunnel junctions are important components in a range of nanoelectric devices including superconducting qubits where they can be used as Josephson junctions. While many improvements in the reproducibility and reliability of qubits have been made possible through new circuit designs, there are still knowledge gaps in the relevant materials science. A better understanding of how fabrication conditions affect the density, uniformity, and elemental composition of the oxide barrier may lead to the development of lower noise and more reliable nanoelectronics and quantum computers. In this paper we use molecular dynamics to develop models of Al-AlO$_\mathrm{x}$-Al junctions by iteratively growing the structures with sequential calculations. With this approach we can see how the surface oxide grows and changes during the oxidation simulation. Dynamic processes such as the evolution of a charge gradient across the oxide, the formation of holes in the oxide layer, and changes between amorphous and semi-crystalline phases are observed. Our results are widely in agreement with previous work including reported oxide densities, self-limiting of the oxidation, and increased crystallinity as the simulation temperature is raised. The encapsulation of the oxide with metal evaporation is also studied atom by atom. Low density regions at the metal-oxide interfaces are a common feature in the final junction structures which persists for different oxidation parameters, empirical potentials, and crystal orientations of the aluminium substrate. △ Less

Submitted 14 May, 2020; v1 submitted 13 May, 2020; originally announced May 2020.

Comments: 14 pages, 16 figures

Journal ref: npj Quantum Inf 7, 12 (2021)

Precision measurement of the ${\cal B}(Υ(3S)\toτ^+τ^-)/{\cal B}(Υ(3S)\toμ^+μ^-)$ ratio

Authors: J. P. Lees, V. Poireau, V. Tisserand, E. Grauges, A. Palano, G. Eigen, D. N. Brown, Yu. G. Kolomensky, M. Fritsch, H. Koch, T. Schroeder, R. Cheaib, C. Hearty, T. S. Mattison, J. A. McKenna, R. Y. So, V. E. Blinov, A. R. Buzykaev, V. P. Druzhinin, V. B. Golubev, E. A. Kozyrev, E. A. Kravchenko, A. P. Onuchin, S. I. Serednyakov, Yu. I. Skovpen , et al. (217 additional authors not shown)

Abstract: We report on a precision measurement of the ratio ${\cal R}_{τμ}^{Υ(3S)} = {\cal B}(Υ(3S)\toτ^+τ^-)/{\cal B}(Υ(3S)\toμ^+μ^-)$ using data collected with the BaBar detector at the SLAC PEP-II $e^+e^-$ collider. The measurement is based on a 28 fb$^{-1}$ data sample collected at a center-of-mass energy of 10.355 GeV corresponding to a sample of 122 million $Υ(3S)$ mesons. The ratio is measured to be… ▽ More We report on a precision measurement of the ratio ${\cal R}_{τμ}^{Υ(3S)} = {\cal B}(Υ(3S)\toτ^+τ^-)/{\cal B}(Υ(3S)\toμ^+μ^-)$ using data collected with the BaBar detector at the SLAC PEP-II $e^+e^-$ collider. The measurement is based on a 28 fb$^{-1}$ data sample collected at a center-of-mass energy of 10.355 GeV corresponding to a sample of 122 million $Υ(3S)$ mesons. The ratio is measured to be ${\cal R}_{τμ}^{Υ(3S)} = 0.966 \pm 0.008_\mathrm{stat} \pm 0.014_\mathrm{syst}$ and is in agreement with the Standard Model prediction of 0.9948 within 2 standard deviations. The uncertainty in ${\cal R}_{τμ}^{Υ(3S)}$ is almost an order of magnitude smaller than the only previous measurement. △ Less

Submitted 10 May, 2020; v1 submitted 3 May, 2020; originally announced May 2020.

Comments: 8 pages, 4 figures, 3 tables

Report number: BABAR-PUB-20/002, SLAC-PUB-17527

Journal ref: Phys. Rev. Lett. 125, 241801 (2020)

Search for lepton-flavor violating decays $D^{0}\rightarrow X^{0}e^{\pm}μ^{\mp}$

Authors: BaBar Collaboration, J. P. Lees, V. Poireau, V. Tisserand, E. Grauges, A. Palano, G. Eigen, D. N. Brown, Yu. G. Kolomensky, M. Fritsch, H. Koch, T. Schroeder, R. Cheaib, C. Hearty, T. S. Mattison, J. A. McKenna, R. Y. So, V. E. Blinov, A. R. Buzykaev, V. P. Druzhinin, V. B. Golubev, E. A. Kozyrev, E. A. Kravchenko, A. P. Onuchin, S. I. Serednyakov , et al. (217 additional authors not shown)

Abstract: We present a search for seven lepton-flavor-violating neutral charm decays of the type $D^{0}\rightarrow X^{0} e^{\pm} μ^{\mp}$, where $X^{0}$ represents a $π^{0}$, $K^{0}_{\rm S}$, $\bar{K^{*0}}$, $ρ^{0}$, $φ$, $ω$, or $η$ meson. The analysis is based on $468$ fb$^{-1}$ of $e^+e^-$ annihilation data collected at or close to the $Υ(4S)$ resonance with the BaBar detector at the SLAC National Accele… ▽ More We present a search for seven lepton-flavor-violating neutral charm decays of the type $D^{0}\rightarrow X^{0} e^{\pm} μ^{\mp}$, where $X^{0}$ represents a $π^{0}$, $K^{0}_{\rm S}$, $\bar{K^{*0}}$, $ρ^{0}$, $φ$, $ω$, or $η$ meson. The analysis is based on $468$ fb$^{-1}$ of $e^+e^-$ annihilation data collected at or close to the $Υ(4S)$ resonance with the BaBar detector at the SLAC National Accelerator Laboratory. No significant signals are observed, and we establish 90\% confidence level upper limits on the branching fractions in the range $(5.0 - 22.5)\times 10^{-7}$. The limits are between one and two orders of magnitude more stringent than previous measurements. △ Less

Submitted 5 May, 2020; v1 submitted 20 April, 2020; originally announced April 2020.

Comments: 12 pages, 2 figures, to be submitted to Physical Review D. arXiv admin note: text overlap with arXiv:1905.00608

Report number: BABAR-PUB-20/001, SLAC-PUB-17524

Journal ref: Phys. Rev. D 101, 112003 (2020)

Automated discovery of a robust interatomic potential for aluminum

Authors: Justin S. Smith, Benjamin Nebgen, Nithin Mathew, Jie Chen, Nicholas Lubbers, Leonid Burakovsky, Sergei Tretiak, Hai Ah Nam, Timothy Germann, Saryu Fensin, Kipton Barros

Abstract: Accuracy of molecular dynamics simulations depends crucially on the interatomic potential used to generate forces. The gold standard would be first-principles quantum mechanics (QM) calculations, but these become prohibitively expensive at large simulation scales. Machine learning (ML) based potentials aim for faithful emulation of QM at drastically reduced computational cost. The accuracy and rob… ▽ More Accuracy of molecular dynamics simulations depends crucially on the interatomic potential used to generate forces. The gold standard would be first-principles quantum mechanics (QM) calculations, but these become prohibitively expensive at large simulation scales. Machine learning (ML) based potentials aim for faithful emulation of QM at drastically reduced computational cost. The accuracy and robustness of an ML potential is primarily limited by the quality and diversity of the training dataset. Using the principles of active learning (AL), we present a highly automated approach to dataset construction. The strategy is to use the ML potential under development to sample new atomic configurations and, whenever a configuration is reached for which the ML uncertainty is sufficiently large, collect new QM data. Here, we seek to push the limits of automation, removing as much expert knowledge from the AL process as possible. All sampling is performed using MD simulations starting from an initially disordered configuration, and undergoing non-equilibrium dynamics as driven by time-varying applied temperatures. We demonstrate this approach by building an ML potential for aluminum (ANI-Al). After many AL iterations, ANI-Al teaches itself to predict properties like the radial distribution function in melt, liquid-solid coexistence curve, and crystal properties such as defect energies and barriers. To demonstrate transferability, we perform a 1.3M atom shock simulation, and show that ANI-Al predictions agree very well with DFT calculations on local atomic environments sampled from the nonequilibrium dynamics. Interestingly, the configurations appearing in shock appear to have been well sampled in the AL training dataset, in a way that we illustrate visually. △ Less

Submitted 24 August, 2020; v1 submitted 10 March, 2020; originally announced March 2020.

Closed-Loop Benchmarking of Stereo Visual-Inertial SLAM Systems: Understanding the Impact of Drift and Latency on Tracking Accuracy

Authors: Yipu Zhao, Justin S. Smith, Sambhu H. Karumanchi, Patricio A. Vela

Abstract: Visual-inertial SLAM is essential for robot navigation in GPS-denied environments, e.g. indoor, underground. Conventionally, the performance of visual-inertial SLAM is evaluated with open-loop analysis, with a focus on the drift level of SLAM systems. In this paper, we raise the question on the importance of visual estimation latency in closed-loop navigation tasks, such as accurate trajectory tra… ▽ More Visual-inertial SLAM is essential for robot navigation in GPS-denied environments, e.g. indoor, underground. Conventionally, the performance of visual-inertial SLAM is evaluated with open-loop analysis, with a focus on the drift level of SLAM systems. In this paper, we raise the question on the importance of visual estimation latency in closed-loop navigation tasks, such as accurate trajectory tracking. To understand the impact of both drift and latency on visual-inertial SLAM systems, a closed-loop benchmarking simulation is conducted, where a robot is commanded to follow a desired trajectory using the feedback from visual-inertial estimation. By extensively evaluating the trajectory tracking performance of representative state-of-the-art visual-inertial SLAM systems, we reveal the importance of latency reduction in visual estimation module of these systems. The findings suggest directions of future improvements for visual-inertial SLAM. △ Less

Submitted 7 March, 2020; v1 submitted 2 March, 2020; originally announced March 2020.

Comments: 8 pages, 7 figures. Accepted for publication in ICRA 2020

Valence instability across magnetostructural transition in USb$_2$

Authors: Z. E. Brubaker, Y. Xiao, P. Chow, C. Kenney-Benson, J. S. Smith, H. Cynn, C. Reynolds, N. P. Butch, R. J. Zieve, J. R. Jeffries

Abstract: We have performed pressure dependent X-ray diffraction and resonant X-ray emission spectroscopy experiments on USb$_2$ to further characterize the AFM-FM transition occurring near 8 GPa. We have found the magnetic transition coincides with a tetragonal to orthorhombic transition resulting in a 17% volume collapse as well as a transient $\textit{f}$-occupation enhancement. Compared to UAs$_2$ and U… ▽ More We have performed pressure dependent X-ray diffraction and resonant X-ray emission spectroscopy experiments on USb$_2$ to further characterize the AFM-FM transition occurring near 8 GPa. We have found the magnetic transition coincides with a tetragonal to orthorhombic transition resulting in a 17% volume collapse as well as a transient $\textit{f}$-occupation enhancement. Compared to UAs$_2$ and UAsS, USb$_2$ shows a reduced bulk modulus and transition pressure and an increased volume collapse at the structural transition. Except for an enhancement across the transition region, the $\textit{f}$-occupancy decreases steadily from 1.96 to 1.75. △ Less

Submitted 31 January, 2020; originally announced February 2020.

Comments: 9 pages, 10 figures