-
StyleRemix: Interpretable Authorship Obfuscation via Distillation and Perturbation of Style Elements
Authors:
Jillian Fisher,
Skyler Hallinan,
Ximing Lu,
Mitchell Gordon,
Zaid Harchaoui,
Yejin Choi
Abstract:
Authorship obfuscation, rewriting a text to intentionally obscure the identity of the author, is an important but challenging task. Current methods using large language models (LLMs) lack interpretability and controllability, often ignoring author-specific stylistic features, resulting in less robust performance overall.
To address this, we develop StyleRemix, an adaptive and interpretable obfus…
▽ More
Authorship obfuscation, rewriting a text to intentionally obscure the identity of the author, is an important but challenging task. Current methods using large language models (LLMs) lack interpretability and controllability, often ignoring author-specific stylistic features, resulting in less robust performance overall.
To address this, we develop StyleRemix, an adaptive and interpretable obfuscation method that perturbs specific, fine-grained style elements of the original input text. StyleRemix uses pre-trained Low Rank Adaptation (LoRA) modules to rewrite an input specifically along various stylistic axes (e.g., formality and length) while maintaining low computational cost. StyleRemix outperforms state-of-the-art baselines and much larger LLMs in a variety of domains as assessed by both automatic and human evaluation.
Additionally, we release AuthorMix, a large set of 30K high-quality, long-form texts from a diverse set of 14 authors and 4 domains, and DiSC, a parallel corpus of 1,500 texts spanning seven style axes in 16 unique directions
△ Less
Submitted 28 August, 2024;
originally announced August 2024.
-
A Bayesian Classification Trees Approach to Treatment Effect Variation with Noncompliance
Authors:
Jared D. Fisher,
David W. Puelz,
Sameer K. Deshpande
Abstract:
Estimating varying treatment effects in randomized trials with noncompliance is inherently challenging since variation comes from two separate sources: variation in the impact itself and variation in the compliance rate. In this setting, existing flexible machine learning methods are highly sensitive to the weak instruments problem, in which the compliance rate is (locally) close to zero. Our main…
▽ More
Estimating varying treatment effects in randomized trials with noncompliance is inherently challenging since variation comes from two separate sources: variation in the impact itself and variation in the compliance rate. In this setting, existing flexible machine learning methods are highly sensitive to the weak instruments problem, in which the compliance rate is (locally) close to zero. Our main methodological contribution is to present a Bayesian Causal Forest model for binary response variables in scenarios with noncompliance. By repeatedly imputing individuals' compliance types, we can flexibly estimate heterogeneous treatment effects among compliers. Simulation studies demonstrate the usefulness of our approach when compliance and treatment effects are heterogeneous. We apply the method to detect and analyze heterogeneity in the treatment effects in the Illinois Workplace Wellness Study, which not only features heterogeneous and one-sided compliance but also several binary outcomes of interest. We demonstrate the methodology on three outcomes one year after intervention. We confirm a null effect on the presence of a chronic condition, discover meaningful heterogeneity impact of the intervention on metabolic parameters though the average effect is null in classical partial effect estimates, and find substantial heterogeneity in individuals' perception of management prioritization of health and safety.
△ Less
Submitted 26 August, 2024; v1 submitted 14 August, 2024;
originally announced August 2024.
-
Robustness of electron charge shuttling: Architectures, pulses, charge defects and noise thresholds
Authors:
Minjun Jeon,
Simon C. Benjamin,
Andrew J. Fisher
Abstract:
In semiconductor-based quantum technologies, the capability to shuttle charges between components is profoundly enabling. We numerically simulated various "conveyor-belt" shuttling scenarios for simple Si/SiO2 devices, explicitly modelling the electron's wave function using grid-based split-operator methods and a time-dependent 2D potential (obtained from a Poisson solver). This allowed us to full…
▽ More
In semiconductor-based quantum technologies, the capability to shuttle charges between components is profoundly enabling. We numerically simulated various "conveyor-belt" shuttling scenarios for simple Si/SiO2 devices, explicitly modelling the electron's wave function using grid-based split-operator methods and a time-dependent 2D potential (obtained from a Poisson solver). This allowed us to fully characterise the electron loss probability and excitation fraction. Remarkably, with as few as three independent electrodes the process can remain near-perfectly adiabatic even in the presence of pulse imperfection, nearby charge defects, and Johnson-Nyquist noise. Only a substantial density of charge defects, or defects at 'adversarial' locations, can catastrophically disrupt the charge shuttling. While we do not explicitly model the spin or valley degrees of freedom, our results from this charge propagation study support the conclusion that conveyor-belt shuttling is an excellent candidate for providing connectivity in semiconductor quantum devices.
△ Less
Submitted 6 August, 2024;
originally announced August 2024.
-
Modular Pluralism: Pluralistic Alignment via Multi-LLM Collaboration
Authors:
Shangbin Feng,
Taylor Sorensen,
Yuhan Liu,
Jillian Fisher,
Chan Young Park,
Yejin Choi,
Yulia Tsvetkov
Abstract:
While existing alignment paradigms have been integral in developing large language models (LLMs), LLMs often learn an averaged human preference and struggle to model diverse preferences across cultures, demographics, and communities. We propose Modular Pluralism, a modular framework based on multi-LLM collaboration for pluralistic alignment: it "plugs into" a base LLM a pool of smaller but special…
▽ More
While existing alignment paradigms have been integral in developing large language models (LLMs), LLMs often learn an averaged human preference and struggle to model diverse preferences across cultures, demographics, and communities. We propose Modular Pluralism, a modular framework based on multi-LLM collaboration for pluralistic alignment: it "plugs into" a base LLM a pool of smaller but specialized community LMs, where models collaborate in distinct modes to flexibility support three modes of pluralism: Overton, steerable, and distributional. Modular Pluralism is uniquely compatible with black-box LLMs and offers the modular control of adding new community LMs for previously underrepresented communities. We evaluate Modular Pluralism with six tasks and four datasets featuring questions/instructions with value-laden and perspective-informed responses. Extensive experiments demonstrate that Modular Pluralism advances the three pluralism objectives across six black-box and open-source LLMs. Further analysis reveals that LLMs are generally faithful to the inputs from smaller community LLMs, allowing seamless patching by adding a new community LM to better cover previously underrepresented communities.
△ Less
Submitted 22 June, 2024;
originally announced June 2024.
-
Materials for Quantum Technologies: a Roadmap for Spin and Topology
Authors:
N. Banerjee,
C. Bell,
C. Ciccarelli,
T. Hesjedal,
F. Johnson,
H. Kurebayashi,
T. A. Moore,
C. Moutafis,
H. L. Stern,
I. J. Vera-Marun,
J. Wade,
C. Barton,
M. R. Connolly,
N. J. Curson,
K. Fallon,
A. J. Fisher,
D. A. Gangloff,
W. Griggs,
E. Linfield,
C. H. Marrows,
A. Rossi,
F. Schindler,
J. Smith,
T. Thomson,
O. Kazakova
Abstract:
This Roadmap provides an overview of the critical role of materials in exploiting spin and topology for next-generation quantum technologies including computing, sensing, information storage and networking devices. We explore the key materials systems that support spin and topological phenomena and discuss their figures of merit. Spin and topology-based quantum technologies have several advantages…
▽ More
This Roadmap provides an overview of the critical role of materials in exploiting spin and topology for next-generation quantum technologies including computing, sensing, information storage and networking devices. We explore the key materials systems that support spin and topological phenomena and discuss their figures of merit. Spin and topology-based quantum technologies have several advantages over their classical, charged-based counterparts, including non-volatility, faster data processing speeds, higher integration densities and lower power consumption. We discuss the main challenges facing the field, identify strategies to overcome them, and provide a realistic outlook on future possibilities of spin-based and topological materials in quantum technology applications.
△ Less
Submitted 11 June, 2024;
originally announced June 2024.
-
With or Without Permission: Site-Specific Augmented Reality for Social Justice
Authors:
Rafael M. L. Silva,
Ana María Cárdenas Gasca,
Joshua A. Fisher,
Erica Principe Cruz,
Cinthya Jauregui,
Amy Lueck,
Fannie Liu,
Andrés Monroy-Hernández,
Kai Lukoff
Abstract:
Movements for social change are often tied to a particular locale. This makes Augmented Reality (AR), which changes how people perceive their surroundings, a promising technology for social justice. Site-specific AR empowers activists to re-tell the story of a place, with or without permission of its owner. It has been used, for example, to reveal hidden histories, re-imagine problematic monuments…
▽ More
Movements for social change are often tied to a particular locale. This makes Augmented Reality (AR), which changes how people perceive their surroundings, a promising technology for social justice. Site-specific AR empowers activists to re-tell the story of a place, with or without permission of its owner. It has been used, for example, to reveal hidden histories, re-imagine problematic monuments, and celebrate minority cultures. However, challenges remain concerning technological ownership and accessibility, scalability, sustainability, and navigating collaborations with marginalized communities and across disciplinary boundaries. This half-day workshop at CHI 2024 seeks to bring together an interdisciplinary group of activists, computer scientists, designers, media scholars, and more to identify opportunities and challenges across domains. To anchor the discussion, participants will each share one example of an artifact used in speculating, designing, and/or delivering site-specific AR experiences. This collection of artifacts will inaugurate an interactive database that can inspire a new wave of activists to leverage AR for social justice.
△ Less
Submitted 6 May, 2024;
originally announced May 2024.
-
REXEL: An End-to-end Model for Document-Level Relation Extraction and Entity Linking
Authors:
Nacime Bouziani,
Shubhi Tyagi,
Joseph Fisher,
Jens Lehmann,
Andrea Pierleoni
Abstract:
Extracting structured information from unstructured text is critical for many downstream NLP applications and is traditionally achieved by closed information extraction (cIE). However, existing approaches for cIE suffer from two limitations: (i) they are often pipelines which makes them prone to error propagation, and/or (ii) they are restricted to sentence level which prevents them from capturing…
▽ More
Extracting structured information from unstructured text is critical for many downstream NLP applications and is traditionally achieved by closed information extraction (cIE). However, existing approaches for cIE suffer from two limitations: (i) they are often pipelines which makes them prone to error propagation, and/or (ii) they are restricted to sentence level which prevents them from capturing long-range dependencies and results in expensive inference time. We address these limitations by proposing REXEL, a highly efficient and accurate model for the joint task of document level cIE (DocIE). REXEL performs mention detection, entity typing, entity disambiguation, coreference resolution and document-level relation classification in a single forward pass to yield facts fully linked to a reference knowledge graph. It is on average 11 times faster than competitive existing approaches in a similar setting and performs competitively both when optimised for any of the individual subtasks and a variety of combinations of different joint tasks, surpassing the baselines by an average of more than 6 F1 points. The combination of speed and accuracy makes REXEL an accurate cost-efficient system for extracting structured information at web-scale. We also release an extension of the DocRED dataset to enable benchmarking of future work on DocIE, which is available at https://github.com/amazon-science/e2e-docie.
△ Less
Submitted 19 April, 2024;
originally announced April 2024.
-
The Clarkston AR Gateways Project: Anchoring Refugee Presence and Narratives in a Small Town
Authors:
Joshua A. Fisher,
Fernando Rochaix
Abstract:
This paper outlines the Clarkston AR Gateways Project, a speculative process and artifact entering its second phase, where Augmented Reality (AR) will be used to amplify the diverse narratives of Clarkston, Georgia's refugee community. Focused on anchoring their stories and presence into the town's physical and digital landscapes, the project employs a participatory co-design approach, engaging di…
▽ More
This paper outlines the Clarkston AR Gateways Project, a speculative process and artifact entering its second phase, where Augmented Reality (AR) will be used to amplify the diverse narratives of Clarkston, Georgia's refugee community. Focused on anchoring their stories and presence into the town's physical and digital landscapes, the project employs a participatory co-design approach, engaging directly with community members. This placemaking effort aims to uplift refugees by teaching them AR development skills that help them more autonomously express and elevate their voices through public art. The result is hoped to be AR experiences that not only challenge prevailing narratives but also celebrate the tapestry of cultures in the small town. This work is supported through AR's unique affordance for users to situate their experiences as interactive narratives within public spaces. Such site-specific AR interactive stories can encourage interactions within those spaces that shift how they are conceived, perceived, and experienced. This process of refugee-driven AR creation reflexively alters the space and affirms their presence and agency. The project's second phase aims to establish a model adaptable to diverse, refugee-inclusive communities, demonstrating how AR storytelling can be a powerful tool for cultural orientation and celebration.
△ Less
Submitted 11 April, 2024;
originally announced April 2024.
-
With or Without Permission: Site-Specific Augmented Reality for Social Justice CHI 2024 Workshop Proceedings
Authors:
Rafael M. L. Silva,
Ana María Cárdenas Gasca,
Joshua A. Fisher,
Erica Principe Cruz,
Cinthya Jauregui,
Amy Lueck,
Fannie Liu,
Andrés Monroy-Hernández,
Kai Lukoff
Abstract:
This volume represents the proceedings of With or Without Permission: Site-Specific Augmented Reality for Social Justice CHI 2024 workshop.
This volume represents the proceedings of With or Without Permission: Site-Specific Augmented Reality for Social Justice CHI 2024 workshop.
△ Less
Submitted 22 April, 2024; v1 submitted 8 April, 2024;
originally announced April 2024.
-
JAMDEC: Unsupervised Authorship Obfuscation using Constrained Decoding over Small Language Models
Authors:
Jillian Fisher,
Ximing Lu,
Jaehun Jung,
Liwei Jiang,
Zaid Harchaoui,
Yejin Choi
Abstract:
The permanence of online content combined with the enhanced authorship identification techniques calls for stronger computational methods to protect the identity and privacy of online authorship when needed, e.g., blind reviews for scientific papers, anonymous online reviews, or anonymous interactions in the mental health forums. In this paper, we propose an unsupervised inference-time approach to…
▽ More
The permanence of online content combined with the enhanced authorship identification techniques calls for stronger computational methods to protect the identity and privacy of online authorship when needed, e.g., blind reviews for scientific papers, anonymous online reviews, or anonymous interactions in the mental health forums. In this paper, we propose an unsupervised inference-time approach to authorship obfuscation to address the unique challenges of authorship obfuscation: lack of supervision data for diverse authorship and domains, and the need for a sufficient level of revision beyond simple paraphrasing to obfuscate the authorship, all the while preserving the original content and fluency.
We introduce JAMDEC, a user-controlled, inference-time algorithm for authorship obfuscation that can be in principle applied to any text and authorship. Our approach builds on small language models such as GPT2-XL in order to help avoid disclosing the original content to proprietary LLM's APIs, while also reducing the performance gap between small and large language models via algorithmic enhancement. The key idea behind our approach is to boost the creative power of smaller language models through constrained decoding, while also allowing for user-specified controls and flexibility. Experimental results demonstrate that our approach based on GPT2-XL outperforms previous state-of-the-art methods based on comparably small models, while performing competitively against GPT3.5 175B, a propriety model that is two orders of magnitudes larger.
△ Less
Submitted 13 February, 2024;
originally announced February 2024.
-
A Roadmap to Pluralistic Alignment
Authors:
Taylor Sorensen,
Jared Moore,
Jillian Fisher,
Mitchell Gordon,
Niloofar Mireshghallah,
Christopher Michael Rytting,
Andre Ye,
Liwei Jiang,
Ximing Lu,
Nouha Dziri,
Tim Althoff,
Yejin Choi
Abstract:
With increased power and prevalence of AI systems, it is ever more critical that AI systems are designed to serve all, i.e., people with diverse values and perspectives. However, aligning models to serve pluralistic human values remains an open research question. In this piece, we propose a roadmap to pluralistic alignment, specifically using language models as a test bed. We identify and formaliz…
▽ More
With increased power and prevalence of AI systems, it is ever more critical that AI systems are designed to serve all, i.e., people with diverse values and perspectives. However, aligning models to serve pluralistic human values remains an open research question. In this piece, we propose a roadmap to pluralistic alignment, specifically using language models as a test bed. We identify and formalize three possible ways to define and operationalize pluralism in AI systems: 1) Overton pluralistic models that present a spectrum of reasonable responses; 2) Steerably pluralistic models that can steer to reflect certain perspectives; and 3) Distributionally pluralistic models that are well-calibrated to a given population in distribution. We also formalize and discuss three possible classes of pluralistic benchmarks: 1) Multi-objective benchmarks, 2) Trade-off steerable benchmarks, which incentivize models to steer to arbitrary trade-offs, and 3) Jury-pluralistic benchmarks which explicitly model diverse human ratings. We use this framework to argue that current alignment techniques may be fundamentally limited for pluralistic AI; indeed, we highlight empirical evidence, both from our own experiments and from other work, that standard alignment procedures might reduce distributional pluralism in models, motivating the need for further research on pluralistic alignment.
△ Less
Submitted 20 August, 2024; v1 submitted 7 February, 2024;
originally announced February 2024.
-
Forms of Understanding of XAI-Explanations
Authors:
Hendrik Buschmeier,
Heike M. Buhl,
Friederike Kern,
Angela Grimminger,
Helen Beierling,
Josephine Fisher,
André Groß,
Ilona Horwath,
Nils Klowait,
Stefan Lazarov,
Michael Lenke,
Vivien Lohmer,
Katharina Rohlfing,
Ingrid Scharlau,
Amit Singh,
Lutz Terfloth,
Anna-Lisa Vollmer,
Yu Wang,
Annedore Wilmes,
Britta Wrede
Abstract:
Explainability has become an important topic in computer science and artificial intelligence, leading to a subfield called Explainable Artificial Intelligence (XAI). The goal of providing or seeking explanations is to achieve (better) 'understanding' on the part of the explainee. However, what it means to 'understand' is still not clearly defined, and the concept itself is rarely the subject of sc…
▽ More
Explainability has become an important topic in computer science and artificial intelligence, leading to a subfield called Explainable Artificial Intelligence (XAI). The goal of providing or seeking explanations is to achieve (better) 'understanding' on the part of the explainee. However, what it means to 'understand' is still not clearly defined, and the concept itself is rarely the subject of scientific investigation. This conceptual article aims to present a model of forms of understanding in the context of XAI and beyond. From an interdisciplinary perspective bringing together computer science, linguistics, sociology, and psychology, a definition of understanding and its forms, assessment, and dynamics during the process of giving everyday explanations are explored. Two types of understanding are considered as possible outcomes of explanations, namely enabledness, 'knowing how' to do or decide something, and comprehension, 'knowing that' -- both in different degrees (from shallow to deep). Explanations regularly start with shallow understanding in a specific domain and can lead to deep comprehension and enabledness of the explanandum, which we see as a prerequisite for human users to gain agency. In this process, the increase of comprehension and enabledness are highly interdependent. Against the background of this systematization, special challenges of understanding in XAI are discussed.
△ Less
Submitted 15 November, 2023;
originally announced November 2023.
-
The Generative AI Paradox: "What It Can Create, It May Not Understand"
Authors:
Peter West,
Ximing Lu,
Nouha Dziri,
Faeze Brahman,
Linjie Li,
Jena D. Hwang,
Liwei Jiang,
Jillian Fisher,
Abhilasha Ravichander,
Khyathi Chandu,
Benjamin Newman,
Pang Wei Koh,
Allyson Ettinger,
Yejin Choi
Abstract:
The recent wave of generative AI has sparked unprecedented global attention, with both excitement and concern over potentially superhuman levels of artificial intelligence: models now take only seconds to produce outputs that would challenge or exceed the capabilities even of expert humans. At the same time, models still show basic errors in understanding that would not be expected even in non-exp…
▽ More
The recent wave of generative AI has sparked unprecedented global attention, with both excitement and concern over potentially superhuman levels of artificial intelligence: models now take only seconds to produce outputs that would challenge or exceed the capabilities even of expert humans. At the same time, models still show basic errors in understanding that would not be expected even in non-expert humans. This presents us with an apparent paradox: how do we reconcile seemingly superhuman capabilities with the persistence of errors that few humans would make? In this work, we posit that this tension reflects a divergence in the configuration of intelligence in today's generative models relative to intelligence in humans. Specifically, we propose and test the Generative AI Paradox hypothesis: generative models, having been trained directly to reproduce expert-like outputs, acquire generative capabilities that are not contingent upon -- and can therefore exceed -- their ability to understand those same types of outputs. This contrasts with humans, for whom basic understanding almost always precedes the ability to generate expert-level outputs. We test this hypothesis through controlled experiments analyzing generation vs. understanding in generative models, across both language and image modalities. Our results show that although models can outperform humans in generation, they consistently fall short of human capabilities in measures of understanding, as well as weaker correlation between generation and understanding performance, and more brittleness to adversarial inputs. Our findings support the hypothesis that models' generative capability may not be contingent upon understanding capability, and call for caution in interpreting artificial intelligence by analogy to human intelligence.
△ Less
Submitted 31 October, 2023;
originally announced November 2023.
-
Improving the Aggregation and Evaluation of NBA Mock Drafts
Authors:
Jared D. Fisher,
Colin Montague
Abstract:
Many enthusiasts and experts publish forecasts of the order players are drafted into professional sports leagues, known as mock drafts. Using a novel dataset of mock drafts for the National Basketball Association (NBA), we analyze authors' mock draft accuracy over time and ask how we can reasonably use information from multiple authors. To measure how accurate mock drafts are, we assume that both…
▽ More
Many enthusiasts and experts publish forecasts of the order players are drafted into professional sports leagues, known as mock drafts. Using a novel dataset of mock drafts for the National Basketball Association (NBA), we analyze authors' mock draft accuracy over time and ask how we can reasonably use information from multiple authors. To measure how accurate mock drafts are, we assume that both mock drafts and the actual draft are ranked lists, and we propose that rank-biased distance (RBD) of Webber et al. (2010) is the appropriate error metric for mock draft accuracy. This is because RBD allows mock drafts to have a different length than the actual draft, accounts for players not appearing in both lists, and weights errors early in the draft more than errors later on. We validate that mock drafts, as expected, improve in accuracy over the course of a season, and that accuracy of the mock drafts produced right before their drafts is fairly stable across seasons. To be able to combine information from multiple mock drafts into a single consensus mock draft, we also propose a ranked-list combination method based on the ideas of ranked-choice voting. We show that our method provides improved forecasts over the standard Borda count combination method used for most similar analyses in sports, and that either combination method provides a more accurate forecast over time than any single author.
△ Less
Submitted 25 October, 2023;
originally announced October 2023.
-
Momentum-space imaging of ultra-thin electron liquids in delta-doped silicon
Authors:
Procopios Constantinou,
Taylor J. Z. Stock,
Eleanor Crane,
Alexander Kölker,
Marcel van Loon,
Juerong Li,
Sarah Fearn,
Henric Bornemann,
Nicolò D'Anna,
Andrew J. Fisher,
Vladimir N. Strocov,
Gabriel Aeppli,
Neil J. Curson,
Steven R. Schofield
Abstract:
Two-dimensional dopant layers ($δ$-layers) in semiconductors provide the high-mobility electron liquids (2DELs) needed for nanoscale quantum-electronic devices. Key parameters such as carrier densities, effective masses, and confinement thicknesses for 2DELs have traditionally been extracted from quantum magnetotransport. In principle, the parameters are immediately readable from the one-electron…
▽ More
Two-dimensional dopant layers ($δ$-layers) in semiconductors provide the high-mobility electron liquids (2DELs) needed for nanoscale quantum-electronic devices. Key parameters such as carrier densities, effective masses, and confinement thicknesses for 2DELs have traditionally been extracted from quantum magnetotransport. In principle, the parameters are immediately readable from the one-electron spectral function that can be measured by angle-resolved photoemission spectroscopy (ARPES). Here, buried 2DEL $δ$-layers in silicon are measured with soft X-ray (SX) ARPES to obtain detailed information about their filled conduction bands and extract device-relevant properties. This study takes advantage of the larger probing depth and photon energy range of SX-ARPES relative to vacuum ultraviolet (VUV) ARPES to accurately measure the $δ$-layer electronic confinement. The measurements are made on ambient-exposed samples and yield extremely thin ($\approx 1$ $nm$) and dense ($\approx$ $10^{14}$ $cm^2$) 2DELs. Critically, this method is used to show that $δ$-layers of arsenic exhibit better electronic confinement than $δ$-layers of phosphorus fabricated under identical conditions.
△ Less
Submitted 29 September, 2023;
originally announced September 2023.
-
Harmonization Across Imaging Locations(HAIL): One-Shot Learning for Brain MRI
Authors:
Abhijeet Parida,
Zhifan Jiang,
Syed Muhammad Anwar,
Nicholas Foreman,
Nicholas Stence,
Michael J. Fisher,
Roger J. Packer,
Robert A. Avery,
Marius George Linguraru
Abstract:
For machine learning-based prognosis and diagnosis of rare diseases, such as pediatric brain tumors, it is necessary to gather medical imaging data from multiple clinical sites that may use different devices and protocols. Deep learning-driven harmonization of radiologic images relies on generative adversarial networks (GANs). However, GANs notoriously generate pseudo structures that do not exist…
▽ More
For machine learning-based prognosis and diagnosis of rare diseases, such as pediatric brain tumors, it is necessary to gather medical imaging data from multiple clinical sites that may use different devices and protocols. Deep learning-driven harmonization of radiologic images relies on generative adversarial networks (GANs). However, GANs notoriously generate pseudo structures that do not exist in the original training data, a phenomenon known as "hallucination". To prevent hallucination in medical imaging, such as magnetic resonance images (MRI) of the brain, we propose a one-shot learning method where we utilize neural style transfer for harmonization. At test time, the method uses one image from a clinical site to generate an image that matches the intensity scale of the collaborating sites. Our approach combines learning a feature extractor, neural style transfer, and adaptive instance normalization. We further propose a novel strategy to evaluate the effectiveness of image harmonization approaches with evaluation metrics that both measure image style harmonization and assess the preservation of anatomical structures. Experimental results demonstrate the effectiveness of our method in preserving patient anatomy while adjusting the image intensities to a new clinical site. Our general harmonization model can be used on unseen data from new sites, making it a valuable tool for real-world medical applications and clinical trials.
△ Less
Submitted 21 August, 2023;
originally announced August 2023.
-
Impossible Distillation: from Low-Quality Model to High-Quality Dataset & Model for Summarization and Paraphrasing
Authors:
Jaehun Jung,
Peter West,
Liwei Jiang,
Faeze Brahman,
Ximing Lu,
Jillian Fisher,
Taylor Sorensen,
Yejin Choi
Abstract:
We present Impossible Distillation, a novel framework for paraphrasing and sentence summarization, that distills a high-quality dataset and model from a low-quality teacher that itself cannot perform these tasks. Unlike prior works that rely on an extreme-scale teacher model (e.g., GPT3) or task-specific architecture, we hypothesize and verify the paraphrastic proximity intrinsic to pre-trained LM…
▽ More
We present Impossible Distillation, a novel framework for paraphrasing and sentence summarization, that distills a high-quality dataset and model from a low-quality teacher that itself cannot perform these tasks. Unlike prior works that rely on an extreme-scale teacher model (e.g., GPT3) or task-specific architecture, we hypothesize and verify the paraphrastic proximity intrinsic to pre-trained LMs (e.g., GPT2), where paraphrases occupy a proximal subspace in the LM distribution. By identifying and distilling generations from these subspaces, Impossible Distillation produces a high-quality dataset and model even from GPT2-scale LMs. We evaluate our method on multiple benchmarks spanning unconstrained / syntax-controlled paraphrase generation and sentence summarization. Our model with 770M parameters consistently outperforms strong baselines, including models distilled from ChatGPT, and sometimes, even ChatGPT itself. Also, we find that our distilled dataset from 1.5B LMs exhibits higher diversity and fidelity than up to 13 times larger datasets.
△ Less
Submitted 19 August, 2024; v1 submitted 26 May, 2023;
originally announced May 2023.
-
Kirwan surjectivity and Lefschetz-Sommese theorems for a generalized hyperkähler reduction
Authors:
Jonathan Fisher,
Lisa Jeffrey,
Alessandro Malusà,
Steven Rayan
Abstract:
Let $G$ be a compact Lie group. We study a class of Hamiltonian $(G \times S^{1})$-manifolds decorated with a function $s$ with certain equivariance properties, under conditions on the $G$-action which we call of (semi-)linear type. In this context, a close analogue of hyperkähler reduction is defined, and our main result establishes surjectivity of an appropriate analogue of Kirwan's map. As a pa…
▽ More
Let $G$ be a compact Lie group. We study a class of Hamiltonian $(G \times S^{1})$-manifolds decorated with a function $s$ with certain equivariance properties, under conditions on the $G$-action which we call of (semi-)linear type. In this context, a close analogue of hyperkähler reduction is defined, and our main result establishes surjectivity of an appropriate analogue of Kirwan's map. As a particular case, our setting includes a class of hyperkähler manifolds with trihamiltonian torus actions, to which our surjectivity result applies.
△ Less
Submitted 18 August, 2023; v1 submitted 24 May, 2023;
originally announced May 2023.
-
Inference-Time Policy Adapters (IPA): Tailoring Extreme-Scale LMs without Fine-tuning
Authors:
Ximing Lu,
Faeze Brahman,
Peter West,
Jaehun Jang,
Khyathi Chandu,
Abhilasha Ravichander,
Lianhui Qin,
Prithviraj Ammanabrolu,
Liwei Jiang,
Sahana Ramnath,
Nouha Dziri,
Jillian Fisher,
Bill Yuchen Lin,
Skyler Hallinan,
Xiang Ren,
Sean Welleck,
Yejin Choi
Abstract:
While extreme-scale language models have demonstrated exceptional performance on a variety of language tasks, the degree of control over these language models through pure prompting can often be limited. Directly fine-tuning such language models can be effective for tailoring them, but it can be either extremely costly (e.g., GPT-3) or not even feasible for the broader community (e.g., GPT-4).
W…
▽ More
While extreme-scale language models have demonstrated exceptional performance on a variety of language tasks, the degree of control over these language models through pure prompting can often be limited. Directly fine-tuning such language models can be effective for tailoring them, but it can be either extremely costly (e.g., GPT-3) or not even feasible for the broader community (e.g., GPT-4).
We propose Inference-time Policy Adapters (IPA), which efficiently tailors a language model such as GPT-3 without fine-tuning it. IPA guides a large base model during decoding time through a lightweight policy adapter trained to optimize an arbitrary user objective with reinforcement learning.
On five challenging text generation tasks, such as toxicity reduction and lexically constrained generation, IPA consistently brings significant improvements over off-the-shelf language models. It outperforms competitive baseline methods, sometimes even including expensive fine-tuning. In particular, tailoring GPT-2 with IPA can outperform GPT-3, while tailoring GPT-3 with IPA brings a major performance boost over GPT-3 (and sometimes even over GPT-4). Our promising results highlight the potential of IPA as a lightweight alternative to tailoring extreme-scale language models.
△ Less
Submitted 6 December, 2023; v1 submitted 24 May, 2023;
originally announced May 2023.
-
Lattice dynamics and ferroelectric properties of the nitride perovskite ${\mathrm{LaWN}}_{3}$
Authors:
Yue-Wen Fang,
Craig A. J. Fisher,
Akihide Kuwabara,
Xin-Wei Shen,
Takafumi Ogawa,
Hiroki Moriwake,
Rong Huang,
Chun-Gang Duan
Abstract:
Using first-principles calculations we examine the crystal structures and phase transitions of nitride perovskite LaWN$_3$. Lattice dynamics calculations indicate that the ground-state structure belongs to space group $R3c$. Two competitive phase transition pathways are identified which are characterized by symmetry-adapted distortion modes. The results suggest that $R3c$ LaWN$_3$ should be an exc…
▽ More
Using first-principles calculations we examine the crystal structures and phase transitions of nitride perovskite LaWN$_3$. Lattice dynamics calculations indicate that the ground-state structure belongs to space group $R3c$. Two competitive phase transition pathways are identified which are characterized by symmetry-adapted distortion modes. The results suggest that $R3c$ LaWN$_3$ should be an excellent ferroelectric semiconductor: its large spontaneous polarization of around 61 $μ$C/cm$^2$ is comparable to that of PbTiO$_3$, and its band gap is about 1.72 eV. Ferroelectricity is found to result from the \emph{B}-site instability driven by hybridization between W-5$d$ and N-2$p$ orbitals. These properties make LaWN$_3$ an attractive candidate material for use in ferroelectric memory devices and photovoltaic cells.
△ Less
Submitted 28 April, 2023;
originally announced May 2023.
-
Use of multiple covariates in assessing treatment-effect modifiers: A methodological review of individual participant data meta-analyses
Authors:
Peter J Godolphin,
Nadine Marlin,
Chantelle Cornett,
David J Fisher,
Jayne F Tierney,
Ian R White,
Ewelina Rogozińska
Abstract:
Individual participant data (IPD) meta-analyses of randomised trials are considered a reliable way to assess participant-level treatment effect modifiers but may not make the best use of the available data. Traditionally, effect modifiers are explored one covariate at a time, which gives rise to the possibility that evidence of treatment-covariate interaction may be due to confounding from a diffe…
▽ More
Individual participant data (IPD) meta-analyses of randomised trials are considered a reliable way to assess participant-level treatment effect modifiers but may not make the best use of the available data. Traditionally, effect modifiers are explored one covariate at a time, which gives rise to the possibility that evidence of treatment-covariate interaction may be due to confounding from a different, related covariate. We aimed to evaluate current practice when estimating treatment-covariate interactions in IPD meta-analysis, specifically focusing on involvement of additional covariates in the models. We reviewed 100 IPD meta-analyses of randomised trials, published between 2015 and 2020, that assessed at least one treatment-covariate interaction. We identified four approaches to handling additional covariates: (1) Single interaction model (unadjusted): No additional covariates included (57/100 studies); (2) Single interaction model (adjusted): Adjustment for the main effect of at least one additional covariate (35/100); (3) Multiple interactions model: Adjustment for at least one two-way interaction between treatment and an additional covariate (3/100); and (4) Three-way interaction model: Three-way interaction formed between treatment, the additional covariate and the potential effect modifier (5/100). IPD is not being utilised to its fullest extent. In an exemplar dataset, we demonstrate how these approaches can lead to different conclusions. Researchers should adjust for additional covariates when estimating interactions in IPD meta-analysis providing they adjust their main effects, which is already widely recommended. Further, they should consider whether more complex approaches could provide better information on who might benefit most from treatments, improving patient choice and treatment policy and practice.
△ Less
Submitted 24 February, 2023;
originally announced February 2023.
-
Statistical and Computational Guarantees for Influence Diagnostics
Authors:
Jillian Fisher,
Lang Liu,
Krishna Pillutla,
Yejin Choi,
Zaid Harchaoui
Abstract:
Influence diagnostics such as influence functions and approximate maximum influence perturbations are popular in machine learning and in AI domain applications. Influence diagnostics are powerful statistical tools to identify influential datapoints or subsets of datapoints. We establish finite-sample statistical bounds, as well as computational complexity bounds, for influence functions and approx…
▽ More
Influence diagnostics such as influence functions and approximate maximum influence perturbations are popular in machine learning and in AI domain applications. Influence diagnostics are powerful statistical tools to identify influential datapoints or subsets of datapoints. We establish finite-sample statistical bounds, as well as computational complexity bounds, for influence functions and approximate maximum influence perturbations using efficient inverse-Hessian-vector product implementations. We illustrate our results with generalized linear models and large attention based models on synthetic and real data.
△ Less
Submitted 19 September, 2023; v1 submitted 7 December, 2022;
originally announced December 2022.
-
Inferring changes to the global carbon cycle with WOMBAT v2.0, a hierarchical flux-inversion framework
Authors:
Michael Bertolacci,
Andrew Zammit-Mangion,
Andrew Schuh,
Beata Bukosa,
Jenny Fisher,
Yi Cao,
Aleya Kaushik,
Noel Cressie
Abstract:
The natural cycles of the surface-to-atmosphere fluxes of carbon dioxide (CO$_2$) and other important greenhouse gases are changing in response to human influences. These changes need to be quantified to understand climate change and its impacts, but this is difficult to do because natural fluxes occur over large spatial and temporal scales. To infer trends in fluxes and identify phase shifts and…
▽ More
The natural cycles of the surface-to-atmosphere fluxes of carbon dioxide (CO$_2$) and other important greenhouse gases are changing in response to human influences. These changes need to be quantified to understand climate change and its impacts, but this is difficult to do because natural fluxes occur over large spatial and temporal scales. To infer trends in fluxes and identify phase shifts and amplitude changes in flux seasonal cycles, we construct a flux-inversion system that uses a novel spatially varying time-series decomposition of the fluxes, while also accommodating physical constraints on the fluxes. We incorporate these features into the Wollongong Methodology for Bayesian Assimilation of Trace-gases (WOMBAT, Zammit-Mangion et al., Geosci. Model Dev., 15, 2022), a hierarchical flux-inversion framework that yields posterior distributions for all unknowns in the underlying model. We apply the new method, which we call WOMBAT v2.0, to a mix of satellite observations of CO$_2$ mole fraction from the Orbiting Carbon Observatory-2 (OCO-2) satellite and direct measurements of CO$_2$ mole fraction from a variety of sources. We estimate the changes to CO$_2$ fluxes that occurred from January 2015 to December 2020, and compare our posterior estimates to those from an alternative method based on a bottom-up understanding of the physical processes involved. We find substantial trends in the fluxes, including that tropical ecosystems trended from being a net source to a net sink of CO$_2$ over the study period. We also find that the amplitude of the global seasonal cycle of ecosystem CO$_2$ fluxes increased over the study period by 0.11 PgC/month (an increase of 8%), and that the seasonal cycle of ecosystem CO$_2$ fluxes in the northern temperate and northern boreal regions shifted earlier in the year by 0.4-0.7 and 0.4-0.9 days, respectively (2.5th to 97.5th posterior percentiles).
△ Less
Submitted 19 October, 2022;
originally announced October 2022.
-
Bayesian Multinomial Logistic Regression for Numerous Categories
Authors:
Jared D. Fisher,
Kyle R. McEvoy
Abstract:
While multinomial logistic regression is a useful tool for classification among multiple categories, the posterior sampling of Bayesian implementations is computationally burdensome when the number of categories is large. In this paper, we show that the appropriate data augmentation technique provides faster posterior sampling than alternatives in the literature. This speed up comes from two sourc…
▽ More
While multinomial logistic regression is a useful tool for classification among multiple categories, the posterior sampling of Bayesian implementations is computationally burdensome when the number of categories is large. In this paper, we show that the appropriate data augmentation technique provides faster posterior sampling than alternatives in the literature. This speed up comes from two sources: simpler posterior conditional distributions on the coefficients and the ability to parallelize parameter draws. In simulation studies, we demonstrate that the effective sampling rate of our posterior sampling approach is double that of competing methods when working with a large number of categories, even without parallelized computations. Furthermore, this computation time only increases linearly as the number of categories increases. Our corresponding R package is available on Github.
△ Less
Submitted 30 August, 2022;
originally announced August 2022.
-
ReFinED: An Efficient Zero-shot-capable Approach to End-to-End Entity Linking
Authors:
Tom Ayoola,
Shubhi Tyagi,
Joseph Fisher,
Christos Christodoulopoulos,
Andrea Pierleoni
Abstract:
We introduce ReFinED, an efficient end-to-end entity linking model which uses fine-grained entity types and entity descriptions to perform linking. The model performs mention detection, fine-grained entity typing, and entity disambiguation for all mentions within a document in a single forward pass, making it more than 60 times faster than competitive existing approaches. ReFinED also surpasses st…
▽ More
We introduce ReFinED, an efficient end-to-end entity linking model which uses fine-grained entity types and entity descriptions to perform linking. The model performs mention detection, fine-grained entity typing, and entity disambiguation for all mentions within a document in a single forward pass, making it more than 60 times faster than competitive existing approaches. ReFinED also surpasses state-of-the-art performance on standard entity linking datasets by an average of 3.7 F1. The model is capable of generalising to large-scale knowledge bases such as Wikidata (which has 15 times more entities than Wikipedia) and of zero-shot entity linking. The combination of speed, accuracy and scale makes ReFinED an effective and cost-efficient system for extracting entities from web-scale datasets, for which the model has been successfully deployed. Our code and pre-trained models are available at https://github.com/alexa/ReFinED
△ Less
Submitted 8 July, 2022;
originally announced July 2022.
-
Improving Entity Disambiguation by Reasoning over a Knowledge Base
Authors:
Tom Ayoola,
Joseph Fisher,
Andrea Pierleoni
Abstract:
Recent work in entity disambiguation (ED) has typically neglected structured knowledge base (KB) facts, and instead relied on a limited subset of KB information, such as entity descriptions or types. This limits the range of contexts in which entities can be disambiguated. To allow the use of all KB facts, as well as descriptions and types, we introduce an ED model which links entities by reasonin…
▽ More
Recent work in entity disambiguation (ED) has typically neglected structured knowledge base (KB) facts, and instead relied on a limited subset of KB information, such as entity descriptions or types. This limits the range of contexts in which entities can be disambiguated. To allow the use of all KB facts, as well as descriptions and types, we introduce an ED model which links entities by reasoning over a symbolic knowledge base in a fully differentiable fashion. Our model surpasses state-of-the-art baselines on six well-established ED datasets by 1.3 F1 on average. By allowing access to all KB information, our model is less reliant on popularity-based entity priors, and improves performance on the challenging ShadowLink dataset (which emphasises infrequent and ambiguous entities) by 12.7 F1.
△ Less
Submitted 8 July, 2022;
originally announced July 2022.
-
Robotic Planning under Uncertainty in Spatiotemporal Environments in Expeditionary Science
Authors:
Victoria Preston,
Genevieve Flaspohler,
Anna P. M. Michel,
John W. Fisher III,
Nicholas Roy
Abstract:
In the expeditionary sciences, spatiotemporally varying environments -- hydrothermal plumes, algal blooms, lava flows, or animal migrations -- are ubiquitous. Mobile robots are uniquely well-suited to study these dynamic, mesoscale natural environments. We formalize expeditionary science as a sequential decision-making problem, modeled using the language of partially-observable Markov decision pro…
▽ More
In the expeditionary sciences, spatiotemporally varying environments -- hydrothermal plumes, algal blooms, lava flows, or animal migrations -- are ubiquitous. Mobile robots are uniquely well-suited to study these dynamic, mesoscale natural environments. We formalize expeditionary science as a sequential decision-making problem, modeled using the language of partially-observable Markov decision processes (POMDPs). Solving the expeditionary science POMDP under real-world constraints requires efficient probabilistic modeling and decision-making in problems with complex dynamics and observational models. Previous work in informative path planning, adaptive sampling, and experimental design have shown compelling results, largely in static environments, using data-driven models and information-based rewards. However, these methodologies do not trivially extend to expeditionary science in spatiotemporal environments: they generally do not make use of scientific knowledge such as equations of state dynamics, they focus on information gathering as opposed to scientific task execution, and they make use of decision-making approaches that scale poorly to large, continuous problems with long planning horizons and real-time operational constraints. In this work, we discuss these and other challenges related to probabilistic modeling and decision-making in expeditionary science, and present some of our preliminary work that addresses these gaps. We ground our results in a real expeditionary science deployment of an autonomous underwater vehicle (AUV) in the deep ocean for hydrothermal vent discovery and characterization. Our concluding thoughts highlight remaining work to be done, and the challenges that merit consideration by the reinforcement learning and decision-making community.
△ Less
Submitted 2 June, 2022;
originally announced June 2022.
-
CPU- and GPU-based Distributed Sampling in Dirichlet Process Mixtures for Large-scale Analysis
Authors:
Or Dinari,
Raz Zamir,
John W. Fisher III,
Oren Freifeld
Abstract:
In the realm of unsupervised learning, Bayesian nonparametric mixture models, exemplified by the Dirichlet Process Mixture Model (DPMM), provide a principled approach for adapting the complexity of the model to the data. Such models are particularly useful in clustering tasks where the number of clusters is unknown. Despite their potential and mathematical elegance, however, DPMMs have yet to beco…
▽ More
In the realm of unsupervised learning, Bayesian nonparametric mixture models, exemplified by the Dirichlet Process Mixture Model (DPMM), provide a principled approach for adapting the complexity of the model to the data. Such models are particularly useful in clustering tasks where the number of clusters is unknown. Despite their potential and mathematical elegance, however, DPMMs have yet to become a mainstream tool widely adopted by practitioners. This is arguably due to a misconception that these models scale poorly as well as the lack of high-performance (and user-friendly) software tools that can handle large datasets efficiently. In this paper we bridge this practical gap by proposing a new, easy-to-use, statistical software package for scalable DPMM inference. More concretely, we provide efficient and easily-modifiable implementations for high-performance distributed sampling-based inference in DPMMs where the user is free to choose between either a multiple-machine, multiple-core, CPU implementation (written in Julia) and a multiple-stream GPU implementation (written in CUDA/C++). Both the CPU and GPU implementations come with a common (and optional) python wrapper, providing the user with a single point of entry with the same interface. On the algorithmic side, our implementations leverage a leading DPMM sampler from (Chang and Fisher III, 2013). While Chang and Fisher III's implementation (written in MATLAB/C++) used only CPU and was designed for a single multi-core machine, the packages we proposed here distribute the computations efficiently across either multiple multi-core machines or across mutiple GPU streams. This leads to speedups, alleviates memory and storage limitations, and lets us fit DPMMs to significantly larger datasets and of higher dimensionality than was possible previously by either (Chang and Fisher III, 2013) or other DPMM methods.
△ Less
Submitted 19 April, 2022;
originally announced April 2022.
-
Hierarchical Entity Alignment for Attribute-Rich Event-Driven Graphs
Authors:
Elizabeth Hou,
Joanna Brown,
John Fisher
Abstract:
This paper addresses the problem of entity alignment in attribute-rich event-driven graphs. Unlike many other entity alignment problems, we are interested in aligning entities based on the similarity of their actions, i.e., entities that participate in similar events are more likely to be the same. We model the generative process of this problem as a Bayesian model and derive our proposed algorith…
▽ More
This paper addresses the problem of entity alignment in attribute-rich event-driven graphs. Unlike many other entity alignment problems, we are interested in aligning entities based on the similarity of their actions, i.e., entities that participate in similar events are more likely to be the same. We model the generative process of this problem as a Bayesian model and derive our proposed algorithm from the posterior predictive distribution. We apply our Hierarchical Entity AlignmenT (HEAT) algorithm to two datasets, one on publications and the other on financial transactions, derived from real data and provided to us by an external collaborator.
△ Less
Submitted 1 February, 2022;
originally announced February 2022.
-
Automatic Y-axis Rescaling in Dynamic Visualizations
Authors:
Jacob Fisher,
Remco Chang,
Eugene Wu
Abstract:
Animated and interactive data visualizations dynamically change the data rendered in a visualization (e.g., bar chart). As the data changes, the y-axis may need to be rescaled as the domain of the data changes. Each axis rescaling potentially improves the readability of the current chart, but may also disorient the user. In contrast to static visualizations, where there is considerable literature…
▽ More
Animated and interactive data visualizations dynamically change the data rendered in a visualization (e.g., bar chart). As the data changes, the y-axis may need to be rescaled as the domain of the data changes. Each axis rescaling potentially improves the readability of the current chart, but may also disorient the user. In contrast to static visualizations, where there is considerable literature to help choose the appropriate y-axis scale, there is a lack of guidance about how and when rescaling should be used in dynamic visualizations. Existing visualization systems and libraries adapt a fixed global y-axis, or rescale every time the data changes. Yet, professional visualizations, such as in data journalism, do not adopt either strategy. They instead carefully and manually choose when to rescale based on the analysis task and data. To this end, we conduct a series of Mechanical Turk experiments to study the potential of dynamic axis rescaling and the factors that affect its effectiveness. We find that the appropriate rescaling policy is both task- and data-dependent, and we do not find one clear policy choice for all situations.
△ Less
Submitted 20 September, 2021;
originally announced September 2021.
-
Spatial mapping of protein composition and tissue organization: a primer for multiplexed antibody-based imaging
Authors:
John W. Hickey,
Elizabeth K. Neumann,
Andrea J. Radtke,
Jeannie M. Camarillo,
Rebecca T. Beuschel,
Alexandre Albanese,
Elizabeth McDonough,
Julia Hatler,
Anne E. Wiblin,
Jeremy Fisher,
Josh Croteau,
Eliza C. Small,
Anup Sood,
Richard M. Caprioli,
R. Michael Angelo,
Garry P. Nolan,
Kwanghun Chung,
Stephen M. Hewitt,
Ronald N. Germain,
Jeffrey M. Spraggins,
Emma Lundberg,
Michael P. Snyder,
Neil L. Kelleher,
Sinem K. Saka
Abstract:
Tissues and organs are composed of distinct cell types that must operate in concert to perform physiological functions. Efforts to create high-dimensional biomarker catalogs of these cells are largely based on transcriptomic single-cell approaches that lack the spatial context required to understand critical cellular communication and correlated structural organization. To probe in situ biology wi…
▽ More
Tissues and organs are composed of distinct cell types that must operate in concert to perform physiological functions. Efforts to create high-dimensional biomarker catalogs of these cells are largely based on transcriptomic single-cell approaches that lack the spatial context required to understand critical cellular communication and correlated structural organization. To probe in situ biology with sufficient coverage depth, several multiplexed protein imaging methods have recently been developed. Though these antibody-based technologies differ in strategy and mode of immunolabeling and detection tags, they commonly utilize antibodies directed against protein biomarkers to provide detailed spatial and functional maps of complex tissues. As these promising antibody-based multiplexing approaches become more widely adopted, new frameworks and considerations are critical for training future users, generating molecular tools, validating antibody panels, and harmonizing datasets. In this perspective, we provide essential resources and key considerations for obtaining robust and reproducible multiplexed antibody-based imaging data compiling specialized knowledge from domain experts and technology developers.
△ Less
Submitted 16 July, 2021;
originally announced July 2021.
-
Benchmarking the Performance of Bayesian Optimization across Multiple Experimental Materials Science Domains
Authors:
Qiaohao Liang,
Aldair E. Gongora,
Zekun Ren,
Armi Tiihonen,
Zhe Liu,
Shijing Sun,
James R. Deneault,
Daniil Bash,
Flore Mekki-Berrada,
Saif A. Khan,
Kedar Hippalgaonkar,
Benji Maruyama,
Keith A. Brown,
John Fisher III,
Tonio Buonassisi
Abstract:
In the field of machine learning (ML) for materials optimization, active learning algorithms, such as Bayesian Optimization (BO), have been leveraged for guiding autonomous and high-throughput experimentation systems. However, very few studies have evaluated the efficiency of BO as a general optimization algorithm across a broad range of experimental materials science domains. In this work, we eva…
▽ More
In the field of machine learning (ML) for materials optimization, active learning algorithms, such as Bayesian Optimization (BO), have been leveraged for guiding autonomous and high-throughput experimentation systems. However, very few studies have evaluated the efficiency of BO as a general optimization algorithm across a broad range of experimental materials science domains. In this work, we evaluate the performance of BO algorithms with a collection of surrogate model and acquisition function pairs across five diverse experimental materials systems, namely carbon nanotube polymer blends, silver nanoparticles, lead-halide perovskites, as well as additively manufactured polymer structures and shapes. By defining acceleration and enhancement metrics for general materials optimization objectives, we find that for surrogate model selection, Gaussian Process (GP) with anisotropic kernels (automatic relevance detection, ARD) and Random Forests (RF) have comparable performance and both outperform the commonly used GP without ARD. We discuss the implicit distributional assumptions of RF and GP, and the benefits of using GP with anisotropic kernels in detail. We provide practical insights for experimentalists on surrogate model selection of BO during materials optimization campaigns.
△ Less
Submitted 23 May, 2021;
originally announced June 2021.
-
Multi-hole models for deterministically placed acceptor arrays in silicon
Authors:
Jianhua Zhu,
Wei Wu,
Andrew J. Fisher
Abstract:
We compute the electronic structure of acceptor clusters in silicon by using three methods to include electron correlations: the full configuration interaction, the Heitler-London approximation, and the unrestricted Hartree-Fock method. We show both the HL approach and the UHF method are good approximations to the ground state of the full CI calculation for a pair of acceptors and for finite linea…
▽ More
We compute the electronic structure of acceptor clusters in silicon by using three methods to include electron correlations: the full configuration interaction, the Heitler-London approximation, and the unrestricted Hartree-Fock method. We show both the HL approach and the UHF method are good approximations to the ground state of the full CI calculation for a pair of acceptors and for finite linear chains. The total energies for finite linear chains show the formation of a 4-fold degenerate ground state when there is a weak bond at the end of the chain, which is shown to be a manifold of topological edge states. We identify a change in the angular momentum composition of the ground state at a critical pattern of bond lengths and show it is related to a crossing in the Fock matrix eigenvalues. We also test the symmetry of the UHF solution and compare it to the full CI; the symmetry is broken under almost all the arrangements by the formation of a magnetic state in UHF, and we find further broken symmetries for some particular arrangements related to crossings or potential crossings between the Fock-matrix eigenvalues. We also compute the charge distributions across the acceptors obtained from the eigenvectors of the Fock matrix: with weak bonds at the chain ends, two holes are localized at either end of the chain while the others have a nearly uniform distribution over the middle; this implies the existence of the non-trivial edge states. We apply the UHF method to treat an infinite linear chain with periodic boundary conditions. We find the band structures in the UHF approximation and compute the Zak phases for the occupied Fock-matrix eigenvalues; we find they do not correctly predict the topological edge states in this interacting system. We find direct study of the quantum numbers characterising the edge states provides a better insight into their topological nature.
△ Less
Submitted 9 August, 2021; v1 submitted 14 May, 2021;
originally announced May 2021.
-
WOMBAT: A fully Bayesian global flux-inversion framework
Authors:
Andrew Zammit-Mangion,
Michael Bertolacci,
Jenny Fisher,
Ann Stavert,
Matthew L. Rigby,
Yi Cao,
Noel Cressie
Abstract:
WOMBAT (the WOllongong Methodology for Bayesian Assimilation of Trace-gases) is a fully Bayesian hierarchical statistical framework for flux inversion of trace gases from flask, in situ, and remotely sensed data. WOMBAT extends the conventional Bayesian-synthesis framework through the consideration of a correlated error term, the capacity for online bias correction, and the provision of uncertaint…
▽ More
WOMBAT (the WOllongong Methodology for Bayesian Assimilation of Trace-gases) is a fully Bayesian hierarchical statistical framework for flux inversion of trace gases from flask, in situ, and remotely sensed data. WOMBAT extends the conventional Bayesian-synthesis framework through the consideration of a correlated error term, the capacity for online bias correction, and the provision of uncertainty quantification on all unknowns that appear in the Bayesian statistical model. We show, in an observing system simulation experiment (OSSE), that these extensions are crucial when the data are indeed biased and have errors that are correlated. Using the GEOS-Chem atmospheric transport model, we show that WOMBAT is able to obtain posterior means and uncertainties on non-fossil-fuel CO$_2$ fluxes from Orbiting Carbon Observatory-2 (OCO-2) data that are comparable to those from the Model Intercomparison Project (MIP) reported in Crowell et al. (2019, Atmos. Chem. Phys., vol. 19). We also find that our predictions of out-of-sample retrievals from the Total Column Carbon Observing Network are, for the most part, more accurate than those made by the MIP participants. Subsequent versions of the OCO-2 datasets will be ingested into WOMBAT as they become available.
△ Less
Submitted 8 February, 2021;
originally announced February 2021.
-
Lightweight Data Fusion with Conjugate Mappings
Authors:
Christopher L. Dean,
Stephen J. Lee,
Jason Pacheco,
John W. Fisher III
Abstract:
We present an approach to data fusion that combines the interpretability of structured probabilistic graphical models with the flexibility of neural networks. The proposed method, lightweight data fusion (LDF), emphasizes posterior analysis over latent variables using two types of information: primary data, which are well-characterized but with limited availability, and auxiliary data, readily ava…
▽ More
We present an approach to data fusion that combines the interpretability of structured probabilistic graphical models with the flexibility of neural networks. The proposed method, lightweight data fusion (LDF), emphasizes posterior analysis over latent variables using two types of information: primary data, which are well-characterized but with limited availability, and auxiliary data, readily available but lacking a well-characterized statistical relationship to the latent quantity of interest. The lack of a forward model for the auxiliary data precludes the use of standard data fusion approaches, while the inability to acquire latent variable observations severely limits direct application of most supervised learning methods. LDF addresses these issues by utilizing neural networks as conjugate mappings of the auxiliary data: nonlinear transformations into sufficient statistics with respect to the latent variables. This facilitates efficient inference by preserving the conjugacy properties of the primary data and leads to compact representations of the latent variable posterior distributions. We demonstrate the LDF methodology on two challenging inference problems: (1) learning electrification rates in Rwanda from satellite imagery, high-level grid infrastructure, and other sources; and (2) inferring county-level homicide rates in the USA by integrating socio-economic data using a mixture model of multiple conjugate mappings.
△ Less
Submitted 20 November, 2020;
originally announced November 2020.
-
Efficient Data Association and Uncertainty Quantification for Multi-Object Tracking
Authors:
David S. Hayden,
Sue Zheng,
John W. Fisher III
Abstract:
Robust data association is critical for analysis of long-term motion trajectories in complex scenes. In its absence, trajectory precision suffers due to periods of kinematic ambiguity degrading the quality of follow-on analysis. Common optimization-based approaches often neglect uncertainty quantification arising from these events. Consequently, we propose the Joint Posterior Tracker (JPT), a Baye…
▽ More
Robust data association is critical for analysis of long-term motion trajectories in complex scenes. In its absence, trajectory precision suffers due to periods of kinematic ambiguity degrading the quality of follow-on analysis. Common optimization-based approaches often neglect uncertainty quantification arising from these events. Consequently, we propose the Joint Posterior Tracker (JPT), a Bayesian multi-object tracking algorithm that robustly reasons over the posterior of associations and trajectories. Novel, permutation-based proposals are crafted for exploration of posterior modes that correspond to plausible association hypotheses. JPT exhibits more accurate uncertainty representation of data associations with superior performance on standard metrics when compared to existing baselines. We also show the utility of JPT applied to automatic scheduling of user-in-the-loop annotations for improved trajectory quality.
△ Less
Submitted 13 November, 2020;
originally announced November 2020.
-
Optical and magnetic signatures of the topological edge states in a dimerised donor chain
Authors:
Wei Wu,
A. J. Fisher
Abstract:
We have studied the excited states of a one-dimensional donor dimer array by using time-dependent Hartree-Fock and density-functional theories. We find that tuning the inter-donor distances can induce a topological phase transition from a topologically trivial anti-ferromagnetic ground state to a topological phase supporting spin-polarised edge states. Significant changes in the optical spectra ac…
▽ More
We have studied the excited states of a one-dimensional donor dimer array by using time-dependent Hartree-Fock and density-functional theories. We find that tuning the inter-donor distances can induce a topological phase transition from a topologically trivial anti-ferromagnetic ground state to a topological phase supporting spin-polarised edge states. Significant changes in the optical spectra accompany this transition, providing signatures for the phase transition and the existence of the edge state; the edge states lead to a robust $1s\rightarrow 2p$ atomic transition. By contrast, the bulk of the chain becomes spinless, inducing a reduction in the HOMO-LUMO gap and a decrease of the excitation energies in the optical spectra. The inclusion of physics beyond the Su-Schrieffer-Heeger-Hubbard model (long-range electron correlations and basis states beyond the 1s manifold) has a critical effect on the results and leads to the novel prediction of a change in optical response related to a topological phase transition. Our results provide a theoretical foundation for using artificial donor linear arrays in semiconductors to form topological edge states by design.
△ Less
Submitted 13 November, 2020;
originally announced November 2020.
-
Rydberg Entangling Gates in Silicon
Authors:
Eleanor Crane,
Alexander Schuckert,
Nguyen H. Le,
Andrew J. Fisher
Abstract:
In this paper, we propose a new Rydberg entangling gate scheme which we demonstrate theoretically to have an order of magnitude improvement in fidelities and speed over existing protocols. We find that applying this gate to donors in silicon would help overcome the strenuous requirements on atomic precision donor placement and substantial gate tuning, which so far has hampered scaling. We calculat…
▽ More
In this paper, we propose a new Rydberg entangling gate scheme which we demonstrate theoretically to have an order of magnitude improvement in fidelities and speed over existing protocols. We find that applying this gate to donors in silicon would help overcome the strenuous requirements on atomic precision donor placement and substantial gate tuning, which so far has hampered scaling. We calculate multivalley Rydberg interactions for several donor species using the Finite Element Method, and show that induced electric dipole and Van der Waals interactions, calculated here for the first time, are important even for low-lying excited states. We show that Rydberg gate operation is possible within the lifetime of donor excited states with 99.9% fidelity for the creation of a Bell state in the presence of decoherence.
△ Less
Submitted 24 November, 2020; v1 submitted 26 August, 2020;
originally announced August 2020.
-
Measuring Mars Atmospheric Winds From Orbit
Authors:
Scott Guzewich J. B. Abshire. M. M. Baker,
J. M. Battalio,
T. Bertrand,
A. J. Brown,
A. Colaprete,
A. M. Cook,
D. R. Cremons,
M. M. Crismani,
A. I. Dave,
M. Day,
M. -C. Desjean,
M. Elrod,
L. K. Fenton,
J. Fisher,
L. L. Gordley,
P. O. Hayne,
N. G. Heavens,
J. L. Hollingsworth,
D. Jha,
V. Jha,
M. A. Kahre,
A. SJ. Khayat,
A. M. Kling,
S. R. Lewis,
B. T. Marshall
, et al. (16 additional authors not shown)
Abstract:
Wind is the process that connects Mars' climate system. Measurements of Mars atmospheric winds from orbit would dramatically advance our understanding of Mars and help prepare for human exploration of the Red Planet. Multiple instrument candidates are in development and will be ready for flight in the next decade. We urge the Decadal Survey to make these measurements a priority for 2023-2032.
Wind is the process that connects Mars' climate system. Measurements of Mars atmospheric winds from orbit would dramatically advance our understanding of Mars and help prepare for human exploration of the Red Planet. Multiple instrument candidates are in development and will be ready for flight in the next decade. We urge the Decadal Survey to make these measurements a priority for 2023-2032.
△ Less
Submitted 10 July, 2020;
originally announced July 2020.
-
Excited states of a phosphorus pair in silicon: Effects of valley-orbital interaction and electron-electron interactions
Authors:
Wei Wu,
A. J. Fisher
Abstract:
Excitations of impurity complexes in semiconductors can not only provide a route to fill the terahertz gap in optical technologies, but can also connect local quantum bits to scale up solid-state quantum-computing devices. However, taking into account both the interactions among electrons/holes, and the host band structures, is challenging. Here we combine first-principles band-structure calculati…
▽ More
Excitations of impurity complexes in semiconductors can not only provide a route to fill the terahertz gap in optical technologies, but can also connect local quantum bits to scale up solid-state quantum-computing devices. However, taking into account both the interactions among electrons/holes, and the host band structures, is challenging. Here we combine first-principles band-structure calculations with quantum-chemistry methodology to evaluate the ground and excited states of a pair of phosphorous donors in silicon within s single framework. We use a broken-symmetry Hartree-Fock approach, followed by a time-dependent Hartree-Fock method to compute the excited states. Our Hamiltonian for each valley includes an anisotropic kinetic energy term, which splits the 2p_0 and 2p_+- transitions of isolated donors by ~4 meV, in good agreement with experiments. Our single-valley calculations show the optical response is a strong function of the optical polarisation, and suggest the use of valley polarisation to control optics and reduce oscillations in exchange interactions. When taking into account all valleys, including valley-orbital interactions, we find a gap opens between the 1s to 2p transition and low-energy charge-transfer states within 1s manifolds (which become optically allowed because of inter-donor interactions). In contrast to the single-valley case, we find charge-transfer excited states also in the triplet sector, thanks to the valley degrees of freedom. These states have a qualitatively correct energy as compared with the previous experiments; additionally, we predict new excitations below 20 meV that have not been analysed previously. A statistical average of nearest-neighbour pairs at different separations suggests that THz radiation could be used to excite pairs spin-selectively. Our approach can readily be extended to other donors and to other semiconducting hosts.
△ Less
Submitted 15 September, 2020; v1 submitted 29 June, 2020;
originally announced June 2020.
-
Bootstrapping a Powerful Mixed Portmanteau Test for Time Series
Authors:
Esam Mahdi,
Thomas J. Fisher
Abstract:
A new portmanteau test statistic is proposed for detecting nonlinearity in time series data. In this paper, we elaborate on the Toeplitz autocorrelation matrix to the autocorrelation and cross-correlation of residuals and squared residuals block matrix. We derive a new portmanteau test statistic using the log of the determinant of the mth autocorrelations and cross-correlations block matrix. The a…
▽ More
A new portmanteau test statistic is proposed for detecting nonlinearity in time series data. In this paper, we elaborate on the Toeplitz autocorrelation matrix to the autocorrelation and cross-correlation of residuals and squared residuals block matrix. We derive a new portmanteau test statistic using the log of the determinant of the mth autocorrelations and cross-correlations block matrix. The asymptotic distribution of the proposed test statistic is derived as a linear combination of chi-squared distributions and can be approximated by a gamma distribution. This test is applied to identify the linearity and nonlinearity dependency of some stationary time series models. It is shown that the convergence of the new test to its asymptotic distribution is reasonable with higher power than other tests in many situations. We demonstrate the efficiency of the proposed test by investigating linear and nonlinear effects in Vodafone Qatar and Nikkei-300 daily returns.
△ Less
Submitted 30 August, 2022; v1 submitted 2 May, 2020;
originally announced May 2020.
-
Bridging the gap between photovoltaics R&D and manufacturing with data-driven optimization
Authors:
Felipe Oviedo,
Zekun Ren,
Xue Hansong,
Siyu Isaac Parker Tian,
Kaicheng Zhang,
Mariya Layurova,
Thomas Heumueller,
Ning Li,
Erik Birgersson,
Shijing Sun,
Benji Mayurama,
Ian Marius Peters,
Christoph J. Brabec,
John Fisher III,
Tonio Buonassisi
Abstract:
Novel photovoltaics, such as perovskites and perovskite-inspired materials, have shown great promise due to high efficiency and potentially low manufacturing cost. So far, solar cell R&D has mostly focused on achieving record efficiencies, a process that often results in small batches, large variance, and limited understanding of the physical causes of underperformance. This approach is intensive…
▽ More
Novel photovoltaics, such as perovskites and perovskite-inspired materials, have shown great promise due to high efficiency and potentially low manufacturing cost. So far, solar cell R&D has mostly focused on achieving record efficiencies, a process that often results in small batches, large variance, and limited understanding of the physical causes of underperformance. This approach is intensive in time and resources, and ignores many relevant factors for industrial production, particularly the need for high reproducibility and high manufacturing yield, and the accompanying need of physical insights. The record-efficiency paradigm is effective in early-stage R&D, but becomes unsuitable for industrial translation, requiring a repetition of the optimization procedure in the industrial setting. This mismatch between optimization objectives, combined with the complexity of physical root-cause analysis, contributes to decade-long timelines to transfer new technologies into the market. Based on recent machine learning and technoeconomic advances, our perspective articulates a data-driven optimization framework to bridge R&D and manufacturing optimization approaches. We extend the maximum-efficiency optimization paradigm by considering two additional dimensions: a technoeconomic figure of merit and scalable physical inference. Our framework naturally aligns different stages of technology development with shared optimization objectives, and accelerates the optimization process by providing physical insights.
△ Less
Submitted 28 April, 2020;
originally announced April 2020.
-
Measuring Social Bias in Knowledge Graph Embeddings
Authors:
Joseph Fisher,
Dave Palfrey,
Christos Christodoulopoulos,
Arpit Mittal
Abstract:
It has recently been shown that word embeddings encode social biases, with a harmful impact on downstream tasks. However, to this point there has been no similar work done in the field of graph embeddings. We present the first study on social bias in knowledge graph embeddings, and propose a new metric suitable for measuring such bias. We conduct experiments on Wikidata and Freebase, and show that…
▽ More
It has recently been shown that word embeddings encode social biases, with a harmful impact on downstream tasks. However, to this point there has been no similar work done in the field of graph embeddings. We present the first study on social bias in knowledge graph embeddings, and propose a new metric suitable for measuring such bias. We conduct experiments on Wikidata and Freebase, and show that, as with word embeddings, harmful social biases related to professions are encoded in the embeddings with respect to gender, religion, ethnicity and nationality. For example, graph embeddings encode the information that men are more likely to be bankers, and women more likely to be homekeepers. As graph embeddings become increasingly utilized, we suggest that it is important the existence of such biases are understood and steps taken to mitigate their impact.
△ Less
Submitted 7 May, 2020; v1 submitted 5 December, 2019;
originally announced December 2019.
-
A linear combination of atomic orbitals (LCAO) model for deterministically placed acceptor arrays in silicon
Authors:
Jianhua Zhu,
Wei Wu,
A. J. Fisher
Abstract:
We develop a tight-binding model based on linear combination of atomic orbitals (LCAO) methods to describe the electronic structure of arrays of acceptors, where the underlying basis states are derived from an effective-mass-theory solution for a single acceptor in either the spherical approximation or the cubic model. Our model allows for arbitrarily strong spin-orbit coupling in the valence band…
▽ More
We develop a tight-binding model based on linear combination of atomic orbitals (LCAO) methods to describe the electronic structure of arrays of acceptors, where the underlying basis states are derived from an effective-mass-theory solution for a single acceptor in either the spherical approximation or the cubic model. Our model allows for arbitrarily strong spin-orbit coupling in the valence band of the semiconductor. We have studied pairs and dimerised linear chains of acceptors in silicon in the `independent-hole' approximation, and investigated the conditions for the existence of topological edge states in the chains. For the finite chain we find a complex interplay between electrostatic effects and the dimerisation, with the long-range Coulomb attraction of the hole to the acceptors splitting off states localised at the end acceptors from the rest of the chain. A further pair of states then splits off from each band, to form a pair localised on the next-to-end acceptors, for one sense of the bond alternation and merges into the bulk bands for the other sense of the alternation. We confirm the topologically non-trivial nature of these next-to-end localised states by calculating the Zak phase. We argue that for the more physically accessible case of one hole per acceptor these long-range electrostatic effects will be screened out; we show this by treating a simple phenomenologically screened model in which electrostatic contributions from beyond the nearest neighbours of acceptor each pair are removed. Topological states are now found on the end acceptors of the chains. In some cases the termination of the chain required to produce topological states is not the one expected on the basis of simple geometry (short versus long bonds); we argue this is because of a non-monotonic relationship between the bond length and the effective Hamiltonian matrix elements between the acceptors.
△ Less
Submitted 18 February, 2020; v1 submitted 18 October, 2019;
originally announced October 2019.
-
Merge and Label: A novel neural network architecture for nested NER
Authors:
Joseph Fisher,
Andreas Vlachos
Abstract:
Named entity recognition (NER) is one of the best studied tasks in natural language processing. However, most approaches are not capable of handling nested structures which are common in many applications. In this paper we introduce a novel neural network architecture that first merges tokens and/or entities into entities forming nested structures, and then labels each of them independently. Unlik…
▽ More
Named entity recognition (NER) is one of the best studied tasks in natural language processing. However, most approaches are not capable of handling nested structures which are common in many applications. In this paper we introduce a novel neural network architecture that first merges tokens and/or entities into entities forming nested structures, and then labels each of them independently. Unlike previous work, our merge and label approach predicts real-valued instead of discrete segmentation structures, which allow it to combine word and nested entity embeddings while maintaining differentiability. %which smoothly groups entities into single vectors across multiple levels. We evaluate our approach using the ACE 2005 Corpus, where it achieves state-of-the-art F1 of 74.6, further improved with contextual embeddings (BERT) to 82.4, an overall improvement of close to 8 F1 points over previous approaches trained on the same data. Additionally we compare it against BiLSTM-CRFs, the dominant approach for flat NER structures, demonstrating that its ability to predict nested structures does not impact performance in simpler cases.
△ Less
Submitted 30 June, 2019;
originally announced July 2019.
-
Topological phases of a dimerized Fermi-Hubbard model for semiconductor nano-lattices
Authors:
Nguyen H. Le,
Andrew J. Fisher,
Neil J. Curson,
Eran Ginossar
Abstract:
Motivated by recent advances in fabricating artificial lattices in semiconductors and their promise for quantum simulation of topological materials, we study the one-dimensional dimerized Fermi-Hubbard model. We show how the topological phases at half-filling can be characterized by a reduced Zak phase defined based on the reduced density matrix of each spin subsystem. Signatures of bulk-boundary…
▽ More
Motivated by recent advances in fabricating artificial lattices in semiconductors and their promise for quantum simulation of topological materials, we study the one-dimensional dimerized Fermi-Hubbard model. We show how the topological phases at half-filling can be characterized by a reduced Zak phase defined based on the reduced density matrix of each spin subsystem. Signatures of bulk-boundary correspondence are observed in the triplon excitation of the bulk and the edge states of uncoupled spins at the boundaries. At quarter-filling we show that owing to the presence of the Hubbard interaction the system can undergo a transition to the topological ground state of the non-interacting Su-Schrieffer-Heeger model with the application of a moderate-strength external magnetic field. We propose a robust experimental realization with a chain of dopant atoms in silicon or gate-defined quantum dots in GaAs where the transition can be probed by measuring the tunneling current through the many-body state of the chain.
△ Less
Submitted 15 February, 2020; v1 submitted 2 June, 2019;
originally announced June 2019.
-
colorspace: A Toolbox for Manipulating and Assessing Colors and Palettes
Authors:
Achim Zeileis,
Jason C. Fisher,
Kurt Hornik,
Ross Ihaka,
Claire D. McWhite,
Paul Murrell,
Reto Stauffer,
Claus O. Wilke
Abstract:
The R package colorspace provides a flexible toolbox for selecting individual colors or color palettes, manipulating these colors, and employing them in statistical graphics and data visualizations. In particular, the package provides a broad range of color palettes based on the HCL (Hue-Chroma-Luminance) color space. The three HCL dimensions have been shown to match those of the human visual syst…
▽ More
The R package colorspace provides a flexible toolbox for selecting individual colors or color palettes, manipulating these colors, and employing them in statistical graphics and data visualizations. In particular, the package provides a broad range of color palettes based on the HCL (Hue-Chroma-Luminance) color space. The three HCL dimensions have been shown to match those of the human visual system very well, thus facilitating intuitive selection of color palettes through trajectories in this space. Using the HCL color model general strategies for three types of palettes are implemented: (1) Qualitative for coding categorical information, i.e., where no particular ordering of categories is available. (2) Sequential for coding ordered/numeric information, i.e., going from high to low (or vice versa). (3) Diverging for coding ordered/numeric information around a central neutral value, i.e., where colors diverge from neutral to two extremes. To aid selection and application of these palettes the package also contains scales for use with ggplot2, shiny (and tcltk) apps for interactive exploration, visualizations of palette properties, accompanying manipulation utilities (like desaturation and lighten/darken), and emulation of color vision deficiencies.
△ Less
Submitted 14 March, 2019;
originally announced March 2019.
-
A Model for Phased Array Feed
Authors:
D. Anish Roshi,
J. Richard Fisher
Abstract:
In this report we present a model for phased array feed (PAF) and compare the model predictions with measurements. A theory for loss-less PAF is presented first. To develop the theory we ask the question -- what is the best $T_{sys}/η_{ap}$ that can be achieved when a PAF is used on a telescope to observe a source at an angle $θ_s, φ_s$ from the boresight direction ? We show that a characteristic…
▽ More
In this report we present a model for phased array feed (PAF) and compare the model predictions with measurements. A theory for loss-less PAF is presented first. To develop the theory we ask the question -- what is the best $T_{sys}/η_{ap}$ that can be achieved when a PAF is used on a telescope to observe a source at an angle $θ_s, φ_s$ from the boresight direction ? We show that a characteristic matrix for the {\em system} (i.e. PAF+telescope+receiver) can be constructed starting from the signal-to-noise ratio of the observations and the best $T_{sys}/η_{ap}$ can be obtained from the maximum eigenvalue of the characteristic matrix. For constructing the characteristic matrix, we derive the open-circuit voltage at the output of the antenna elements in the PAF due to (a) radiation from source, (b) radiation from ground (spillover), (c) radiation from sky background and (d) noise due to the receiver. The characteristic matrix is then obtained from the correlation matrices of these voltages. We then describe a modeling program developed to implement the theory presented here. Finally the model predictions are compared with results from test observations made toward Virgo A with a prototype PAF (Kite array) on the GBT (Roshi et al. 2015).
△ Less
Submitted 4 February, 2019;
originally announced February 2019.
-
Model for a Noise Matched Phased Array Feed
Authors:
D. Anish Roshi,
W. Shillue,
J. Richard Fisher
Abstract:
We present a model for a Noise Matched Phased Array Feed (PAF) system and compare model predictions with the measurement results. The PAF system consists of an array feed, a receiver, a beamformer and a parabolic reflector. The novel aspect of our model is the characterization of the {\em PAF system} by a single matrix. This characteristic matrix is constructed from the open-circuit voltage covari…
▽ More
We present a model for a Noise Matched Phased Array Feed (PAF) system and compare model predictions with the measurement results. The PAF system consists of an array feed, a receiver, a beamformer and a parabolic reflector. The novel aspect of our model is the characterization of the {\em PAF system} by a single matrix. This characteristic matrix is constructed from the open-circuit voltage covariance at the output of the PAF due to signal from the observing source, ground spillover noise, sky background noise and (low-noise) amplifier (LNA) noise. The best signal-to-noise ratio on the source achievable with the PAF system will be the maximum eigenvalue of the characteristic matrix. The voltage covariance due to signal and spillover noise are derived by applying the Lorentz reciprocity theorem. The receiver noise covariance and noise temperature are obtained in terms of Lange invariants such that they are suitable for noise matching the array feed. The model predictions are compared with the measured performance of a 1.4 GHz, 19-element, dual-polarized PAF on the Robert C. Byrd Green Bank Telescope. We show that the model predictions, obtained with an additional noise contribution due to the measured losses ahead of the low-noise amplifier, compare well with the measured ratio of system temperature to aperture efficiency as a function of frequency and as a function of offset from the boresight. Further, our modeling indicates that the bandwidth over which this ratio is optimum can be improved by a factor of at least two by noise matching the PAF with the LNA.
△ Less
Submitted 6 February, 2019; v1 submitted 4 February, 2019;
originally announced February 2019.
-
Optically Controlled Entangling Gates in Randomly Doped Silicon
Authors:
Eleanor Crane,
Thomas Crane,
Nguyen H. Le,
Alexander Schuckert,
Andrew J. Fisher
Abstract:
Randomly-doped silicon has many competitive advantages for quantum computation; not only is it fast to fabricate but it could naturally contain high numbers of qubits and logic gates as a function of doping densities. We determine the densities of entangling gates in randomly doped silicon comprising two different dopant species. First, we define conditions and plot maps of the relative locations…
▽ More
Randomly-doped silicon has many competitive advantages for quantum computation; not only is it fast to fabricate but it could naturally contain high numbers of qubits and logic gates as a function of doping densities. We determine the densities of entangling gates in randomly doped silicon comprising two different dopant species. First, we define conditions and plot maps of the relative locations of the dopants necessary for them to form exchange interaction mediated entangling gates. Second, using nearest neighbour Poisson point process theory, we calculate the doping densities necessary for maximal densities of single and dual-species gates. We find agreement of our results with a Monte Carlo simulation, for which we present the algorithms, which handles multiple donor structures and scales optimally with the number of dopants and use it to extract donor structures not captured by our Poisson point process theory. Third, using the moving average cluster expansion technique, we make predictions for a proof of principle experiment demonstrating the control of one species by the orbital excitation of another. These combined approaches to density optimization in random distributions may be useful for other condensed matter systems as well as applications outside physics.
△ Less
Submitted 1 February, 2019;
originally announced February 2019.