Showing 1–50 of 119 results for author: Gupta, J

Symmetric Encryption Scheme Based on Quasigroup Using Chained Mode of Operation

Authors: Satish Kumar, Harshdeep Singh, Indivar Gupta, Ashok Ji Gupta

Abstract: In this paper, we propose a novel construction for a symmetric encryption scheme, referred as SEBQ which is based on the structure of quasigroup. We utilize concepts of chaining like mode of operation and present a block cipher with in-built properties. We prove that SEBQ shows resistance against chosen plaintext attack (CPA) and by applying unbalanced Feistel transformation [19], it achieves secu… ▽ More In this paper, we propose a novel construction for a symmetric encryption scheme, referred as SEBQ which is based on the structure of quasigroup. We utilize concepts of chaining like mode of operation and present a block cipher with in-built properties. We prove that SEBQ shows resistance against chosen plaintext attack (CPA) and by applying unbalanced Feistel transformation [19], it achieves security against chosen ciphertext attacks (CCA). Subsequently, we conduct an assessment of the randomness of the proposed scheme by running the NIST test suite and we analyze the impact of the initial vector, secret key and plaintext on ciphertext through an avalanche effect analysis. We also compare the results with existing schemes based on quasigroups [11,46]. Moreover, we analyze the computational complexity in terms of number of operations needed for encryption and decryption process. △ Less

Submitted 8 August, 2024; originally announced August 2024.

MSC Class: 20N05; 05B15; 94A60; 68W20

Structural Reorganizations and Nanodomain Emergence in Lipid Membrane Driven by Ionic Liquids

Authors: J. Gupta, V. K. Sharma, P. Hitaishi, H. Srinivasan, S. Kumar, S. K. Ghosh, S. Mitra

Abstract: The exceptional physicochemical properties and versatile biological activities of ionic liquids (ILs) have propelled their potential applications in various industries, including pharmaceuticals and green chemistry. However, their widespread use is limited by concerns over toxicity, particularly due to interactions with cell membranes. This study examines the effects of imidazolium-based ILs on th… ▽ More The exceptional physicochemical properties and versatile biological activities of ionic liquids (ILs) have propelled their potential applications in various industries, including pharmaceuticals and green chemistry. However, their widespread use is limited by concerns over toxicity, particularly due to interactions with cell membranes. This study examines the effects of imidazolium-based ILs on the microscopic structure and phase behavior of a model cell membrane composed of zwitterionic dipalmitoylphosphatidylcholine (DPPC) lipid. Small-angle neutron scattering and dynamic light scattering reveal that the shorter chain IL, 1-hexyl-3-methylimidazolium bromide (HMIM[Br]), induces aggregation of DPPC unilamellar vesicles. In contrast, this aggregation is absent with the longer alkyl chain IL, 1-decyl-3-methylimidazolium bromide (DMIM[Br]). Instead, DMIM[Br] incorporation leads to the formation of distinct IL-poor and IL-rich nanodomains within the DPPC membrane, as evidenced by X-ray reflectivity, differential scanning calorimetry, and molecular dynamics simulation. The less evident nanodomain formation with HMIM[Br] underscores the role of hydrophobic interactions between lipid alkyl tails and ILs. Our findings demonstrate that longer alkyl chains in ILs significantly enhance their propensity to form membrane nanodomains and increase membrane permeability, directly correlating with higher cytotoxicity. This crucial link between nanodomains and toxicity provides valuable insights for designing safer, more environmentally friendly ILs, and promoting their use in biomedical applications and sustainable industrial processes. △ Less

Submitted 26 July, 2024; originally announced July 2024.

Communicating the gravitational-wave discoveries of the LIGO-Virgo-KAGRA Collaboration

Authors: Hannah Middleton, Christopher P L Berry, Nicolas Arnaud, David Blair, Jacqueline Bondell, Nicolas Bonne, Debarati Chatterjee, Sylvain Chaty, Storm Colloms, Lynn Cominsky, Livia Conti, Isabel Cordero-Carrión, Robert Coyne, Zoheyr Doctor, Andreas Freise, Aaron Geller, Jen Gupta, Daniel Holz, William Katzman, David Keitel, Joey Shapiro Key, Nutsinee Kijbunchoo, Carl Knox, Coleman Krawczyk, Ryan N Lang , et al. (5 additional authors not shown)

Abstract: The LIGO-Virgo-KAGRA (LVK) Collaboration has made breakthrough discoveries in gravitational-wave astronomy, a new field of astronomy that provides a different means of observing our Universe. Gravitational-wave discoveries are possible thanks to the work of thousands of people from across the globe working together. In this article, we discuss the range of engagement activities used to communicate… ▽ More The LIGO-Virgo-KAGRA (LVK) Collaboration has made breakthrough discoveries in gravitational-wave astronomy, a new field of astronomy that provides a different means of observing our Universe. Gravitational-wave discoveries are possible thanks to the work of thousands of people from across the globe working together. In this article, we discuss the range of engagement activities used to communicate LVK gravitational-wave discoveries and the stories of the people behind the science using the activities surrounding the release of the third Gravitational Wave Transient Catalog as a case study. △ Less

Submitted 29 July, 2024; v1 submitted 26 July, 2024; originally announced July 2024.

Comments: 11 pages, 5 figures, submitted to JCOM

Report number: LIGO DCC: P2400039

A general and modular approach to solid-state integration and readout of zero-dimensional quantum systems

Authors: Marzieh Kavand, Zoe Phillips, William H. Koll, Morgan Hamilton, Ethel Perez-Hoyos, Rianna Greer, Ferdous Ara, Dan Pharis, Mehdi Maleki Sanukesh, Mingyu Xu, Takashi Taniguchi, Paul Canfield, Michael E. Flatté, Danna E. Freedman, Jay Gupta, Ezekiel Johnston-Halperin

Abstract: Electronic spectroscopy of zero-dimensional (0D) quantum systems, including point defects in solids, atomic states, and small molecules, is a critical tool for developing a fundamental understanding of these systems, with applications ranging from solid-state and molecular materials development to emerging technologies rooted in quantum information science. Toward this end, scanning tunneling spec… ▽ More Electronic spectroscopy of zero-dimensional (0D) quantum systems, including point defects in solids, atomic states, and small molecules, is a critical tool for developing a fundamental understanding of these systems, with applications ranging from solid-state and molecular materials development to emerging technologies rooted in quantum information science. Toward this end, scanning tunneling spectroscopy (STS) has demonstrated atomic-scale sensitivity, but is not easily scalable for applications, whereas device-based approaches rely on embedding these systems within a solid-state tunnel junction (TJ) and are not generally applicable. Here we demonstrate an all-electrical readout mechanism for these quasi-0D states that is modular and general, dramatically expanding the phase space of accessible quantum systems and providing an approach that is amenable to scaling and integration with other solid-state quantum technologies. Our approach relies on the creation of high-quality tunnel junctions via the mechanical exfoliation and stacking of multi-layer graphene (MLG) and hexagonal boron nitride (hBN) to encapsulate the target quantum system (QS) in an MLG/hBN/QS/hBN/MLG heterostructure. This structure allows for electronic spectroscopy and readout of candidate quantum systems through a combination of Coulomb and spin-blockade, providing access to entire classes of quantum systems that have previously only been accessible via optical spectroscopy or magnetic resonance measurements of large ensembles, if at all. △ Less

Submitted 31 July, 2024; v1 submitted 15 July, 2024; originally announced July 2024.

Lipid Lateral Diffusion: Mechanisms and Modulators

Authors: V. K. Sharma, H. Srinivasan, J. Gupta, S. Mitra

Abstract: The lateral diffusion of lipids within membrane is of paramount importance, serving as a central mechanism in numerous physiological processes including cell signaling, membrane trafficking, protein activity regulation, and energy transduction pathways. This review offers a comprehensive overview of lateral lipid diffusion in model biomembrane systems explored through the lens of neutron scatterin… ▽ More The lateral diffusion of lipids within membrane is of paramount importance, serving as a central mechanism in numerous physiological processes including cell signaling, membrane trafficking, protein activity regulation, and energy transduction pathways. This review offers a comprehensive overview of lateral lipid diffusion in model biomembrane systems explored through the lens of neutron scattering techniques. We examine diverse models of lateral diffusion and explore the various factors influencing this fundamental process in membrane dynamics. Additionally, we offer a thorough summary of how different membrane-active compounds, including drugs, antioxidants, stimulants, and membrane proteins, affect lipid lateral diffusion. Our analysis unveils the intricate interplay between these additives and membranes, shedding light on their dynamic interactions. We elucidate that this interaction is governed by a complex combination of multiple factors including the physical state and charge of the membrane, the concentration of additives, the molecular architecture of the compounds, and their spatial distribution within the membrane. In conclusion, we briefly discuss the future directions and areas requiring further investigation in the realm of lateral lipid diffusion, highlighting the need to study more realistic membrane systems. △ Less

Submitted 7 July, 2024; originally announced July 2024.

Reducing False Discoveries in Statistically-Significant Regional-Colocation Mining: A Summary of Results

Authors: Subhankar Ghosh, Jayant Gupta, Arun Sharma, Shuai An, Shashi Shekhar

Abstract: Given a set \emph{S} of spatial feature types, its feature instances, a study area, and a neighbor relationship, the goal is to find pairs $<$a region ($r_{g}$), a subset \emph{C} of \emph{S}$>$ such that \emph{C} is a statistically significant regional-colocation pattern in $r_{g}$. This problem is important for applications in various domains including ecology, economics, and sociology. The prob… ▽ More Given a set \emph{S} of spatial feature types, its feature instances, a study area, and a neighbor relationship, the goal is to find pairs $<$a region ($r_{g}$), a subset \emph{C} of \emph{S}$>$ such that \emph{C} is a statistically significant regional-colocation pattern in $r_{g}$. This problem is important for applications in various domains including ecology, economics, and sociology. The problem is computationally challenging due to the exponential number of regional colocation patterns and candidate regions. Previously, we proposed a miner \cite{10.1145/3557989.3566158} that finds statistically significant regional colocation patterns. However, the numerous simultaneous statistical inferences raise the risk of false discoveries (also known as the multiple comparisons problem) and carry a high computational cost. We propose a novel algorithm, namely, multiple comparisons regional colocation miner (MultComp-RCM) which uses a Bonferroni correction. Theoretical analysis, experimental evaluation, and case study results show that the proposed method reduces both the false discovery rate and computational cost. △ Less

Submitted 1 July, 2024; originally announced July 2024.

ACM Class: E.m; F.2; E.1; H.3; I.5; J.0

Towards Statistically Significant Taxonomy Aware Co-location Pattern Detection

Authors: Subhankar Ghosh, Arun Sharma, Jayant Gupta, Shashi Shekhar

Abstract: Given a collection of Boolean spatial feature types, their instances, a neighborhood relation (e.g., proximity), and a hierarchical taxonomy of the feature types, the goal is to find the subsets of feature types or their parents whose spatial interaction is statistically significant. This problem is for taxonomy-reliant applications such as ecology (e.g., finding new symbiotic relationships across… ▽ More Given a collection of Boolean spatial feature types, their instances, a neighborhood relation (e.g., proximity), and a hierarchical taxonomy of the feature types, the goal is to find the subsets of feature types or their parents whose spatial interaction is statistically significant. This problem is for taxonomy-reliant applications such as ecology (e.g., finding new symbiotic relationships across the food chain), spatial pathology (e.g., immunotherapy for cancer), retail, etc. The problem is computationally challenging due to the exponential number of candidate co-location patterns generated by the taxonomy. Most approaches for co-location pattern detection overlook the hierarchical relationships among spatial features, and the statistical significance of the detected patterns is not always considered, leading to potential false discoveries. This paper introduces two methods for incorporating taxonomies and assessing the statistical significance of co-location patterns. The baseline approach iteratively checks the significance of co-locations between leaf nodes or their ancestors in the taxonomy. Using the Benjamini-Hochberg procedure, an advanced approach is proposed to control the false discovery rate. This approach effectively reduces the risk of false discoveries while maintaining the power to detect true co-location patterns. Experimental evaluation and case study results show the effectiveness of the approach. △ Less

Submitted 4 July, 2024; v1 submitted 29 June, 2024; originally announced July 2024.

Comments: Accepted in The 16th Conference on Spatial Information Theory (COSIT) 2024

ACM Class: E.m; H.3.3; I.5; J.4; J.4

MacroQueue: Automating Measurements in High-Dimensional Parameter Spaces

Authors: Brad M. Goff, Jay A. Gupta

Abstract: Laboratory measurements often use several instruments to fully explore the relevant parameter space; such as, an external lock-in amplifier, an electromagnet, an RF generator, etc.. Ordinarily, these instruments have to be individually controlled and their parameters have to be manually recorded. MacroQueue enables effortless measurements throughout these high-dimensional parameter space systems.… ▽ More Laboratory measurements often use several instruments to fully explore the relevant parameter space; such as, an external lock-in amplifier, an electromagnet, an RF generator, etc.. Ordinarily, these instruments have to be individually controlled and their parameters have to be manually recorded. MacroQueue enables effortless measurements throughout these high-dimensional parameter space systems. MacroQueue is a modular software designed for controlling and automating various laboratory equipment in sync without requiring coding ability. Currently, it includes functions to control the 3 major commercial scanning tunneling microscopes, CreaTec, RHK, and Scienta Omicron in combination with any other instruments that are a part of the systems. It can be extended to control any instrument that can be controlled via Python. △ Less

Submitted 14 May, 2024; originally announced June 2024.

Comments: 4 pages; 3 figures

Aurora: A Foundation Model of the Atmosphere

Authors: Cristian Bodnar, Wessel P. Bruinsma, Ana Lucic, Megan Stanley, Johannes Brandstetter, Patrick Garvan, Maik Riechert, Jonathan Weyn, Haiyu Dong, Anna Vaughan, Jayesh K. Gupta, Kit Tambiratnam, Alex Archibald, Elizabeth Heider, Max Welling, Richard E. Turner, Paris Perdikaris

Abstract: Deep learning foundation models are revolutionizing many facets of science by leveraging vast amounts of data to learn general-purpose representations that can be adapted to tackle diverse downstream tasks. Foundation models hold the promise to also transform our ability to model our planet and its subsystems by exploiting the vast expanse of Earth system data. Here we introduce Aurora, a large-sc… ▽ More Deep learning foundation models are revolutionizing many facets of science by leveraging vast amounts of data to learn general-purpose representations that can be adapted to tackle diverse downstream tasks. Foundation models hold the promise to also transform our ability to model our planet and its subsystems by exploiting the vast expanse of Earth system data. Here we introduce Aurora, a large-scale foundation model of the atmosphere trained on over a million hours of diverse weather and climate data. Aurora leverages the strengths of the foundation modelling approach to produce operational forecasts for a wide variety of atmospheric prediction problems, including those with limited training data, heterogeneous variables, and extreme events. In under a minute, Aurora produces 5-day global air pollution predictions and 10-day high-resolution weather forecasts that outperform state-of-the-art classical simulation tools and the best specialized deep learning models. Taken together, these results indicate that foundation models can transform environmental forecasting. △ Less

Submitted 28 May, 2024; v1 submitted 20 May, 2024; originally announced May 2024.

Predicting Traffic Congestion at Urban Intersections Using Data-Driven Modeling

Authors: Tara Kelly, Jessica Gupta

Abstract: Traffic congestion at intersections is a significant issue in urban areas, leading to increased commute times, safety hazards, and operational inefficiencies. This study aims to develop a predictive model for congestion at intersections in major U.S. cities, utilizing a dataset of trip-logging metrics from commercial vehicles across 4,800 intersections. The dataset encompasses 27 features, includi… ▽ More Traffic congestion at intersections is a significant issue in urban areas, leading to increased commute times, safety hazards, and operational inefficiencies. This study aims to develop a predictive model for congestion at intersections in major U.S. cities, utilizing a dataset of trip-logging metrics from commercial vehicles across 4,800 intersections. The dataset encompasses 27 features, including intersection coordinates, street names, time of day, and traffic metrics (Kashyap et al., 2019). Additional features, such as rainfall/snowfall percentage, distance from downtown and outskirts, and road types, were incorporated to enhance the model's predictive power. The methodology involves data exploration, feature transformation, and handling missing values through low-rank models and label encoding. The proposed model has the potential to assist city planners and governments in anticipating traffic hot spots, optimizing operations, and identifying infrastructure challenges. △ Less

Submitted 7 June, 2024; v1 submitted 12 April, 2024; originally announced April 2024.

The Physics of Antimicrobial Activity of Ionic Liquids

Authors: V. K. Sharma, J. Gupta, J. Bhatt Mitra, H. Srinivasan, V. García Sakai, S. K. Ghosh, S. Mitra

Abstract: The bactericidal potency of ionic liquids (ILs) is well-established, yet their precise mechanism of action remains elusive. Here, we show evidence that the bactericidal action of ILs primarily involves permeabilizing the bacterial cell membrane. Our findings reveal that ILs exert their effects by directly interacting with the lipid bilayer and enhancing the membrane dynamics. Lateral lipid diffusi… ▽ More The bactericidal potency of ionic liquids (ILs) is well-established, yet their precise mechanism of action remains elusive. Here, we show evidence that the bactericidal action of ILs primarily involves permeabilizing the bacterial cell membrane. Our findings reveal that ILs exert their effects by directly interacting with the lipid bilayer and enhancing the membrane dynamics. Lateral lipid diffusion is accelerated which in turn augments membrane permeability, ultimately leading to bacterial death. Furthermore, our results establish a significant connection: an increase in the alkyl chain length of ILs correlates with a notable enhancement in both lipid lateral diffusion and antimicrobial potency. This underscores a compelling correlation between membrane dynamics and antimicrobial effectiveness, providing valuable insights for the rational design and optimization of IL-based antimicrobial agents in healthcare applications. △ Less

Submitted 24 June, 2024; v1 submitted 10 April, 2024; originally announced April 2024.

VoicePilot: Harnessing LLMs as Speech Interfaces for Physically Assistive Robots

Authors: Akhil Padmanabha, Jessie Yuan, Janavi Gupta, Zulekha Karachiwalla, Carmel Majidi, Henny Admoni, Zackory Erickson

Abstract: Physically assistive robots present an opportunity to significantly increase the well-being and independence of individuals with motor impairments or other forms of disability who are unable to complete activities of daily living. Speech interfaces, especially ones that utilize Large Language Models (LLMs), can enable individuals to effectively and naturally communicate high-level commands and nua… ▽ More Physically assistive robots present an opportunity to significantly increase the well-being and independence of individuals with motor impairments or other forms of disability who are unable to complete activities of daily living. Speech interfaces, especially ones that utilize Large Language Models (LLMs), can enable individuals to effectively and naturally communicate high-level commands and nuanced preferences to robots. Frameworks for integrating LLMs as interfaces to robots for high level task planning and code generation have been proposed, but fail to incorporate human-centric considerations which are essential while developing assistive interfaces. In this work, we present a framework for incorporating LLMs as speech interfaces for physically assistive robots, constructed iteratively with 3 stages of testing involving a feeding robot, culminating in an evaluation with 11 older adults at an independent living facility. We use both quantitative and qualitative data from the final study to validate our framework and additionally provide design guidelines for using LLMs as speech interfaces for assistive robots. Videos and supporting files are located on our project website: https://sites.google.com/andrew.cmu.edu/voicepilot/ △ Less

Submitted 16 July, 2024; v1 submitted 5 April, 2024; originally announced April 2024.

Formation of Oriented Bilayer Motif -- Vanadyl Phthalocyanine on Ag(100)

Authors: William Koll, Corina Urdaniz, Kyungju Noh, Yujeong Bae, Christoph Wolf, Jay Gupta

Abstract: The adsorption and self-assembly of vanadyl phthalocyanine molecules on Ag(100) has been investigated using a combination of scanning tunneling microscopy and density functional theory. At sub-monolayer coverage, we observe two distinct adsorption configurations of isolated molecules, corresponding to the central O atom pointing toward (O-down) or away (O-up) from the substrate. Upon adsorption in… ▽ More The adsorption and self-assembly of vanadyl phthalocyanine molecules on Ag(100) has been investigated using a combination of scanning tunneling microscopy and density functional theory. At sub-monolayer coverage, we observe two distinct adsorption configurations of isolated molecules, corresponding to the central O atom pointing toward (O-down) or away (O-up) from the substrate. Upon adsorption in the O-up orientation, the otherwise achiral molecules take on a windmill-like chiral appearance due to their interaction with the substrate. At monolayer coverage, we observe a self-assembled square lattice with a mixture of O-up and O-down molecules. At higher coverage we find a strong preference for bilayer formation with O-up and O-down molecules in alternating layers, suggesting stabilization by dipolar interactions. Close inspection of the multi-layer surface reveals grain boundaries separating domains of opposite organizational chirality, and long-range ordering. △ Less

Submitted 28 March, 2024; originally announced March 2024.

Comments: 15 pages, 5 figures

Towards Spatially-Lucid AI Classification in Non-Euclidean Space: An Application for MxIF Oncology Data

Authors: Majid Farhadloo, Arun Sharma, Jayant Gupta, Alexey Leontovich, Svetomir N. Markovic, Shashi Shekhar

Abstract: Given multi-category point sets from different place-types, our goal is to develop a spatially-lucid classifier that can distinguish between two classes based on the arrangements of their points. This problem is important for many applications, such as oncology, for analyzing immune-tumor relationships and designing new immunotherapies. It is challenging due to spatial variability and interpretabi… ▽ More Given multi-category point sets from different place-types, our goal is to develop a spatially-lucid classifier that can distinguish between two classes based on the arrangements of their points. This problem is important for many applications, such as oncology, for analyzing immune-tumor relationships and designing new immunotherapies. It is challenging due to spatial variability and interpretability needs. Previously proposed techniques require dense training data or have limited ability to handle significant spatial variability within a single place-type. Most importantly, these deep neural network (DNN) approaches are not designed to work in non-Euclidean space, particularly point sets. Existing non-Euclidean DNN methods are limited to one-size-fits-all approaches. We explore a spatial ensemble framework that explicitly uses different training strategies, including weighted-distance learning rate and spatial domain adaptation, on various place-types for spatially-lucid classification. Experimental results on real-world datasets (e.g., MxIF oncology data) show that the proposed framework provides higher prediction accuracy than baseline methods. △ Less

Submitted 22 February, 2024; originally announced February 2024.

Comments: SIAM International Conference on Data Mining (SDM24)

Independence in the Home: A Wearable Interface for a Person with Quadriplegia to Teleoperate a Mobile Manipulator

Authors: Akhil Padmanabha, Janavi Gupta, Chen Chen, Jehan Yang, Vy Nguyen, Douglas J. Weber, Carmel Majidi, Zackory Erickson

Abstract: Teleoperation of mobile manipulators within a home environment can significantly enhance the independence of individuals with severe motor impairments, allowing them to regain the ability to perform self-care and household tasks. There is a critical need for novel teleoperation interfaces to offer effective alternatives for individuals with impairments who may encounter challenges in using existin… ▽ More Teleoperation of mobile manipulators within a home environment can significantly enhance the independence of individuals with severe motor impairments, allowing them to regain the ability to perform self-care and household tasks. There is a critical need for novel teleoperation interfaces to offer effective alternatives for individuals with impairments who may encounter challenges in using existing interfaces due to physical limitations. In this work, we iterate on one such interface, HAT (Head-Worn Assistive Teleoperation), an inertial-based wearable integrated into any head-worn garment. We evaluate HAT through a 7-day in-home study with Henry Evans, a non-speaking individual with quadriplegia who has participated extensively in assistive robotics studies. We additionally evaluate HAT with a proposed shared control method for mobile manipulators termed Driver Assistance and demonstrate how the interface generalizes to other physical devices and contexts. Our results show that HAT is a strong teleoperation interface across key metrics including efficiency, errors, learning curve, and workload. Code and videos are located on our project website. △ Less

Submitted 2 January, 2024; v1 submitted 22 December, 2023; originally announced December 2023.

Gemini: A Family of Highly Capable Multimodal Models

Authors: Gemini Team, Rohan Anil, Sebastian Borgeaud, Jean-Baptiste Alayrac, Jiahui Yu, Radu Soricut, Johan Schalkwyk, Andrew M. Dai, Anja Hauth, Katie Millican, David Silver, Melvin Johnson, Ioannis Antonoglou, Julian Schrittwieser, Amelia Glaese, Jilin Chen, Emily Pitler, Timothy Lillicrap, Angeliki Lazaridou, Orhan Firat, James Molloy, Michael Isard, Paul R. Barham, Tom Hennigan, Benjamin Lee , et al. (1325 additional authors not shown)

Abstract: This report introduces a new family of multimodal models, Gemini, that exhibit remarkable capabilities across image, audio, video, and text understanding. The Gemini family consists of Ultra, Pro, and Nano sizes, suitable for applications ranging from complex reasoning tasks to on-device memory-constrained use-cases. Evaluation on a broad range of benchmarks shows that our most-capable Gemini Ultr… ▽ More This report introduces a new family of multimodal models, Gemini, that exhibit remarkable capabilities across image, audio, video, and text understanding. The Gemini family consists of Ultra, Pro, and Nano sizes, suitable for applications ranging from complex reasoning tasks to on-device memory-constrained use-cases. Evaluation on a broad range of benchmarks shows that our most-capable Gemini Ultra model advances the state of the art in 30 of 32 of these benchmarks - notably being the first model to achieve human-expert performance on the well-studied exam benchmark MMLU, and improving the state of the art in every one of the 20 multimodal benchmarks we examined. We believe that the new capabilities of the Gemini family in cross-modal reasoning and language understanding will enable a wide variety of use cases. We discuss our approach toward post-training and deploying Gemini models responsibly to users through services including Gemini, Gemini Advanced, Google AI Studio, and Cloud Vertex AI. △ Less

Submitted 17 June, 2024; v1 submitted 18 December, 2023; originally announced December 2023.

SEMQA: Semi-Extractive Multi-Source Question Answering

Authors: Tal Schuster, Adam D. Lelkes, Haitian Sun, Jai Gupta, Jonathan Berant, William W. Cohen, Donald Metzler

Abstract: Recently proposed long-form question answering (QA) systems, supported by large language models (LLMs), have shown promising capabilities. Yet, attributing and verifying their generated abstractive answers can be difficult, and automatically evaluating their accuracy remains an ongoing challenge. In this work, we introduce a new QA task for answering multi-answer questions by summarizing multipl… ▽ More Recently proposed long-form question answering (QA) systems, supported by large language models (LLMs), have shown promising capabilities. Yet, attributing and verifying their generated abstractive answers can be difficult, and automatically evaluating their accuracy remains an ongoing challenge. In this work, we introduce a new QA task for answering multi-answer questions by summarizing multiple diverse sources in a semi-extractive fashion. Specifically, Semi-extractive Multi-source QA (SEMQA) requires models to output a comprehensive answer, while mixing factual quoted spans -- copied verbatim from given input sources -- and non-factual free-text connectors that glue these spans together into a single cohesive passage. This setting bridges the gap between the outputs of well-grounded but constrained extractive QA systems and more fluent but harder to attribute fully abstractive answers. Particularly, it enables a new mode for language models that leverages their advanced language generation capabilities, while also producing fine in-line attributions by-design that are easy to verify, interpret, and evaluate. To study this task, we create the first dataset of this kind, QuoteSum, with human-written semi-extractive answers to natural and generated questions, and define text-based evaluation metrics. Experimenting with several LLMs in various settings, we find this task to be surprisingly challenging, demonstrating the importance of QuoteSum for developing and studying such consolidation capabilities. △ Less

Submitted 30 June, 2024; v1 submitted 8 November, 2023; originally announced November 2023.

Comments: NAACL 2024

Reducing Uncertainty in Sea-level Rise Prediction: A Spatial-variability-aware Approach

Authors: Subhankar Ghosh, Shuai An, Arun Sharma, Jayant Gupta, Shashi Shekhar, Aneesh Subramanian

Abstract: Given multi-model ensemble climate projections, the goal is to accurately and reliably predict future sea-level rise while lowering the uncertainty. This problem is important because sea-level rise affects millions of people in coastal communities and beyond due to climate change's impacts on polar ice sheets and the ocean. This problem is challenging due to spatial variability and unknowns such a… ▽ More Given multi-model ensemble climate projections, the goal is to accurately and reliably predict future sea-level rise while lowering the uncertainty. This problem is important because sea-level rise affects millions of people in coastal communities and beyond due to climate change's impacts on polar ice sheets and the ocean. This problem is challenging due to spatial variability and unknowns such as possible tipping points (e.g., collapse of Greenland or West Antarctic ice-shelf), climate feedback loops (e.g., clouds, permafrost thawing), future policy decisions, and human actions. Most existing climate modeling approaches use the same set of weights globally, during either regression or deep learning to combine different climate projections. Such approaches are inadequate when different regions require different weighting schemes for accurate and reliable sea-level rise predictions. This paper proposes a zonal regression model which addresses spatial variability and model inter-dependency. Experimental results show more reliable predictions using the weights learned via this approach on a regional scale. △ Less

Submitted 18 October, 2023; originally announced October 2023.

Comments: 6 pages, 5 figures, I-GUIDE 2023 conference

ACM Class: J.2; I.2.m; I.2.6; I.2.1; I.2

EvDNeRF: Reconstructing Event Data with Dynamic Neural Radiance Fields

Authors: Anish Bhattacharya, Ratnesh Madaan, Fernando Cladera, Sai Vemprala, Rogerio Bonatti, Kostas Daniilidis, Ashish Kapoor, Vijay Kumar, Nikolai Matni, Jayesh K. Gupta

Abstract: We present EvDNeRF, a pipeline for generating event data and training an event-based dynamic NeRF, for the purpose of faithfully reconstructing eventstreams on scenes with rigid and non-rigid deformations that may be too fast to capture with a standard camera. Event cameras register asynchronous per-pixel brightness changes at MHz rates with high dynamic range, making them ideal for observing fast… ▽ More We present EvDNeRF, a pipeline for generating event data and training an event-based dynamic NeRF, for the purpose of faithfully reconstructing eventstreams on scenes with rigid and non-rigid deformations that may be too fast to capture with a standard camera. Event cameras register asynchronous per-pixel brightness changes at MHz rates with high dynamic range, making them ideal for observing fast motion with almost no motion blur. Neural radiance fields (NeRFs) offer visual-quality geometric-based learnable rendering, but prior work with events has only considered reconstruction of static scenes. Our EvDNeRF can predict eventstreams of dynamic scenes from a static or moving viewpoint between any desired timestamps, thereby allowing it to be used as an event-based simulator for a given scene. We show that by training on varied batch sizes of events, we can improve test-time predictions of events at fine time resolutions, outperforming baselines that pair standard dynamic NeRFs with event generators. We release our simulated and real datasets, as well as code for multi-view event-based data generation and the training and evaluation of EvDNeRF models (https://github.com/anish-bhattacharya/EvDNeRF). △ Less

Submitted 6 December, 2023; v1 submitted 3 October, 2023; originally announced October 2023.

Comments: 16 pages, 20 figures, 2 tables

How Does Generative Retrieval Scale to Millions of Passages?

Authors: Ronak Pradeep, Kai Hui, Jai Gupta, Adam D. Lelkes, Honglei Zhuang, Jimmy Lin, Donald Metzler, Vinh Q. Tran

Abstract: Popularized by the Differentiable Search Index, the emerging paradigm of generative retrieval re-frames the classic information retrieval problem into a sequence-to-sequence modeling task, forgoing external indices and encoding an entire document corpus within a single Transformer. Although many different approaches have been proposed to improve the effectiveness of generative retrieval, they have… ▽ More Popularized by the Differentiable Search Index, the emerging paradigm of generative retrieval re-frames the classic information retrieval problem into a sequence-to-sequence modeling task, forgoing external indices and encoding an entire document corpus within a single Transformer. Although many different approaches have been proposed to improve the effectiveness of generative retrieval, they have only been evaluated on document corpora on the order of 100k in size. We conduct the first empirical study of generative retrieval techniques across various corpus scales, ultimately scaling up to the entire MS MARCO passage ranking task with a corpus of 8.8M passages and evaluating model sizes up to 11B parameters. We uncover several findings about scaling generative retrieval to millions of passages; notably, the central importance of using synthetic queries as document representations during indexing, the ineffectiveness of existing proposed architecture modifications when accounting for compute cost, and the limits of naively scaling model parameters with respect to retrieval performance. While we find that generative retrieval is competitive with state-of-the-art dual encoders on small corpora, scaling to millions of passages remains an important and unsolved challenge. We believe these findings will be valuable for the community to clarify the current state of generative retrieval, highlight the unique challenges, and inspire new research directions. △ Less

Submitted 19 May, 2023; originally announced May 2023.

A Survey on Solving and Discovering Differential Equations Using Deep Neural Networks

Authors: Hyeonjung, Jung, Jayant Gupta, Bharat Jayaprakash, Matthew Eagon, Harish Panneer Selvam, Carl Molnar, William Northrop, Shashi Shekhar

Abstract: Ordinary and partial differential equations (DE) are used extensively in scientific and mathematical domains to model physical systems. Current literature has focused primarily on deep neural network (DNN) based methods for solving a specific DE or a family of DEs. Research communities with a history of using DE models may view DNN-based differential equation solvers (DNN-DEs) as a faster and tran… ▽ More Ordinary and partial differential equations (DE) are used extensively in scientific and mathematical domains to model physical systems. Current literature has focused primarily on deep neural network (DNN) based methods for solving a specific DE or a family of DEs. Research communities with a history of using DE models may view DNN-based differential equation solvers (DNN-DEs) as a faster and transferable alternative to current numerical methods. However, there is a lack of systematic surveys detailing the use of DNN-DE methods across physical application domains and a generalized taxonomy to guide future research. This paper surveys and classifies previous works and provides an educational tutorial for senior practitioners, professionals, and graduate students in engineering and computer science. First, we propose a taxonomy to navigate domains of DE systems studied under the umbrella of DNN-DE. Second, we examine the theory and performance of the Physics Informed Neural Network (PINN) to demonstrate how the influential DNN-DE architecture mathematically solves a system of equations. Third, to reinforce the key ideas of solving and discovery of DEs using DNN, we provide a tutorial using DeepXDE, a Python package for developing PINNs, to develop DNN-DEs for solving and discovering a classic DE, the linear transport equation. △ Less

Submitted 19 June, 2023; v1 submitted 26 April, 2023; originally announced April 2023.

Comments: Under review for ACM Computing Surveys journal. 29 pages

Observation of Skyrmion Bubbles in Multilayer [Pt/Co/Cu]n using spin-polarized STM

Authors: Jacob J. Repicky, Brad Goff, Shuyu Cheng, Roland K. Kawakami, Jay A. Gupta

Abstract: Magnetic multilayers are a promising platform for storage and logic devices based on skyrmion spin textures, due to the large materials phase space for tuning properties. Epitaxial superlattice structures of [Pt/Co/Cu]n thin films were grown by molecular beam epitaxy at room temperature. Spin-polarized scanning tunneling microscopy (SP-STM) of these samples was used to probe the connection between… ▽ More Magnetic multilayers are a promising platform for storage and logic devices based on skyrmion spin textures, due to the large materials phase space for tuning properties. Epitaxial superlattice structures of [Pt/Co/Cu]n thin films were grown by molecular beam epitaxy at room temperature. Spin-polarized scanning tunneling microscopy (SP-STM) of these samples was used to probe the connection between surface structure and skyrmion morphology with nanoscale spatial resolution. Irregular-shaped skyrmion bubbles were observed, with effective diameters from 20-200 nm that are much larger than the nanoscale grain structure of the surface topography. Nucleation, annihilation, and motion of skyrmion bubbles could be driven using the stray field of the ferromagnetic tip in repeated imaging, and spin-polarized current/voltage pulses. Our detailed comparison of STM topography and differential conductance images shows that there are no surface defects or inhomogeneities at length scales that could account for the range in skyrmion bubble size or shape observed in the measurements. △ Less

Submitted 1 June, 2023; v1 submitted 17 March, 2023; originally announced March 2023.

Comments: 11 pages, 5 figures

Scanning Tunneling Microscopy Study of Epitaxial Fe3GeTe2 Monolayers on Bi2Te3

Authors: Brad M. Goff, Alexander J. Bishop, Wenyi Zhou, Ryan Bailey-Crandell, Katherine Robinson, Roland K. Kawakami, Jay A. Gupta

Abstract: Introducing magnetism to the surface state of topological insulators, such as Bi2Te3, can lead to a variety of interesting phenomena. We use scanning tunneling microscopy (STM) to study a single quintuple layer (QL) of the van der Waals magnet Fe3GeTe2 (FGT) that is grown on Bi2Te3 via molecular beam epitaxy. STM topographic images show that the FGT grows as free-standing islands on Bi2Te3 and out… ▽ More Introducing magnetism to the surface state of topological insulators, such as Bi2Te3, can lead to a variety of interesting phenomena. We use scanning tunneling microscopy (STM) to study a single quintuple layer (QL) of the van der Waals magnet Fe3GeTe2 (FGT) that is grown on Bi2Te3 via molecular beam epitaxy. STM topographic images show that the FGT grows as free-standing islands on Bi2Te3 and outwards from Bi2Te3 steps. Atomic resolution imaging shows atomic lattices of 390 +- 10 pm for FGT and 430 +- 10 pm for Bi2Te3, consistent with the respective bulk crystals. A moiré pattern is observed on FGT regions with a periodicity of 4.3 +- 0.4 nm that can be attributed solely to this lattice mismatch and thus indicates zero rotational misalignments. While most of the surface is covered by a single QL of the FGT, there are small double QL regions, as well as regions with distinct chemical terminations due to an incomplete QL. The most common partial QL surface termination is the FeGe layer, in which the top two atomic layers are missing. This termination has a distinctive electronic structure and a (sqrt3 x sqrt3)R30 reconstruction overlaid on the moiré pattern in STM images. Magnetic circular dichroism (MCD) measurements confirm these thin FGT films are ferromagnetic with TC ~190 K. △ Less

Submitted 20 November, 2023; v1 submitted 17 March, 2023; originally announced March 2023.

Comments: 12 pages, 5 figures

An Atomically Tailored Chiral Magnet with Small Skyrmions at Room Temperature

Authors: Tao Liu, Camelia M. Selcu, Binbin Wang, Núria Bagués, Po-Kuan Wu, Timothy Q. Hartnett, Shuyu Cheng, Denis Pelekhov, Roland A. Bennett, Joseph Perry Corbett, Jacob R. Repicky, Brendan McCullian, P. Chris Hammel, Jay A. Gupta, Mohit Randeria, Prasanna V. Balachandran, David W. McComb, Roland K. Kawakami

Abstract: Creating materials that do not exist in nature can lead to breakthroughs in science and technology. Magnetic skyrmions are topological excitations that have attracted great attention recently for their potential applications in low power, ultrahigh density memory. A major challenge has been to find materials that meet the dual requirement of small skyrmions stable at room temperature. Here we meet… ▽ More Creating materials that do not exist in nature can lead to breakthroughs in science and technology. Magnetic skyrmions are topological excitations that have attracted great attention recently for their potential applications in low power, ultrahigh density memory. A major challenge has been to find materials that meet the dual requirement of small skyrmions stable at room temperature. Here we meet both these goals by developing epitaxial FeGe films with excess Fe using atomic layer molecular beam epitaxy (MBE) far from thermal equilibrium. Our novel atomic layer design permits the incorporation of 20% excess Fe while maintaining a non-centrosymmetric crystal structure supported by theoretical calculations and necessary for stabilizing skyrmions. We show that the Curie temperature is well above room temperature, and that the skyrmions probed by topological Hall effect have sizes down to 15 nm as imaged by Lorentz transmission electron microscopy (LTEM) and magnetic force microscopy (MFM). Our results illustrate new avenues for creating artificial materials tailored at the atomic scale that can impact nanotechnology. △ Less

Submitted 9 March, 2023; originally announced March 2023.

Comments: 22 figures, 34 pages

Journal ref: Commun Phys 6, 327 (2023)

Geometric Clifford Algebra Networks

Authors: David Ruhe, Jayesh K. Gupta, Steven de Keninck, Max Welling, Johannes Brandstetter

Abstract: We propose Geometric Clifford Algebra Networks (GCANs) for modeling dynamical systems. GCANs are based on symmetry group transformations using geometric (Clifford) algebras. We first review the quintessence of modern (plane-based) geometric algebra, which builds on isometries encoded as elements of the $\mathrm{Pin}(p,q,r)$ group. We then propose the concept of group action layers, which linearly… ▽ More We propose Geometric Clifford Algebra Networks (GCANs) for modeling dynamical systems. GCANs are based on symmetry group transformations using geometric (Clifford) algebras. We first review the quintessence of modern (plane-based) geometric algebra, which builds on isometries encoded as elements of the $\mathrm{Pin}(p,q,r)$ group. We then propose the concept of group action layers, which linearly combine object transformations using pre-specified group actions. Together with a new activation and normalization scheme, these layers serve as adjustable $\textit{geometric templates}$ that can be refined via gradient descent. Theoretical advantages are strongly reflected in the modeling of three-dimensional rigid body transformations as well as large-scale fluid dynamics simulations, showing significantly improved performance over traditional methods. △ Less

Submitted 29 May, 2023; v1 submitted 13 February, 2023; originally announced February 2023.

ClimaX: A foundation model for weather and climate

Authors: Tung Nguyen, Johannes Brandstetter, Ashish Kapoor, Jayesh K. Gupta, Aditya Grover

Abstract: Most state-of-the-art approaches for weather and climate modeling are based on physics-informed numerical models of the atmosphere. These approaches aim to model the non-linear dynamics and complex interactions between multiple variables, which are challenging to approximate. Additionally, many such numerical models are computationally intensive, especially when modeling the atmospheric phenomenon… ▽ More Most state-of-the-art approaches for weather and climate modeling are based on physics-informed numerical models of the atmosphere. These approaches aim to model the non-linear dynamics and complex interactions between multiple variables, which are challenging to approximate. Additionally, many such numerical models are computationally intensive, especially when modeling the atmospheric phenomenon at a fine-grained spatial and temporal resolution. Recent data-driven approaches based on machine learning instead aim to directly solve a downstream forecasting or projection task by learning a data-driven functional mapping using deep neural networks. However, these networks are trained using curated and homogeneous climate datasets for specific spatiotemporal tasks, and thus lack the generality of numerical models. We develop and demonstrate ClimaX, a flexible and generalizable deep learning model for weather and climate science that can be trained using heterogeneous datasets spanning different variables, spatio-temporal coverage, and physical groundings. ClimaX extends the Transformer architecture with novel encoding and aggregation blocks that allow effective use of available compute while maintaining general utility. ClimaX is pre-trained with a self-supervised learning objective on climate datasets derived from CMIP6. The pre-trained ClimaX can then be fine-tuned to address a breadth of climate and weather tasks, including those that involve atmospheric variables and spatio-temporal scales unseen during pretraining. Compared to existing data-driven baselines, we show that this generality in ClimaX results in superior performance on benchmarks for weather forecasting and climate projections, even when pretrained at lower resolutions and compute budgets. The source code is available at https://github.com/microsoft/ClimaX. △ Less

Submitted 18 December, 2023; v1 submitted 24 January, 2023; originally announced January 2023.

Comments: International Conference on Machine Learning 2023

Dense Feature Memory Augmented Transformers for COVID-19 Vaccination Search Classification

Authors: Jai Gupta, Yi Tay, Chaitanya Kamath, Vinh Q. Tran, Donald Metzler, Shailesh Bavadekar, Mimi Sun, Evgeniy Gabrilovich

Abstract: With the devastating outbreak of COVID-19, vaccines are one of the crucial lines of defense against mass infection in this global pandemic. Given the protection they provide, vaccines are becoming mandatory in certain social and professional settings. This paper presents a classification model for detecting COVID-19 vaccination related search queries, a machine learning model that is used to gener… ▽ More With the devastating outbreak of COVID-19, vaccines are one of the crucial lines of defense against mass infection in this global pandemic. Given the protection they provide, vaccines are becoming mandatory in certain social and professional settings. This paper presents a classification model for detecting COVID-19 vaccination related search queries, a machine learning model that is used to generate search insights for COVID-19 vaccinations. The proposed method combines and leverages advancements from modern state-of-the-art (SOTA) natural language understanding (NLU) techniques such as pretrained Transformers with traditional dense features. We propose a novel approach of considering dense features as memory tokens that the model can attend to. We show that this new modeling approach enables a significant improvement to the Vaccine Search Insights (VSI) task, improving a strong well-established gradient-boosting baseline by relative +15% improvement in F1 score and +14% in precision. △ Less

Submitted 16 December, 2022; originally announced December 2022.

Comments: EMNLP 2022

MSC Class: I.2.7

DSI++: Updating Transformer Memory with New Documents

Authors: Sanket Vaibhav Mehta, Jai Gupta, Yi Tay, Mostafa Dehghani, Vinh Q. Tran, Jinfeng Rao, Marc Najork, Emma Strubell, Donald Metzler

Abstract: Differentiable Search Indices (DSIs) encode a corpus of documents in model parameters and use the same model to answer user queries directly. Despite the strong performance of DSI models, deploying them in situations where the corpus changes over time is computationally expensive because reindexing the corpus requires re-training the model. In this work, we introduce DSI++, a continual learning ch… ▽ More Differentiable Search Indices (DSIs) encode a corpus of documents in model parameters and use the same model to answer user queries directly. Despite the strong performance of DSI models, deploying them in situations where the corpus changes over time is computationally expensive because reindexing the corpus requires re-training the model. In this work, we introduce DSI++, a continual learning challenge for DSI to incrementally index new documents while being able to answer queries related to both previously and newly indexed documents. Across different model scales and document identifier representations, we show that continual indexing of new documents leads to considerable forgetting of previously indexed documents. We also hypothesize and verify that the model experiences forgetting events during training, leading to unstable learning. To mitigate these issues, we investigate two approaches. The first focuses on modifying the training dynamics. Flatter minima implicitly alleviate forgetting, so we optimize for flatter loss basins and show that the model stably memorizes more documents ($+12\%$). Next, we introduce a generative memory to sample pseudo-queries for documents and supplement them during continual indexing to prevent forgetting for the retrieval task. Extensive experiments on novel continual indexing benchmarks based on Natural Questions (NQ) and MS MARCO demonstrate that our proposed solution mitigates forgetting significantly. Concretely, it improves the average Hits@10 by $+21.1\%$ over competitive baselines for NQ and requires $6$ times fewer model updates compared to re-training the DSI model for incrementally indexing five corpora in a sequence. △ Less

Submitted 8 December, 2023; v1 submitted 19 December, 2022; originally announced December 2022.

Comments: Accepted at EMNLP 2023 main conference

CST5: Data Augmentation for Code-Switched Semantic Parsing

Authors: Anmol Agarwal, Jigar Gupta, Rahul Goel, Shyam Upadhyay, Pankaj Joshi, Rengarajan Aravamudhan

Abstract: Extending semantic parsers to code-switched input has been a challenging problem, primarily due to a lack of supervised training data. In this work, we introduce CST5, a new data augmentation technique that finetunes a T5 model using a small seed set ($\approx$100 utterances) to generate code-switched utterances from English utterances. We show that CST5 generates high quality code-switched data,… ▽ More Extending semantic parsers to code-switched input has been a challenging problem, primarily due to a lack of supervised training data. In this work, we introduce CST5, a new data augmentation technique that finetunes a T5 model using a small seed set ($\approx$100 utterances) to generate code-switched utterances from English utterances. We show that CST5 generates high quality code-switched data, both intrinsically (per human evaluation) and extrinsically by comparing baseline models which are trained without data augmentation to models which are trained with augmented data. Empirically we observe that using CST5, one can achieve the same semantic parsing performance by using up to 20x less labeled data. To aid further research in this area, we are also releasing (a) Hinglish-TOP, the largest human annotated code-switched semantic parsing dataset to date, containing 10k human annotated Hindi-English (Hinglish) code-switched utterances, and (b) Over 170K CST5 generated code-switched utterances from the TOPv2 dataset. Human evaluation shows that both the human annotated data as well as the CST5 generated data is of good quality. △ Less

Submitted 14 November, 2022; originally announced November 2022.

Agent-Time Attention for Sparse Rewards Multi-Agent Reinforcement Learning

Authors: Jennifer She, Jayesh K. Gupta, Mykel J. Kochenderfer

Abstract: Sparse and delayed rewards pose a challenge to single agent reinforcement learning. This challenge is amplified in multi-agent reinforcement learning (MARL) where credit assignment of these rewards needs to happen not only across time, but also across agents. We propose Agent-Time Attention (ATA), a neural network model with auxiliary losses for redistributing sparse and delayed rewards in collabo… ▽ More Sparse and delayed rewards pose a challenge to single agent reinforcement learning. This challenge is amplified in multi-agent reinforcement learning (MARL) where credit assignment of these rewards needs to happen not only across time, but also across agents. We propose Agent-Time Attention (ATA), a neural network model with auxiliary losses for redistributing sparse and delayed rewards in collaborative MARL. We provide a simple example that demonstrates how providing agents with their own local redistributed rewards and shared global redistributed rewards motivate different policies. We extend several MiniGrid environments, specifically MultiRoom and DoorKey, to the multi-agent sparse delayed rewards setting. We demonstrate that ATA outperforms various baselines on many instances of these environments. Source code of the experiments is available at https://github.com/jshe/agent-time-attention. △ Less

Submitted 31 October, 2022; originally announced October 2022.

Comments: Full version of the Extended Abstract accepted at the International Conference on Autonomous Agents and Multi-Agent Systems (AAMAS), 2022

Learning Modular Simulations for Homogeneous Systems

Authors: Jayesh K. Gupta, Sai Vemprala, Ashish Kapoor

Abstract: Complex systems are often decomposed into modular subsystems for engineering tractability. Although various equation based white-box modeling techniques make use of such structure, learning based methods have yet to incorporate these ideas broadly. We present a modular simulation framework for modeling homogeneous multibody dynamical systems, which combines ideas from graph neural networks and neu… ▽ More Complex systems are often decomposed into modular subsystems for engineering tractability. Although various equation based white-box modeling techniques make use of such structure, learning based methods have yet to incorporate these ideas broadly. We present a modular simulation framework for modeling homogeneous multibody dynamical systems, which combines ideas from graph neural networks and neural differential equations. We learn to model the individual dynamical subsystem as a neural ODE module. Full simulation of the composite system is orchestrated via spatio-temporal message passing between these modules. An arbitrary number of modules can be combined to simulate systems of a wide variety of coupling topologies. We evaluate our framework on a variety of systems and show that message passing allows coordination between multiple modules over time for accurate predictions and in certain cases, enables zero-shot generalization to new system configurations. Furthermore, we show that our models can be transferred to new system configurations with lower data requirement and training effort, compared to those trained from scratch. △ Less

Submitted 28 October, 2022; originally announced October 2022.

Comments: First two authors contributed equally. Accepted at NeurIPS 2022

Towards Multi-spatiotemporal-scale Generalized PDE Modeling

Authors: Jayesh K. Gupta, Johannes Brandstetter

Abstract: Partial differential equations (PDEs) are central to describing complex physical system simulations. Their expensive solution techniques have led to an increased interest in deep neural network based surrogates. However, the practical utility of training such surrogates is contingent on their ability to model complex multi-scale spatio-temporal phenomena. Various neural network architectures have… ▽ More Partial differential equations (PDEs) are central to describing complex physical system simulations. Their expensive solution techniques have led to an increased interest in deep neural network based surrogates. However, the practical utility of training such surrogates is contingent on their ability to model complex multi-scale spatio-temporal phenomena. Various neural network architectures have been proposed to target such phenomena, most notably Fourier Neural Operators (FNOs), which give a natural handle over local & global spatial information via parameterization of different Fourier modes, and U-Nets which treat local and global information via downsampling and upsampling paths. However, generalizing across different equation parameters or time-scales still remains a challenge. In this work, we make a comprehensive comparison between various FNO, ResNet, and U-Net like approaches to fluid mechanics problems in both vorticity-stream and velocity function form. For U-Nets, we transfer recent architectural improvements from computer vision, most notably from object segmentation and generative modeling. We further analyze the design considerations for using FNO layers to improve performance of U-Net architectures without major degradation of computational cost. Finally, we show promising results on generalization to different PDE parameters and time-scales with a single surrogate model. Source code for our PyTorch benchmark framework is available at https://github.com/microsoft/pdearena. △ Less

Submitted 15 November, 2022; v1 submitted 30 September, 2022; originally announced September 2022.

Learning to Simulate Realistic LiDARs

Authors: Benoit Guillard, Sai Vemprala, Jayesh K. Gupta, Ondrej Miksik, Vibhav Vineet, Pascal Fua, Ashish Kapoor

Abstract: Simulating realistic sensors is a challenging part in data generation for autonomous systems, often involving carefully handcrafted sensor design, scene properties, and physics modeling. To alleviate this, we introduce a pipeline for data-driven simulation of a realistic LiDAR sensor. We propose a model that learns a mapping between RGB images and corresponding LiDAR features such as raydrop or pe… ▽ More Simulating realistic sensors is a challenging part in data generation for autonomous systems, often involving carefully handcrafted sensor design, scene properties, and physics modeling. To alleviate this, we introduce a pipeline for data-driven simulation of a realistic LiDAR sensor. We propose a model that learns a mapping between RGB images and corresponding LiDAR features such as raydrop or per-point intensities directly from real datasets. We show that our model can learn to encode realistic effects such as dropped points on transparent surfaces or high intensity returns on reflective materials. When applied to naively raycasted point clouds provided by off-the-shelf simulator software, our model enhances the data by predicting intensities and removing points based on the scene's appearance to match a real LiDAR sensor. We use our technique to learn models of two distinct LiDAR sensors and use them to improve simulated LiDAR data accordingly. Through a sample task of vehicle segmentation, we show that enhancing simulated point clouds with our technique improves downstream task performance. △ Less

Submitted 22 September, 2022; originally announced September 2022.

Comments: IROS2022 paper

Centrally endo-AIP Modules

Authors: Shiv Kumar, Ashok Ji Gupta

Abstract: In this paper, we introduce the concept of centrally endo-AIP modules. We call a module M centrally endo-AIP, if the left annihilator of any fully invariant submodule N of M in the endomorphism ring S = End(M) is a centrally s-unital ideal of S. We discuss some properties of centrally endo-AIP modules. We also study the endomorphism ring of centrally endo-AIP modules and characterize quasi-Baer mo… ▽ More In this paper, we introduce the concept of centrally endo-AIP modules. We call a module M centrally endo-AIP, if the left annihilator of any fully invariant submodule N of M in the endomorphism ring S = End(M) is a centrally s-unital ideal of S. We discuss some properties of centrally endo-AIP modules. We also study the endomorphism ring of centrally endo-AIP modules and characterize quasi-Baer modules in terms of centrally endo-AIP modules △ Less

Submitted 18 September, 2022; originally announced September 2022.

MSC Class: 16D10; 16D40; 16S50

Clifford Neural Layers for PDE Modeling

Authors: Johannes Brandstetter, Rianne van den Berg, Max Welling, Jayesh K. Gupta

Abstract: Partial differential equations (PDEs) see widespread use in sciences and engineering to describe simulation of physical processes as scalar and vector fields interacting and coevolving over time. Due to the computationally expensive nature of their standard solution methods, neural PDE surrogates have become an active research topic to accelerate these simulations. However, current methods do not… ▽ More Partial differential equations (PDEs) see widespread use in sciences and engineering to describe simulation of physical processes as scalar and vector fields interacting and coevolving over time. Due to the computationally expensive nature of their standard solution methods, neural PDE surrogates have become an active research topic to accelerate these simulations. However, current methods do not explicitly take into account the relationship between different fields and their internal components, which are often correlated. Viewing the time evolution of such correlated fields through the lens of multivector fields allows us to overcome these limitations. Multivector fields consist of scalar, vector, as well as higher-order components, such as bivectors and trivectors. Their algebraic properties, such as multiplication, addition and other arithmetic operations can be described by Clifford algebras. To our knowledge, this paper presents the first usage of such multivector representations together with Clifford convolutions and Clifford Fourier transforms in the context of deep learning. The resulting Clifford neural layers are universally applicable and will find direct use in the areas of fluid dynamics, weather forecasting, and the modeling of physical systems in general. We empirically evaluate the benefit of Clifford neural layers by replacing convolution and Fourier operations in common neural PDE surrogates by their Clifford counterparts on 2D Navier-Stokes and weather modeling tasks, as well as 3D Maxwell equations. For similar parameter count, Clifford neural layers consistently improve generalization capabilities of the tested neural PDE surrogates. Source code for our PyTorch implementation is available at https://microsoft.github.io/cliffordlayers/. △ Less

Submitted 2 March, 2023; v1 submitted 8 September, 2022; originally announced September 2022.

Comments: Accepted at ICLR-2023

Modules in which pure submodule is essential in a direct summand

Authors: Kaushal Gupta, Shiv Kumar, Ashok Ji Gupta

Abstract: In this paper, we study the class of modules have the property that every pure submodule is essential in a direct summand. These modules are termed as pure extending modules which is a proper generalisation of extending modules. Examples and counterexamples are given. We study some properties of pure extending modules and characterize regular ring, semisimple ring, local ring and PDS ring in terms… ▽ More In this paper, we study the class of modules have the property that every pure submodule is essential in a direct summand. These modules are termed as pure extending modules which is a proper generalisation of extending modules. Examples and counterexamples are given. We study some properties of pure extending modules and characterize regular ring, semisimple ring, local ring and PDS ring in terms of pure extending modules. △ Less

Submitted 9 September, 2022; originally announced September 2022.

MSC Class: 16D40; 16D60; 16E50

Confident Adaptive Language Modeling

Authors: Tal Schuster, Adam Fisch, Jai Gupta, Mostafa Dehghani, Dara Bahri, Vinh Q. Tran, Yi Tay, Donald Metzler

Abstract: Recent advances in Transformer-based large language models (LLMs) have led to significant performance improvements across many tasks. These gains come with a drastic increase in the models' size, potentially leading to slow and costly use at inference time. In practice, however, the series of generations made by LLMs is composed of varying levels of difficulty. While certain predictions truly bene… ▽ More Recent advances in Transformer-based large language models (LLMs) have led to significant performance improvements across many tasks. These gains come with a drastic increase in the models' size, potentially leading to slow and costly use at inference time. In practice, however, the series of generations made by LLMs is composed of varying levels of difficulty. While certain predictions truly benefit from the models' full capacity, other continuations are more trivial and can be solved with reduced compute. In this work, we introduce Confident Adaptive Language Modeling (CALM), a framework for dynamically allocating different amounts of compute per input and generation timestep. Early exit decoding involves several challenges that we address here, such as: (1) what confidence measure to use; (2) connecting sequence-level constraints to local per-token exit decisions; and (3) attending back to missing hidden representations due to early exits in previous tokens. Through theoretical analysis and empirical experiments on three diverse text generation tasks, we demonstrate the efficacy of our framework in reducing compute -- potential speedup of up to $\times 3$ -- while provably maintaining high performance. △ Less

Submitted 25 October, 2022; v1 submitted 14 July, 2022; originally announced July 2022.

Comments: NeurIPS 2022 (selected as Oral)

Towards a Tighter Bound on Possible-Rendezvous Areas: Preliminary Results

Authors: Arun Sharma, Jayant Gupta, Subhankar Ghosh

Abstract: Given trajectories with gaps, we investigate methods to tighten spatial bounds on areas (e.g., nodes in a spatial network) where possible rendezvous activity could have occurred. The problem is important for reducing the onerous amount of manual effort to post-process possible rendezvous areas using satellite imagery and has many societal applications to improve public safety, security, and health… ▽ More Given trajectories with gaps, we investigate methods to tighten spatial bounds on areas (e.g., nodes in a spatial network) where possible rendezvous activity could have occurred. The problem is important for reducing the onerous amount of manual effort to post-process possible rendezvous areas using satellite imagery and has many societal applications to improve public safety, security, and health. The problem of rendezvous detection is challenging due to the difficulty of interpreting missing data within a trajectory gap and the very high cost of detecting gaps in such a large volume of location data. Most recent literature presents formal models, namely space-time prism, to track an object's rendezvous patterns within trajectory gaps on a spatial network. However, the bounds derived from the space-time prism are rather loose, resulting in unnecessarily extensive post-processing manual effort. To address these limitations, we propose a Time Slicing-based Gap-Aware Rendezvous Detection (TGARD) algorithm to tighten the spatial bounds in spatial networks. We propose a Dual Convergence TGARD (DC-TGARD) algorithm to improve computational efficiency using a bi-directional pruning approach. Theoretical results show the proposed spatial bounds on the area of possible rendezvous are tighter than that from related work (space-time prism). Experimental results on synthetic and real-world spatial networks (e.g., road networks) show that the proposed DC-TGARD is more scalable than the TGARD algorithm. △ Less

Submitted 25 June, 2022; originally announced June 2022.

GoalNet: Inferring Conjunctive Goal Predicates from Human Plan Demonstrations for Robot Instruction Following

Authors: Shreya Sharma, Jigyasa Gupta, Shreshth Tuli, Rohan Paul, Mausam

Abstract: Our goal is to enable a robot to learn how to sequence its actions to perform tasks specified as natural language instructions, given successful demonstrations from a human partner. The ability to plan high-level tasks can be factored as (i) inferring specific goal predicates that characterize the task implied by a language instruction for a given world state and (ii) synthesizing a feasible goal-… ▽ More Our goal is to enable a robot to learn how to sequence its actions to perform tasks specified as natural language instructions, given successful demonstrations from a human partner. The ability to plan high-level tasks can be factored as (i) inferring specific goal predicates that characterize the task implied by a language instruction for a given world state and (ii) synthesizing a feasible goal-reaching action-sequence with such predicates. For the former, we leverage a neural network prediction model, while utilizing a symbolic planner for the latter. We introduce a novel neuro-symbolic model, GoalNet, for contextual and task dependent inference of goal predicates from human demonstrations and linguistic task descriptions. GoalNet combines (i) learning, where dense representations are acquired for language instruction and the world state that enables generalization to novel settings and (ii) planning, where the cause-effect modeling by the symbolic planner eschews irrelevant predicates facilitating multi-stage decision making in large domains. GoalNet demonstrates a significant improvement (51%) in the task completion rate in comparison to a state-of-the-art rule-based approach on a benchmark data set displaying linguistic variations, particularly for multi-stage instructions. △ Less

Submitted 14 May, 2022; originally announced May 2022.

Comments: Accepted at Planning and Reinforcement Learning workshop in ICAPS 2022

Σ-dual Rickart modules

Authors: Shiv Kumar, Ashok Ji Gupta

Abstract: In this paper, we dualize the concept of Σ-Rickart modules as Σ-dual Rickart modules. An R-module M is said to be Σ-dual Rickart if the direct sum of arbitrary copies of M is dual Rickart. We prove that each cohereditary module over the Noetherian ring is a Σ-dual Rickart. We introduce the notion of strongly cogenerated modules and characterize Σ-dual Rickart modules in terms of strongly cogenerat… ▽ More In this paper, we dualize the concept of Σ-Rickart modules as Σ-dual Rickart modules. An R-module M is said to be Σ-dual Rickart if the direct sum of arbitrary copies of M is dual Rickart. We prove that each cohereditary module over the Noetherian ring is a Σ-dual Rickart. We introduce the notion of strongly cogenerated modules and characterize Σ-dual Rickart modules in terms of strongly cogenerated modules. We also study some properties of Σ- dual Rickart modules and find connections with semisimple Artinian ring, regular ring semi-hereditary ring and FP-injective module. Further, we study the endomorphism ring of Σ-dual Rickart modules △ Less

Submitted 17 August, 2022; v1 submitted 26 April, 2022; originally announced April 2022.

ED2LM: Encoder-Decoder to Language Model for Faster Document Re-ranking Inference

Authors: Kai Hui, Honglei Zhuang, Tao Chen, Zhen Qin, Jing Lu, Dara Bahri, Ji Ma, Jai Prakash Gupta, Cicero Nogueira dos Santos, Yi Tay, Don Metzler

Abstract: State-of-the-art neural models typically encode document-query pairs using cross-attention for re-ranking. To this end, models generally utilize an encoder-only (like BERT) paradigm or an encoder-decoder (like T5) approach. These paradigms, however, are not without flaws, i.e., running the model on all query-document pairs at inference-time incurs a significant computational cost. This paper propo… ▽ More State-of-the-art neural models typically encode document-query pairs using cross-attention for re-ranking. To this end, models generally utilize an encoder-only (like BERT) paradigm or an encoder-decoder (like T5) approach. These paradigms, however, are not without flaws, i.e., running the model on all query-document pairs at inference-time incurs a significant computational cost. This paper proposes a new training and inference paradigm for re-ranking. We propose to finetune a pretrained encoder-decoder model using in the form of document to query generation. Subsequently, we show that this encoder-decoder architecture can be decomposed into a decoder-only language model during inference. This results in significant inference time speedups since the decoder-only architecture only needs to learn to interpret static encoder embeddings during inference. Our experiments show that this new paradigm achieves results that are comparable to the more expensive cross-attention ranking approaches while being up to 6.8X faster. We believe this work paves the way for more efficient neural rankers that leverage large pretrained models. △ Less

Submitted 25 April, 2022; originally announced April 2022.

Comments: Findings of ACL 2022

COMPASS: Contrastive Multimodal Pretraining for Autonomous Systems

Authors: Shuang Ma, Sai Vemprala, Wenshan Wang, Jayesh K. Gupta, Yale Song, Daniel McDuff, Ashish Kapoor

Abstract: Learning representations that generalize across tasks and domains is challenging yet necessary for autonomous systems. Although task-driven approaches are appealing, designing models specific to each application can be difficult in the face of limited data, especially when dealing with highly variable multimodal input spaces arising from different tasks in different environments.We introduce the f… ▽ More Learning representations that generalize across tasks and domains is challenging yet necessary for autonomous systems. Although task-driven approaches are appealing, designing models specific to each application can be difficult in the face of limited data, especially when dealing with highly variable multimodal input spaces arising from different tasks in different environments.We introduce the first general-purpose pretraining pipeline, COntrastive Multimodal Pretraining for AutonomouS Systems (COMPASS), to overcome the limitations of task-specific models and existing pretraining approaches. COMPASS constructs a multimodal graph by considering the essential information for autonomous systems and the properties of different modalities. Through this graph, multimodal signals are connected and mapped into two factorized spatio-temporal latent spaces: a "motion pattern space" and a "current state space." By learning from multimodal correspondences in each latent space, COMPASS creates state representations that models necessary information such as temporal dynamics, geometry, and semantics. We pretrain COMPASS on a large-scale multimodal simulation dataset TartanAir \cite{tartanair2020iros} and evaluate it on drone navigation, vehicle racing, and visual odometry tasks. The experiments indicate that COMPASS can tackle all three scenarios and can also generalize to unseen environments and real-world data. △ Less

Submitted 19 February, 2022; originally announced March 2022.

Biceph-Net: A robust and lightweight framework for the diagnosis of Alzheimer's disease using 2D-MRI scans and deep similarity learning

Authors: A. H. Rashid, A. Gupta, J. Gupta, M. Tanveer

Abstract: Alzheimer's Disease (AD) is a neurodegenerative disease that is one of the significant causes of death in the elderly population. Many deep learning techniques have been proposed to diagnose AD using Magnetic Resonance Imaging (MRI) scans. Predicting AD using 2D slices extracted from 3D MRI scans is challenging as the inter-slice information gets lost. To this end, we propose a novel and lightweig… ▽ More Alzheimer's Disease (AD) is a neurodegenerative disease that is one of the significant causes of death in the elderly population. Many deep learning techniques have been proposed to diagnose AD using Magnetic Resonance Imaging (MRI) scans. Predicting AD using 2D slices extracted from 3D MRI scans is challenging as the inter-slice information gets lost. To this end, we propose a novel and lightweight framework termed 'Biceph-Net' for AD diagnosis using 2D MRI scans that model both the intra-slice and inter-slice information. Biceph-Net has been experimentally shown to perform similar to other Spatio-temporal neural networks while being computationally more efficient. Biceph-Net is also superior in performance compared to vanilla 2D convolutional neural networks (CNN) for AD diagnosis using 2D MRI slices. Biceph-Net also has an inbuilt neighbourhood-based model interpretation feature that can be exploited to understand the classification decision taken by the network. Biceph-Net experimentally achieves a test accuracy of 100% in the classification of Cognitively Normal (CN) vs AD, 98.16% for Mild Cognitive Impairment (MCI) vs AD, and 97.80% for CN vs MCI vs AD. △ Less

Submitted 23 March, 2022; originally announced March 2022.

Journal ref: IEEE Journal of Biomedical and Health Informatics, 2022

Recursive Reasoning Graph for Multi-Agent Reinforcement Learning

Authors: Xiaobai Ma, David Isele, Jayesh K. Gupta, Kikuo Fujimura, Mykel J. Kochenderfer

Abstract: Multi-agent reinforcement learning (MARL) provides an efficient way for simultaneously learning policies for multiple agents interacting with each other. However, in scenarios requiring complex interactions, existing algorithms can suffer from an inability to accurately anticipate the influence of self-actions on other agents. Incorporating an ability to reason about other agents' potential respon… ▽ More Multi-agent reinforcement learning (MARL) provides an efficient way for simultaneously learning policies for multiple agents interacting with each other. However, in scenarios requiring complex interactions, existing algorithms can suffer from an inability to accurately anticipate the influence of self-actions on other agents. Incorporating an ability to reason about other agents' potential responses can allow an agent to formulate more effective strategies. This paper adopts a recursive reasoning model in a centralized-training-decentralized-execution framework to help learning agents better cooperate with or compete against others. The proposed algorithm, referred to as the Recursive Reasoning Graph (R2G), shows state-of-the-art performance on multiple multi-agent particle and robotics games. △ Less

Submitted 5 March, 2022; originally announced March 2022.

Comments: AAAI 2022

HyperPrompt: Prompt-based Task-Conditioning of Transformers

Authors: Yun He, Huaixiu Steven Zheng, Yi Tay, Jai Gupta, Yu Du, Vamsi Aribandi, Zhe Zhao, YaGuang Li, Zhao Chen, Donald Metzler, Heng-Tze Cheng, Ed H. Chi

Abstract: Prompt-Tuning is a new paradigm for finetuning pre-trained language models in a parameter-efficient way. Here, we explore the use of HyperNetworks to generate hyper-prompts: we propose HyperPrompt, a novel architecture for prompt-based task-conditioning of self-attention in Transformers. The hyper-prompts are end-to-end learnable via generation by a HyperNetwork. HyperPrompt allows the network to… ▽ More Prompt-Tuning is a new paradigm for finetuning pre-trained language models in a parameter-efficient way. Here, we explore the use of HyperNetworks to generate hyper-prompts: we propose HyperPrompt, a novel architecture for prompt-based task-conditioning of self-attention in Transformers. The hyper-prompts are end-to-end learnable via generation by a HyperNetwork. HyperPrompt allows the network to learn task-specific feature maps where the hyper-prompts serve as task global memories for the queries to attend to, at the same time enabling flexible information sharing among tasks. We show that HyperPrompt is competitive against strong multi-task learning baselines with as few as $0.14\%$ of additional task-conditioning parameters, achieving great parameter and computational efficiency. Through extensive empirical experiments, we demonstrate that HyperPrompt can achieve superior performances over strong T5 multi-task learning baselines and parameter-efficient adapter variants including Prompt-Tuning and HyperFormer++ on Natural Language Understanding benchmarks of GLUE and SuperGLUE across many model sizes. △ Less

Submitted 14 June, 2022; v1 submitted 1 March, 2022; originally announced March 2022.

Comments: Accepted to ICML 2022

A New Generation of Perspective API: Efficient Multilingual Character-level Transformers

Authors: Alyssa Lees, Vinh Q. Tran, Yi Tay, Jeffrey Sorensen, Jai Gupta, Donald Metzler, Lucy Vasserman

Abstract: On the world wide web, toxic content detectors are a crucial line of defense against potentially hateful and offensive messages. As such, building highly effective classifiers that enable a safer internet is an important research area. Moreover, the web is a highly multilingual, cross-cultural community that develops its own lingo over time. As such, it is crucial to develop models that are effect… ▽ More On the world wide web, toxic content detectors are a crucial line of defense against potentially hateful and offensive messages. As such, building highly effective classifiers that enable a safer internet is an important research area. Moreover, the web is a highly multilingual, cross-cultural community that develops its own lingo over time. As such, it is crucial to develop models that are effective across a diverse range of languages, usages, and styles. In this paper, we present the fundamentals behind the next version of the Perspective API from Google Jigsaw. At the heart of the approach is a single multilingual token-free Charformer model that is applicable across a range of languages, domains, and tasks. We demonstrate that by forgoing static vocabularies, we gain flexibility across a variety of settings. We additionally outline the techniques employed to make such a byte-level model efficient and feasible for productionization. Through extensive experiments on multilingual toxic comment classification benchmarks derived from real API traffic and evaluation on an array of code-switching, covert toxicity, emoji-based hate, human-readable obfuscation, distribution shift, and bias evaluation settings, we show that our proposed approach outperforms strong baselines. Finally, we present our findings from deploying this system in production. △ Less

Submitted 22 February, 2022; originally announced February 2022.

Transformer Memory as a Differentiable Search Index

Authors: Yi Tay, Vinh Q. Tran, Mostafa Dehghani, Jianmo Ni, Dara Bahri, Harsh Mehta, Zhen Qin, Kai Hui, Zhe Zhao, Jai Gupta, Tal Schuster, William W. Cohen, Donald Metzler

Abstract: In this paper, we demonstrate that information retrieval can be accomplished with a single Transformer, in which all information about the corpus is encoded in the parameters of the model. To this end, we introduce the Differentiable Search Index (DSI), a new paradigm that learns a text-to-text model that maps string queries directly to relevant docids; in other words, a DSI model answers queries… ▽ More In this paper, we demonstrate that information retrieval can be accomplished with a single Transformer, in which all information about the corpus is encoded in the parameters of the model. To this end, we introduce the Differentiable Search Index (DSI), a new paradigm that learns a text-to-text model that maps string queries directly to relevant docids; in other words, a DSI model answers queries directly using only its parameters, dramatically simplifying the whole retrieval process. We study variations in how documents and their identifiers are represented, variations in training procedures, and the interplay between models and corpus sizes. Experiments demonstrate that given appropriate design choices, DSI significantly outperforms strong baselines such as dual encoder models. Moreover, DSI demonstrates strong generalization capabilities, outperforming a BM25 baseline in a zero-shot setup. △ Less

Submitted 21 October, 2022; v1 submitted 14 February, 2022; originally announced February 2022.

Comments: NeurIPS 2022

Kinetically-controlled epitaxial growth of Fe$_3$GeTe$_2$ van der Waals ferromagnetic films

Authors: Wenyi Zhou, Alexander J. Bishop, Menglin Zhu, Igor Lyalin, Robert C. Walko, Jay A. Gupta, Jinwoo Hwang, Roland K. Kawakami

Abstract: We demonstrate that kinetics play an important role in the epitaxial growth of Fe$_3$GeTe$_2$ (FGT) van der Waals (vdW) ferromagnetic films by molecular beam epitaxy. By varying the deposition rate, we control the formation or suppression of an initial tellurium-deficient non-van der Waals phase (Fe$_3$Ge$_2$) prior to realizing epitaxial growth of the vdW FGT phase. Using cross-sectional scanning… ▽ More We demonstrate that kinetics play an important role in the epitaxial growth of Fe$_3$GeTe$_2$ (FGT) van der Waals (vdW) ferromagnetic films by molecular beam epitaxy. By varying the deposition rate, we control the formation or suppression of an initial tellurium-deficient non-van der Waals phase (Fe$_3$Ge$_2$) prior to realizing epitaxial growth of the vdW FGT phase. Using cross-sectional scanning transmission electron microscopy and scanning tunneling microscopy, we optimize the FGT films to have atomically smooth surfaces and abrupt interfaces with the Ge(111) substrate. The magnetic properties of our high quality material are confirmed through magneto-optic, magnetotransport, and spin-polarized STM studies. Importantly, this demonstrates how the interplay of energetics and kinetics can help tune the re-evaporation rate of chalcogen atoms and interdiffusion from the underlayer, which paves the way for future studies of van der Waals epitaxy. △ Less

Submitted 8 February, 2022; originally announced February 2022.

Comments: 18 pages, 4 figures

Journal ref: ACS Appl. Electron. Mater. 4, 3190 (2022)

Understanding COVID-19 Effects on Mobility: A Community-Engaged Approach

Authors: Arun Sharma, Majid Farhadloo, Yan Li, Aditya Kulkarni, Jayant Gupta, Shashi Shekhar

Abstract: Given aggregated mobile device data, the goal is to understand the impact of COVID-19 policy interventions on mobility. This problem is vital due to important societal use cases, such as safely reopening the economy. Challenges include understanding and interpreting questions of interest to policymakers, cross-jurisdictional variability in choice and time of interventions, the large data volume, a… ▽ More Given aggregated mobile device data, the goal is to understand the impact of COVID-19 policy interventions on mobility. This problem is vital due to important societal use cases, such as safely reopening the economy. Challenges include understanding and interpreting questions of interest to policymakers, cross-jurisdictional variability in choice and time of interventions, the large data volume, and unknown sampling bias. The related work has explored the COVID-19 impact on travel distance, time spent at home, and the number of visitors at different points of interest. However, many policymakers are interested in long-duration visits to high-risk business categories and understanding the spatial selection bias to interpret summary reports. We provide an Entity Relationship diagram, system architecture, and implementation to support queries on long-duration visits in addition to fine resolution device count maps to understand spatial bias. We closely collaborated with policymakers to derive the system requirements and evaluate the system components, the summary reports, and visualizations. △ Less

Submitted 10 January, 2022; originally announced January 2022.

Functional Anomaly Detection: a Benchmark Study

Authors: Guillaume Staerman, Eric Adjakossa, Pavlo Mozharovskyi, Vera Hofer, Jayant Sen Gupta, Stephan Clémençon

Abstract: The increasing automation in many areas of the Industry expressly demands to design efficient machine-learning solutions for the detection of abnormal events. With the ubiquitous deployment of sensors monitoring nearly continuously the health of complex infrastructures, anomaly detection can now rely on measurements sampled at a very high frequency, providing a very rich representation of the phen… ▽ More The increasing automation in many areas of the Industry expressly demands to design efficient machine-learning solutions for the detection of abnormal events. With the ubiquitous deployment of sensors monitoring nearly continuously the health of complex infrastructures, anomaly detection can now rely on measurements sampled at a very high frequency, providing a very rich representation of the phenomenon under surveillance. In order to exploit fully the information thus collected, the observations cannot be treated as multivariate data anymore and a functional analysis approach is required. It is the purpose of this paper to investigate the performance of recent techniques for anomaly detection in the functional setup on real datasets. After an overview of the state-of-the-art and a visual-descriptive study, a variety of anomaly detection methods are compared. While taxonomies of abnormalities (e.g. shape, location) in the functional setup are documented in the literature, assigning a specific type to the identified anomalies appears to be a challenging task. Thus, strengths and weaknesses of the existing approaches are benchmarked in view of these highlighted types in a simulation study. Anomaly detection methods are next evaluated on two datasets, related to the monitoring of helicopters in flight and to the spectrometry of construction materials namely. The benchmark analysis is concluded by recommendation guidance for practitioners. △ Less

Submitted 13 January, 2022; originally announced January 2022.