Showing 1–50 of 180 results for author: Shah, V

AI-Assisted Generation of Difficult Math Questions

Authors: Vedant Shah, Dingli Yu, Kaifeng Lyu, Simon Park, Nan Rosemary Ke, Michael Mozer, Yoshua Bengio, Sanjeev Arora, Anirudh Goyal

Abstract: Current LLM training positions mathematical reasoning as a core capability. With publicly available sources fully tapped, there is unmet demand for diverse and challenging math questions. Relying solely on human experts is both time-consuming and costly, while LLM-generated questions often lack the requisite diversity and difficulty. We present a design framework that combines the strengths of LLM… ▽ More Current LLM training positions mathematical reasoning as a core capability. With publicly available sources fully tapped, there is unmet demand for diverse and challenging math questions. Relying solely on human experts is both time-consuming and costly, while LLM-generated questions often lack the requisite diversity and difficulty. We present a design framework that combines the strengths of LLMs with a human-in-the-loop approach to generate a diverse array of challenging math questions. We leverage LLM metacognition skills [Didolkar et al., 2024] of a strong LLM to extract core "skills" from existing math datasets. These skills serve as the basis for generating novel and difficult questions by prompting the LLM with random pairs of core skills. The use of two different skills within each question makes finding such questions an "out of distribution" task for both LLMs and humans. Our pipeline employs LLMs to iteratively generate and refine questions and solutions through multiturn prompting. Human annotators then verify and further refine the questions, with their efficiency enhanced via further LLM interactions. Applying this pipeline on skills extracted from the MATH dataset [Hendrycks et al., 2021] resulted in MATH$^2$ - a dataset of higher-quality math questions, as evidenced by: (a) Lower performance of all models on MATH$^2$ than on MATH (b) Higher performance on MATH when using MATH$^2$ questions as in-context examples. Although focused on mathematics, our methodology seems applicable to other domains requiring structured reasoning, and potentially as a component of scalable oversight. Also of interest is a striking relationship observed between models' performance on the new dataset: the success rate on MATH$^2$ is the square on MATH, suggesting that successfully solving the question in MATH$^2$ requires a nontrivial combination of two distinct math skills. △ Less

Submitted 30 July, 2024; originally announced July 2024.

Learning-augmented Maximum Independent Set

Authors: Vladimir Braverman, Prathamesh Dharangutte, Vihan Shah, Chen Wang

Abstract: We study the Maximum Independent Set (MIS) problem on general graphs within the framework of learning-augmented algorithms. The MIS problem is known to be NP-hard and is also NP-hard to approximate to within a factor of $n^{1-δ}$ for any $δ>0$. We show that we can break this barrier in the presence of an oracle obtained through predictions from a machine learning model that answers vertex membersh… ▽ More We study the Maximum Independent Set (MIS) problem on general graphs within the framework of learning-augmented algorithms. The MIS problem is known to be NP-hard and is also NP-hard to approximate to within a factor of $n^{1-δ}$ for any $δ>0$. We show that we can break this barrier in the presence of an oracle obtained through predictions from a machine learning model that answers vertex membership queries for a fixed MIS with probability $1/2+\varepsilon$. In the first setting we consider, the oracle can be queried once per vertex to know if a vertex belongs to a fixed MIS, and the oracle returns the correct answer with probability $1/2 + \varepsilon$. Under this setting, we show an algorithm that obtains an $\tilde{O}(\sqrtΔ/\varepsilon)$-approximation in $O(m)$ time where $Δ$ is the maximum degree of the graph. In the second setting, we allow multiple queries to the oracle for a vertex, each of which is correct with probability $1/2 + \varepsilon$. For this setting, we show an $O(1)$-approximation algorithm using $O(n/\varepsilon^2)$ total queries and $\tilde{O}(m)$ runtime. △ Less

Submitted 16 July, 2024; originally announced July 2024.

Comments: APPROX 2024

EyeDentify: A Dataset for Pupil Diameter Estimation based on Webcam Images

Authors: Vijul Shah, Ko Watanabe, Brian B. Moser, Andreas Dengel

Abstract: In this work, we introduce EyeDentify, a dataset specifically designed for pupil diameter estimation based on webcam images. EyeDentify addresses the lack of available datasets for pupil diameter estimation, a crucial domain for understanding physiological and psychological states traditionally dominated by highly specialized sensor systems such as Tobii. Unlike these advanced sensor systems and a… ▽ More In this work, we introduce EyeDentify, a dataset specifically designed for pupil diameter estimation based on webcam images. EyeDentify addresses the lack of available datasets for pupil diameter estimation, a crucial domain for understanding physiological and psychological states traditionally dominated by highly specialized sensor systems such as Tobii. Unlike these advanced sensor systems and associated costs, webcam images are more commonly found in practice. Yet, deep learning models that can estimate pupil diameters using standard webcam data are scarce. By providing a dataset of cropped eye images alongside corresponding pupil diameter information, EyeDentify enables the development and refinement of models designed specifically for less-equipped environments, democratizing pupil diameter estimation by making it more accessible and broadly applicable, which in turn contributes to multiple domains of understanding human activity and supporting healthcare. Our dataset is available at https://vijulshah.github.io/eyedentify/. △ Less

Submitted 15 July, 2024; originally announced July 2024.

ORAN-Bench-13K: An Open Source Benchmark for Assessing LLMs in Open Radio Access Networks

Authors: Pranshav Gajjar, Vijay K. Shah

Abstract: Large Language Models (LLMs) can revolutionize how we deploy and operate Open Radio Access Networks (O-RAN) by enhancing network analytics, anomaly detection, and code generation and significantly increasing the efficiency and reliability of a plethora of O-RAN tasks. In this paper, we present ORAN-Bench-13K, the first comprehensive benchmark designed to evaluate the performance of Large Language… ▽ More Large Language Models (LLMs) can revolutionize how we deploy and operate Open Radio Access Networks (O-RAN) by enhancing network analytics, anomaly detection, and code generation and significantly increasing the efficiency and reliability of a plethora of O-RAN tasks. In this paper, we present ORAN-Bench-13K, the first comprehensive benchmark designed to evaluate the performance of Large Language Models (LLMs) within the context of O-RAN. Our benchmark consists of 13,952 meticulously curated multiple-choice questions generated from 116 O-RAN specification documents. We leverage a novel three-stage LLM framework, and the questions are categorized into three distinct difficulties to cover a wide spectrum of ORAN-related knowledge. We thoroughly evaluate the performance of several state-of-the-art LLMs, including Gemini, Chat-GPT, and Mistral. Additionally, we propose ORANSight, a Retrieval-Augmented Generation (RAG)-based pipeline that demonstrates superior performance on ORAN-Bench-13K compared to other tested closed-source models. Our findings indicate that current popular LLM models are not proficient in O-RAN, highlighting the need for specialized models. We observed a noticeable performance improvement when incorporating the RAG-based ORANSight pipeline, with a Macro Accuracy of 0.784 and a Weighted Accuracy of 0.776, which was on average 21.55% and 22.59% better than the other tested LLMs. △ Less

Submitted 13 July, 2024; v1 submitted 8 July, 2024; originally announced July 2024.

Pre-Calc: Learning to Use the Calculator Improves Numeracy in Language Models

Authors: Vishruth Veerendranath, Vishwa Shah, Kshitish Ghate

Abstract: Quantitative and numerical comprehension in language is an important task in many fields like education and finance, but still remains a challenging task for language models. While tool and calculator usage has shown to be helpful to improve mathematical reasoning in large pretrained decoder-only language models, this remains unexplored for smaller language models with encoders. In this paper, we… ▽ More Quantitative and numerical comprehension in language is an important task in many fields like education and finance, but still remains a challenging task for language models. While tool and calculator usage has shown to be helpful to improve mathematical reasoning in large pretrained decoder-only language models, this remains unexplored for smaller language models with encoders. In this paper, we propose Pre-Calc, a simple pre-finetuning objective of learning to use the calculator for both encoder-only and encoder-decoder architectures, formulated as a discriminative and generative task respectively. We pre-train BERT and RoBERTa for discriminative calculator use and Flan-T5 for generative calculator use on the MAWPS, SVAMP, and AsDiv-A datasets, which improves performance on downstream tasks that require numerical understanding. Our code and data are available at https://github.com/calc-cmu/pre-calc. △ Less

Submitted 25 June, 2024; v1 submitted 22 April, 2024; originally announced April 2024.

Comments: AI4Math workshop, ICML 2024

NormAd: A Benchmark for Measuring the Cultural Adaptability of Large Language Models

Authors: Abhinav Rao, Akhila Yerukola, Vishwa Shah, Katharina Reinecke, Maarten Sap

Abstract: The integration of large language models (LLMs) into various global cultures fundamentally presents a challenge: LLMs must navigate interactions, respect social norms, and avoid transgressing cultural boundaries. However, it is still unclear if LLMs can adapt their outputs to diverse cultural norms. Our study focuses on this aspect. We introduce NormAd, a novel dataset, which includes 2.6k stories… ▽ More The integration of large language models (LLMs) into various global cultures fundamentally presents a challenge: LLMs must navigate interactions, respect social norms, and avoid transgressing cultural boundaries. However, it is still unclear if LLMs can adapt their outputs to diverse cultural norms. Our study focuses on this aspect. We introduce NormAd, a novel dataset, which includes 2.6k stories that represent social and cultural norms from 75 countries, to assess the ability of LLMs to adapt to different granular levels of socio-cultural contexts such as the country of origin, its associated cultural values, and prevalent social norms. Our study reveals that LLMs struggle with cultural reasoning across all contextual granularities, showing stronger adaptability to English-centric cultures over those from the Global South. Even with explicit social norms, the top-performing model, Mistral-7b-Instruct, achieves only 81.8% accuracy, lagging behind the 95.6% achieved by humans. Evaluation on NormAd further reveals that LLMs struggle to adapt to stories involving gift-giving across cultures. Due to inherent agreement or sycophancy biases, LLMs find it considerably easier to assess the social acceptability of stories that adhere to norms than those that deviate. Our benchmark measures the cultural adaptability (or lack thereof) of LLMs, emphasizing the potential to make these technologies more equitable and useful for global audiences. We release the NormAd dataset and its associated code on GitHub. △ Less

Submitted 11 July, 2024; v1 submitted 18 April, 2024; originally announced April 2024.

Comments: Preprint. In Review

Towards DNA-Encoded Library Generation with GFlowNets

Authors: Michał Koziarski, Mohammed Abukalam, Vedant Shah, Louis Vaillancourt, Doris Alexandra Schuetz, Moksh Jain, Almer van der Sloot, Mathieu Bourgey, Anne Marinier, Yoshua Bengio

Abstract: DNA-encoded libraries (DELs) are a powerful approach for rapidly screening large numbers of diverse compounds. One of the key challenges in using DELs is library design, which involves choosing the building blocks that will be combinatorially combined to produce the final library. In this paper we consider the task of protein-protein interaction (PPI) biased DEL design. To this end, we evaluate se… ▽ More DNA-encoded libraries (DELs) are a powerful approach for rapidly screening large numbers of diverse compounds. One of the key challenges in using DELs is library design, which involves choosing the building blocks that will be combinatorially combined to produce the final library. In this paper we consider the task of protein-protein interaction (PPI) biased DEL design. To this end, we evaluate several machine learning algorithms on the PPI modulation task and use them as a reward for the proposed GFlowNet-based generative approach. We additionally investigate the possibility of using structural information about building blocks to design a hierarchical action space for the GFlowNet. The observed results indicate that GFlowNets are a promising approach for generating diverse combinatorial library candidates. △ Less

Submitted 15 April, 2024; originally announced April 2024.

Anomaly Detection and Approximate Similarity Searches of Transients in Real-time Data Streams

Authors: P. D. Aleo, A. W. Engel, G. Narayan, C. R. Angus, K. Malanchev, K. Auchettl, V. F. Baldassare, A. Berres, T. J. L. de Boer, B. M. Boyd, K. C. Chambers, K. W. Davis, N. Esquivel, D. Farias, R. J. Foley, A. Gagliano, C. Gall, H. Gao, S. Gomez, M. Grayling, D. O. Jones, C. -C. Lin, E. A. Magnier, K. S. Mandel, T. Matheson , et al. (7 additional authors not shown)

Abstract: We present LAISS (Lightcurve Anomaly Identification and Similarity Search), an automated pipeline to detect anomalous astrophysical transients in real-time data streams. We deploy our anomaly detection model on the nightly ZTF Alert Stream via the ANTARES broker, identifying a manageable $\sim$1-5 candidates per night for expert vetting and coordinating follow-up observations. Our method leverages… ▽ More We present LAISS (Lightcurve Anomaly Identification and Similarity Search), an automated pipeline to detect anomalous astrophysical transients in real-time data streams. We deploy our anomaly detection model on the nightly ZTF Alert Stream via the ANTARES broker, identifying a manageable $\sim$1-5 candidates per night for expert vetting and coordinating follow-up observations. Our method leverages statistical light-curve and contextual host-galaxy features within a random forest classifier, tagging transients of rare classes (spectroscopic anomalies), of uncommon host-galaxy environments (contextual anomalies), and of peculiar or interaction-powered phenomena (behavioral anomalies). Moreover, we demonstrate the power of a low-latency ($\sim$ms) approximate similarity search method to find transient analogs with similar light-curve evolution and host-galaxy environments. We use analogs for data-driven discovery, characterization, (re-)classification, and imputation in retrospective and real-time searches. To date we have identified $\sim$50 previously known and previously missed rare transients from real-time and retrospective searches, including but not limited to: SLSNe, TDEs, SNe IIn, SNe IIb, SNe Ia-CSM, SNe Ia-91bg-like, SNe Ib, SNe Ic, SNe Ic-BL, and M31 novae. Lastly, we report the discovery of 325 total transients, all observed between 2018-2021 and absent from public catalogs ($\sim$1% of all ZTF Astronomical Transient reports to the Transient Name Server through 2021). These methods enable a systematic approach to finding the "needle in the haystack" in large-volume data streams. Because of its integration with the ANTARES broker, LAISS is built to detect exciting transients in Rubin data. △ Less

Submitted 24 July, 2024; v1 submitted 1 April, 2024; originally announced April 2024.

Comments: 44 pages (68 pages with Appendix), 15 figures, accepted to ApJ

MICROSIM: A high performance phase-field solver based on CPU and GPU implementations

Authors: Tanmay Dutta, Dasari Mohan, Saurav Shenoy, Nasir Attar, Abhikshek Kalokhe, Ajay Sagar, Swapnil Bhure, Swaroop . S. Pradhan, Jitendriya Praharaj, Subham Mridha, Anshika Kushwaha, Vaishali Shah, M. P. Gururajan, V. Venkatesh Shenoi, Gandham Phanikumar, Saswata Bhattacharyya, Abhik Choudhury

Abstract: The phase-field method has become a useful tool for the simulation of classical metallurgical phase transformations as well as other phenomena related to materials science. The thermodynamic consistency that forms the basis of these formulations lends to its strong predictive capabilities and utility. However, a strong impediment to the usage of the method for typical applied problems of industria… ▽ More The phase-field method has become a useful tool for the simulation of classical metallurgical phase transformations as well as other phenomena related to materials science. The thermodynamic consistency that forms the basis of these formulations lends to its strong predictive capabilities and utility. However, a strong impediment to the usage of the method for typical applied problems of industrial and academic relevance is the significant overhead with regard to the code development and know-how required for quantitative model formulations. In this paper, we report the development of an open-source phase-field software stack that contains generic formulations for the simulation of multi-phase and multi-component phase transformations. The solvers incorporate thermodynamic coupling that allows the realization of simulations with real alloys in scenarios directly relevant to the materials industry. Further, the solvers utilize parallelization strategies using either multiple CPUs or GPUs to provide cross-platform portability and usability on available supercomputing machines. Finally, the solver stack also contains a graphical user interface to gradually introduce the usage of the software. The user interface also provides a collection of post-processing tools that allow the estimation of useful metrics related to microstructural evolution. △ Less

Submitted 1 April, 2024; originally announced April 2024.

A VLBI Software Correlator for Fast Radio Transients

Authors: Calvin Leung, Shion Andrew, Kiyoshi W. Masui, Charanjot Brar, Tomas Cassanelli, Shami Chatterjee, Victoria Kaspi, Kholoud Khairy, Adam E. Lanman, Mattias Lazda, Juan Mena-Parra, Gavin Noble, Aaron B. Pearlman, Mubdi Rahman, Pranav Sanghavi, Vishwangi Shah

Abstract: One major goal in fast radio burst science is to detect fast radio bursts (FRBs) over a wide field of view without sacrificing the angular resolution required to pinpoint them to their host galaxies. Wide-field detection and localization capabilities have already been demonstrated using connected-element interferometry; the CHIME/FRB Outriggers project will push this further using widefield cylind… ▽ More One major goal in fast radio burst science is to detect fast radio bursts (FRBs) over a wide field of view without sacrificing the angular resolution required to pinpoint them to their host galaxies. Wide-field detection and localization capabilities have already been demonstrated using connected-element interferometry; the CHIME/FRB Outriggers project will push this further using widefield cylindrical telescopes as widefield outriggers for very long baseline interferometry (VLBI). This paper describes an offline VLBI software correlator written in Python for the CHIME/FRB Outriggers project. It includes features well-suited to modern widefield instruments like multibeaming/multiple phase center correlation, pulse gating including coherent dedispersion, and a novel correlation algorithm based on the quadratic estimator formalism. This algorithm mitigates sensitivity loss which arises in instruments where the windowing and channelization is done outside the VLBI correlator at each station, which accounts for a 30 percent sensitivity drop away from the phase center. Our correlation algorithm recovers this sensitivity on both simulated and real data. As an end to end check of our software, we have written a preliminary pipeline for VLBI calibration and single-pulse localization, which we use in Lanman et al. (2024) to verify the astrometric accuracy of the CHIME/FRB Outriggers array. △ Less

Submitted 26 March, 2024; v1 submitted 8 March, 2024; originally announced March 2024.

Comments: 24 pages, 7 figures. Comments, reference suggestions, and PRs welcome!

Preserving Data Privacy for ML-driven Applications in Open Radio Access Networks

Authors: Pranshav Gajjar, Azuka Chiejina, Vijay K. Shah

Abstract: Deep learning offers a promising solution to improve spectrum access techniques by utilizing data-driven approaches to manage and share limited spectrum resources for emerging applications. For several of these applications, the sensitive wireless data (such as spectrograms) are stored in a shared database or multistakeholder cloud environment and are therefore prone to privacy leaks. This paper a… ▽ More Deep learning offers a promising solution to improve spectrum access techniques by utilizing data-driven approaches to manage and share limited spectrum resources for emerging applications. For several of these applications, the sensitive wireless data (such as spectrograms) are stored in a shared database or multistakeholder cloud environment and are therefore prone to privacy leaks. This paper aims to address such privacy concerns by examining the representative case study of shared database scenarios in 5G Open Radio Access Network (O-RAN) networks where we have a shared database within the near-real-time (near-RT) RAN intelligent controller. We focus on securing the data that can be used by machine learning (ML) models for spectrum sharing and interference mitigation applications without compromising the model and network performances. The underlying idea is to leverage a (i) Shuffling-based learnable encryption technique to encrypt the data, following which, (ii) employ a custom Vision transformer (ViT) as the trained ML model that is capable of performing accurate inferences on such encrypted data. The paper offers a thorough analysis and comparisons with analogous convolutional neural networks (CNN) as well as deeper architectures (such as ResNet-50) as baselines. Our experiments showcase that the proposed approach significantly outperforms the baseline CNN with an improvement of 24.5% and 23.9% for the percent accuracy and F1-Score respectively when operated on encrypted data. Though deeper ResNet-50 architecture is obtained as a slightly more accurate model, with an increase of 4.4%, the proposed approach boasts a reduction of parameters by 99.32%, and thus, offers a much-improved prediction time by nearly 60%. △ Less

Submitted 15 February, 2024; originally announced February 2024.

A pulsar-like swing in the polarisation position angle of a nearby fast radio burst

Authors: Ryan Mckinven, Mohit Bhardwaj, Tarraneh Eftekhari, Charles D. Kilpatrick, Aida Kirichenko, Arpan Pal, Amanda M. Cook, B. M. Gaensler, Utkarsh Giri, Victoria M. Kaspi, Daniele Michilli, Kenzie Nimmo, Aaron B. Pearlman, Ziggy Pleunis, Ketan R. Sand, Ingrid Stairs, Bridget C. Andersen, Shion Andrew, Kevin Bandura, Charanjot Brar, Tomas Cassanelli, Shami Chatterjee, Alice P. Curtin, Fengqiu Adam Dong, Gwendolyn Eadie , et al. (19 additional authors not shown)

Abstract: Fast radio bursts (FRBs) last for milliseconds and arrive at Earth from cosmological distances. While their origin(s) and emission mechanism(s) are presently unknown, their signals bear similarities with the much less luminous radio emission generated by pulsars within our Galaxy and several lines of evidence point toward neutron star origins. For pulsars, the linear polarisation position angle (P… ▽ More Fast radio bursts (FRBs) last for milliseconds and arrive at Earth from cosmological distances. While their origin(s) and emission mechanism(s) are presently unknown, their signals bear similarities with the much less luminous radio emission generated by pulsars within our Galaxy and several lines of evidence point toward neutron star origins. For pulsars, the linear polarisation position angle (PA) often exhibits evolution over the pulse phase that is interpreted within a geometric framework known as the rotating vector model (RVM). Here, we report on a fast radio burst, FRB 20221022A, detected by the Canadian Hydrogen Intensity Mapping Experiment (CHIME) and localized to a nearby host galaxy ($\sim 65\; \rm{Mpc}$), MCG+14-02-011. This one-off FRB displays a $\sim 130$ degree rotation of its PA over its $\sim 2.5\; \rm{ms}$ burst duration, closely resembling the "S"-shaped PA evolution commonly seen from pulsars and some radio magnetars. The PA evolution disfavours emission models involving shocks far from the source and instead suggests magnetospheric origins for this source which places the emission region close to the FRB central engine, echoing similar conclusions drawn from tempo-polarimetric studies of some repeating sources. This FRB's PA evolution is remarkably well-described by the RVM and, although we cannot determine the inclination and magnetic obliquity due to the unknown period/duty cycle of the source, we can dismiss extremely short-period pulsars (e.g., recycled millisecond pulsars) as potential progenitors. RVM-fitting appears to favour a source occupying a unique position in the period/duty cycle phase space that implies tight opening angles for the beamed emission, significantly reducing burst energy requirements of the source. △ Less

Submitted 14 February, 2024; originally announced February 2024.

CHIME/FRB Outriggers: KKO Station System and Commissioning Results

Authors: Adam E. Lanman, Shion Andrew, Mattias Lazda, Vishwangi Shah, Mandana Amiri, Arvind Balasubramanian, Kevin Bandura, P. J. Boyle, Charanjot Brar, Mark Carlson, Jean-François Cliche, Nina Gusinskaia, Ian T. Hendricksen, J. F. Kaczmarek, Tom Landecker, Calvin Leung, Ryan Mckinven, Juan Mena-Parra, Nikola Milutinovic, Kenzie Nimmo, Aaron B. Pearlman, Andre Renard, Mubdi Rahman, J. Richard Shaw, Seth R. Siegel , et al. (21 additional authors not shown)

Abstract: Localizing fast radio bursts (FRBs) to their host galaxies is an essential step to better understanding their origins and using them as cosmic probes. The CHIME/FRB Outrigger program aims to add VLBI-localization capabilities to CHIME, such that FRBs may be localized to tens of milliarcsecond precision at the time of their discovery, more than sufficient for host galaxy identification. The first-b… ▽ More Localizing fast radio bursts (FRBs) to their host galaxies is an essential step to better understanding their origins and using them as cosmic probes. The CHIME/FRB Outrigger program aims to add VLBI-localization capabilities to CHIME, such that FRBs may be localized to tens of milliarcsecond precision at the time of their discovery, more than sufficient for host galaxy identification. The first-built outrigger telescope is KKO, located 66 kilometers west of CHIME. Cross-correlating KKO with CHIME can achieve arcsecond-scale localization in right ascension while avoiding the worst effects of the ionosphere. This paper presents measurements of KKO's performance throughout its commissioning phase, as well as a summary of its design and function. We demonstrate KKO's capabilities as a standalone instrument by producing full-sky images, mapping the angular and frequency structure of the primary beam, and measuring feed positions. To demonstrate the localization capabilities of the CHIME -- KKO baseline, we collected five separate observations each for a set of twenty bright pulsars, and aimed to measure their positions to within 5~arcseconds. All of these pulses were successfully localized to within this specification. The next two outriggers are expected to be commissioned in 2024, and will enable subarcsecond localizations for approximately hundreds of FRBs each year. △ Less

Submitted 29 May, 2024; v1 submitted 12 February, 2024; originally announced February 2024.

Comments: 41 pages, 17 figures

System-level Analysis of Adversarial Attacks and Defenses on Intelligence in O-RAN based Cellular Networks

Authors: Azuka Chiejina, Brian Kim, Kaushik Chowhdury, Vijay K. Shah

Abstract: While the open architecture, open interfaces, and integration of intelligence within Open Radio Access Network technology hold the promise of transforming 5G and 6G networks, they also introduce cybersecurity vulnerabilities that hinder its widespread adoption. In this paper, we conduct a thorough system-level investigation of cyber threats, with a specific focus on machine learning (ML) intellige… ▽ More While the open architecture, open interfaces, and integration of intelligence within Open Radio Access Network technology hold the promise of transforming 5G and 6G networks, they also introduce cybersecurity vulnerabilities that hinder its widespread adoption. In this paper, we conduct a thorough system-level investigation of cyber threats, with a specific focus on machine learning (ML) intelligence components known as xApps within the O-RAN's near-real-time RAN Intelligent Controller (near-RT RIC) platform. Our study begins by developing a malicious xApp designed to execute adversarial attacks on two types of test data - spectrograms and key performance metrics (KPMs), stored in the RIC database within the near-RT RIC. To mitigate these threats, we utilize a distillation technique that involves training a teacher model at a high softmax temperature and transferring its knowledge to a student model trained at a lower softmax temperature, which is deployed as the robust ML model within xApp. We prototype an over-the-air LTE/5G O-RAN testbed to assess the impact of these attacks and the effectiveness of the distillation defense technique by leveraging an ML-based Interference Classification (InterClass) xApp as an example. We examine two versions of InterClass xApp under distinct scenarios, one based on Convolutional Neural Networks (CNNs) and another based on Deep Neural Networks (DNNs) using spectrograms and KPMs as input data respectively. Our findings reveal up to 100% and 96.3% degradation in the accuracy of both the CNN and DNN models respectively resulting in a significant decline in network performance under considered adversarial attacks. Under the strict latency constraints of the near-RT RIC closed control loop, our analysis shows that the distillation technique outperforms classical adversarial training by achieving an accuracy of up to 98.3% for mitigating such attacks. △ Less

Submitted 13 February, 2024; v1 submitted 9 February, 2024; originally announced February 2024.

Comments: his paper has been accepted for publication in ACM WiSec 2024

ASCENT: A Context-Aware Spectrum Coexistence Design and Implementation Toolset for Policymakers in Satellite Bands

Authors: Ta-seen Reaz Niloy, Saurav Kumar, Aniruddha Hore, Zoheb Hassan, Carl Dietrich, Eric W. Burger, Jeffrey H. Reed, Vijay K. Shah

Abstract: This paper introduces ASCENT (context Aware Spectrum Coexistence Design and Implementation) toolset, an advanced context-aware terrestrial satellite spectrum sharing toolset designed for researchers, policymakers, and regulators. It serves two essential purposes (a) evaluating the potential for harmful interference to primary users in satellite bands and (b) facilitating the analysis, design, and… ▽ More This paper introduces ASCENT (context Aware Spectrum Coexistence Design and Implementation) toolset, an advanced context-aware terrestrial satellite spectrum sharing toolset designed for researchers, policymakers, and regulators. It serves two essential purposes (a) evaluating the potential for harmful interference to primary users in satellite bands and (b) facilitating the analysis, design, and implementation of diverse regulatory policies on spectrum usage and sharing. Notably, ASCENT implements a closed-loop feedback system that allows dynamic adaptation of policies according to a wide range of contextual factors (e.g., weather, buildings, summer/winter foliage, etc.) and feedback on the impact of these policies through realistic simulation. Specifically, ASCENT comprises the following components (i) interference evaluation tool for evaluating interference at the incumbents in a spectrum-sharing environment while taking the underlying contexts, (ii) dynamic spectrum access (DSA) framework for providing context-aware instructions to adapt networking parameters and control secondary terrestrial network's access to the shared spectrum band according to context aware prioritization, (iii) Context broker to acquire essential and relevant contexts from external context information providers; and (iv) DSA Database to store dynamic and static contexts and the regulator's policy information. The closed-loop feedback system of ASCENT is implemented by integrating these components in a modular software architecture. A case study of sharing the lower 12 GHz Ku band (12.2-12.7 GHz) with the 5G terrestrial cellular network is considered, and the usability of ASCENT is demonstrated by dynamically changing exclusion zone's radius in different weather conditions. △ Less

Submitted 15 February, 2024; v1 submitted 7 February, 2024; originally announced February 2024.

Context-Aware Spectrum Coexistence of Terrestrial Beyond 5G Networks in Satellite Bands

Authors: Ta Seen Reaz Niloy, Zoheb Hasan, Rob Smith, Vikram R. Anapana, Vijay K. Shah

Abstract: Spectrum sharing between terrestrial 5G and incumbent networks in the satellite bands presents a promising avenue to satisfy the ever-increasing bandwidth demand of the next-generation wireless networks. However, protecting incumbent operations from harmful interference poses a fundamental challenge in accommodating terrestrial broadband cellular networks in the satellite bands. State-of-the-art s… ▽ More Spectrum sharing between terrestrial 5G and incumbent networks in the satellite bands presents a promising avenue to satisfy the ever-increasing bandwidth demand of the next-generation wireless networks. However, protecting incumbent operations from harmful interference poses a fundamental challenge in accommodating terrestrial broadband cellular networks in the satellite bands. State-of-the-art spectrum-sharing policies usually consider several worst-case assumptions and ignore site-specific contextual factors in making spectrum-sharing decisions, and thus, often results in under-utilization of the shared band for the secondary licensees. To address such limitations, this paper introduces CAT3S (Context-Aware Terrestrial-Satellite Spectrum Sharing) framework that empowers the coexisting terrestrial 5G network to maximize utilization of the shared satellite band without creating harmful interference to the incumbent links by exploiting the contextual factors. CAT3S consists of the following two components: (i) context-acquisition unit to collect and process essential contextual information for spectrum sharing and (ii) context-aware base station (BS) control unit to optimize the set of operational BSs and their operation parameters (i.e., transmit power and active beams per sector). To evaluate the performance of the CAT3S, a realistic spectrum coexistence case study over the 12 GHz band is considered. Experiment results demonstrate that the proposed CAT3S achieves notably higher spectrum utilization than state-of-the-art spectrum-sharing policies in different weather contexts. △ Less

Submitted 14 February, 2024; v1 submitted 6 February, 2024; originally announced February 2024.

Leveraging Continuously Differentiable Activation Functions for Learning in Quantized Noisy Environments

Authors: Vivswan Shah, Nathan Youngblood

Abstract: Real-world analog systems intrinsically suffer from noise that can impede model convergence and accuracy on a variety of deep learning models. We demonstrate that differentiable activations like GELU and SiLU enable robust propagation of gradients which help to mitigate analog quantization error that is ubiquitous to all analog systems. We perform analysis and training of convolutional, linear, an… ▽ More Real-world analog systems intrinsically suffer from noise that can impede model convergence and accuracy on a variety of deep learning models. We demonstrate that differentiable activations like GELU and SiLU enable robust propagation of gradients which help to mitigate analog quantization error that is ubiquitous to all analog systems. We perform analysis and training of convolutional, linear, and transformer networks in the presence of quantized noise. Here, we are able to demonstrate that continuously differentiable activation functions are significantly more noise resilient over conventional rectified activations. As in the case of ReLU, the error in gradients are 100x higher than those in GELU near zero. Our findings provide guidance for selecting appropriate activations to realize performant and reliable hardware implementations across several machine learning domains such as computer vision, signal processing, and beyond. △ Less

Submitted 4 February, 2024; originally announced February 2024.

Efficient Causal Graph Discovery Using Large Language Models

Authors: Thomas Jiralerspong, Xiaoyin Chen, Yash More, Vedant Shah, Yoshua Bengio

Abstract: We propose a novel framework that leverages LLMs for full causal graph discovery. While previous LLM-based methods have used a pairwise query approach, this requires a quadratic number of queries which quickly becomes impractical for larger causal graphs. In contrast, the proposed framework uses a breadth-first search (BFS) approach which allows it to use only a linear number of queries. We also s… ▽ More We propose a novel framework that leverages LLMs for full causal graph discovery. While previous LLM-based methods have used a pairwise query approach, this requires a quadratic number of queries which quickly becomes impractical for larger causal graphs. In contrast, the proposed framework uses a breadth-first search (BFS) approach which allows it to use only a linear number of queries. We also show that the proposed method can easily incorporate observational data when available, to improve performance. In addition to being more time and data-efficient, the proposed framework achieves state-of-the-art results on real-world causal graphs of varying sizes. The results demonstrate the effectiveness and efficiency of the proposed method in discovering causal relationships, showcasing its potential for broad applicability in causal graph discovery tasks across different domains. △ Less

Submitted 20 July, 2024; v1 submitted 2 February, 2024; originally announced February 2024.

New Lower Bounds in Merlin-Arthur Communication and Graph Streaming Verification

Authors: Prantar Ghosh, Vihan Shah

Abstract: We show new lower bounds in the \emph{Merlin-Arthur} (MA) communication model and the related \emph{annotated streaming} or stream verification model. The MA communication model is an enhancement of the classical communication model, where in addition to the usual players Alice and Bob, there is an all-powerful but untrusted player Merlin who knows their inputs and tries to convince them about the… ▽ More We show new lower bounds in the \emph{Merlin-Arthur} (MA) communication model and the related \emph{annotated streaming} or stream verification model. The MA communication model is an enhancement of the classical communication model, where in addition to the usual players Alice and Bob, there is an all-powerful but untrusted player Merlin who knows their inputs and tries to convince them about the output. Most functions have MA protocols with total communication significantly smaller than what would be needed without Merlin. We focus on the online MA (OMA) model, which is the MA analogue of one-way communication, and introduce the notion of \emph{non-trivial-OMA} complexity of a function. This is the minimum total communication needed by any non-trivial OMA protocol computing that function, where a trivial OMA protocol is one where Alice sends Bob roughly as many bits as she would have sent without Merlin. We prove a lower bound on the non-trivial-OMA complexity of a natural function \emph{Equals-Index} (basically the well-known Index problem on large domains) and identify it as a canonical problem for proving strong lower bounds on this complexity: reductions from it (i) reproduce and/or improve upon the lower bounds for all functions that were previously known to have large non-trivial-OMA complexity, (ii) exhibit the first explicit functions whose non-trivial-OMA complexity is superlinear, and even exponential, in their classical one-way complexity, and (iii) show functions on input size $n$ for which this complexity is as large as $n/\log n$. While exhibiting a function with $ω(\sqrt{n})$ (standard) OMA complexity is a longstanding open problem, we did not even know of any function with $ω(\sqrt{n})$ non-trivial-OMA complexity. We further extend the lower bounds to a related streaming model called annotated streaming. △ Less

Submitted 12 January, 2024; originally announced January 2024.

Comments: To appear in ITCS 2024

Analysis and Validation of Image Search Engines in Histopathology

Authors: Isaiah Lahr, Saghir Alfasly, Peyman Nejat, Jibran Khan, Luke Kottom, Vaishnavi Kumbhar, Areej Alsaafin, Abubakr Shafique, Sobhan Hemati, Ghazal Alabtah, Nneka Comfere, Dennis Murphee, Aaron Mangold, Saba Yasir, Chady Meroueh, Lisa Boardman, Vijay H. Shah, Joaquin J. Garcia, H. R. Tizhoosh

Abstract: Searching for similar images in archives of histology and histopathology images is a crucial task that may aid in patient matching for various purposes, ranging from triaging and diagnosis to prognosis and prediction. Whole slide images (WSIs) are highly detailed digital representations of tissue specimens mounted on glass slides. Matching WSI to WSI can serve as the critical method for patient ma… ▽ More Searching for similar images in archives of histology and histopathology images is a crucial task that may aid in patient matching for various purposes, ranging from triaging and diagnosis to prognosis and prediction. Whole slide images (WSIs) are highly detailed digital representations of tissue specimens mounted on glass slides. Matching WSI to WSI can serve as the critical method for patient matching. In this paper, we report extensive analysis and validation of four search methods bag of visual words (BoVW), Yottixel, SISH, RetCCL, and some of their potential variants. We analyze their algorithms and structures and assess their performance. For this evaluation, we utilized four internal datasets ($1269$ patients) and three public datasets ($1207$ patients), totaling more than $200,000$ patches from $38$ different classes/subtypes across five primary sites. Certain search engines, for example, BoVW, exhibit notable efficiency and speed but suffer from low accuracy. Conversely, search engines like Yottixel demonstrate efficiency and speed, providing moderately accurate results. Recent proposals, including SISH, display inefficiency and yield inconsistent outcomes, while alternatives like RetCCL prove inadequate in both accuracy and efficiency. Further research is imperative to address the dual aspects of accuracy and minimal storage requirements in histopathological image search. △ Less

Submitted 8 June, 2024; v1 submitted 6 January, 2024; originally announced January 2024.

Gemini: A Family of Highly Capable Multimodal Models

Authors: Gemini Team, Rohan Anil, Sebastian Borgeaud, Jean-Baptiste Alayrac, Jiahui Yu, Radu Soricut, Johan Schalkwyk, Andrew M. Dai, Anja Hauth, Katie Millican, David Silver, Melvin Johnson, Ioannis Antonoglou, Julian Schrittwieser, Amelia Glaese, Jilin Chen, Emily Pitler, Timothy Lillicrap, Angeliki Lazaridou, Orhan Firat, James Molloy, Michael Isard, Paul R. Barham, Tom Hennigan, Benjamin Lee , et al. (1325 additional authors not shown)

Abstract: This report introduces a new family of multimodal models, Gemini, that exhibit remarkable capabilities across image, audio, video, and text understanding. The Gemini family consists of Ultra, Pro, and Nano sizes, suitable for applications ranging from complex reasoning tasks to on-device memory-constrained use-cases. Evaluation on a broad range of benchmarks shows that our most-capable Gemini Ultr… ▽ More This report introduces a new family of multimodal models, Gemini, that exhibit remarkable capabilities across image, audio, video, and text understanding. The Gemini family consists of Ultra, Pro, and Nano sizes, suitable for applications ranging from complex reasoning tasks to on-device memory-constrained use-cases. Evaluation on a broad range of benchmarks shows that our most-capable Gemini Ultra model advances the state of the art in 30 of 32 of these benchmarks - notably being the first model to achieve human-expert performance on the well-studied exam benchmark MMLU, and improving the state of the art in every one of the 20 multimodal benchmarks we examined. We believe that the new capabilities of the Gemini family in cross-modal reasoning and language understanding will enable a wide variety of use cases. We discuss our approach toward post-training and deploying Gemini models responsibly to users through services including Gemini, Gemini Advanced, Google AI Studio, and Cloud Vertex AI. △ Less

Submitted 17 June, 2024; v1 submitted 18 December, 2023; originally announced December 2023.

On the Divisibility of Degrees of Representations of Lie Algebras

Authors: Varun Shah, Steven Spallone

Abstract: Let $\mathfrak g$ be a reductive Lie algebra, and $m$ a positive integer. There is a natural density of irreducible representations of $\mathfrak g$, whose degrees are not divisible by $m$. For $\mathfrak g=\mathfrak{gl}_n$, this density decays exponentially to $0$ as $n \to \infty$. Similar results hold for simple Lie algebras and Lie groups, and there are versions for self-dual and orthogonal re… ▽ More Let $\mathfrak g$ be a reductive Lie algebra, and $m$ a positive integer. There is a natural density of irreducible representations of $\mathfrak g$, whose degrees are not divisible by $m$. For $\mathfrak g=\mathfrak{gl}_n$, this density decays exponentially to $0$ as $n \to \infty$. Similar results hold for simple Lie algebras and Lie groups, and there are versions for self-dual and orthogonal representations. △ Less

Submitted 1 December, 2023; originally announced December 2023.

Street TryOn: Learning In-the-Wild Virtual Try-On from Unpaired Person Images

Authors: Aiyu Cui, Jay Mahajan, Viraj Shah, Preeti Gomathinayagam, Chang Liu, Svetlana Lazebnik

Abstract: Most virtual try-on research is motivated to serve the fashion business by generating images to demonstrate garments on studio models at a lower cost. However, virtual try-on should be a broader application that also allows customers to visualize garments on themselves using their own casual photos, known as in-the-wild try-on. Unfortunately, the existing methods, which achieve plausible results f… ▽ More Most virtual try-on research is motivated to serve the fashion business by generating images to demonstrate garments on studio models at a lower cost. However, virtual try-on should be a broader application that also allows customers to visualize garments on themselves using their own casual photos, known as in-the-wild try-on. Unfortunately, the existing methods, which achieve plausible results for studio try-on settings, perform poorly in the in-the-wild context. This is because these methods often require paired images (garment images paired with images of people wearing the same garment) for training. While such paired data is easy to collect from shopping websites for studio settings, it is difficult to obtain for in-the-wild scenes. In this work, we fill the gap by (1) introducing a StreetTryOn benchmark to support in-the-wild virtual try-on applications and (2) proposing a novel method to learn virtual try-on from a set of in-the-wild person images directly without requiring paired data. We tackle the unique challenges, including warping garments to more diverse human poses and rendering more complex backgrounds faithfully, by a novel DensePose warping correction method combined with diffusion-based conditional inpainting. Our experiments show competitive performance for standard studio try-on tasks and SOTA performance for street try-on and cross-domain try-on tasks. △ Less

Submitted 16 July, 2024; v1 submitted 27 November, 2023; originally announced November 2023.

Comments: The abstract and intro are updated. Some typos and some pdf rendering errors have been fixed in the version

Unlearning via Sparse Representations

Authors: Vedant Shah, Frederik Träuble, Ashish Malik, Hugo Larochelle, Michael Mozer, Sanjeev Arora, Yoshua Bengio, Anirudh Goyal

Abstract: Machine \emph{unlearning}, which involves erasing knowledge about a \emph{forget set} from a trained model, can prove to be costly and infeasible by existing techniques. We propose a nearly compute-free zero-shot unlearning technique based on a discrete representational bottleneck. We show that the proposed technique efficiently unlearns the forget set and incurs negligible damage to the model's p… ▽ More Machine \emph{unlearning}, which involves erasing knowledge about a \emph{forget set} from a trained model, can prove to be costly and infeasible by existing techniques. We propose a nearly compute-free zero-shot unlearning technique based on a discrete representational bottleneck. We show that the proposed technique efficiently unlearns the forget set and incurs negligible damage to the model's performance on the rest of the data set. We evaluate the proposed technique on the problem of \textit{class unlearning} using three datasets: CIFAR-10, CIFAR-100, and LACUNA-100. We compare the proposed technique to SCRUB, a state-of-the-art approach which uses knowledge distillation for unlearning. Across all three datasets, the proposed technique performs as well as, if not better than SCRUB while incurring almost no computational cost. △ Less

Submitted 26 November, 2023; originally announced November 2023.

ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAs

Authors: Viraj Shah, Nataniel Ruiz, Forrester Cole, Erika Lu, Svetlana Lazebnik, Yuanzhen Li, Varun Jampani

Abstract: Methods for finetuning generative models for concept-driven personalization generally achieve strong results for subject-driven or style-driven generation. Recently, low-rank adaptations (LoRA) have been proposed as a parameter-efficient way of achieving concept-driven personalization. While recent work explores the combination of separate LoRAs to achieve joint generation of learned styles and su… ▽ More Methods for finetuning generative models for concept-driven personalization generally achieve strong results for subject-driven or style-driven generation. Recently, low-rank adaptations (LoRA) have been proposed as a parameter-efficient way of achieving concept-driven personalization. While recent work explores the combination of separate LoRAs to achieve joint generation of learned styles and subjects, existing techniques do not reliably address the problem; they often compromise either subject fidelity or style fidelity. We propose ZipLoRA, a method to cheaply and effectively merge independently trained style and subject LoRAs in order to achieve generation of any user-provided subject in any user-provided style. Experiments on a wide range of subject and style combinations show that ZipLoRA can generate compelling results with meaningful improvements over baselines in subject and style fidelity while preserving the ability to recontextualize. Project page: https://ziplora.github.io △ Less

Submitted 22 November, 2023; originally announced November 2023.

Comments: Project page: https://ziplora.github.io

Updating the first CHIME/FRB catalog of fast radio bursts with baseband data

Authors: The CHIME/FRB Collaboration, :, Mandana Amiri, Bridget C. Andersen, Shion Andrew, Kevin Bandura, Mohit Bhardwaj, P. J. Boyle, Charanjot Brar, Daniela Breitman, Tomas Cassanelli, Pragya Chawla, Amanda M. Cook, Alice P. Curtin, Matt Dobbs, Fengqiu Adam Dong, Gwendolyn Eadie, Emmanuel Fonseca, B. M. Gaensler, Utkarsh Giri, Antonio Herrera-Martin, Hans Hopkins, Adaeze L. Ibik, Ronniy C. Joseph, J. F. Kaczmarek , et al. (36 additional authors not shown)

Abstract: In 2021, a catalog of 536 fast radio bursts (FRBs) detected with the Canadian Hydrogen Intensity Mapping Experiment (CHIME) radio telescope was released by the CHIME/FRB Collaboration. This large collection of bursts, observed with a single instrument and uniform selection effects, has advanced our understanding of the FRB population. Here we update the results for 140 of these FRBs for which chan… ▽ More In 2021, a catalog of 536 fast radio bursts (FRBs) detected with the Canadian Hydrogen Intensity Mapping Experiment (CHIME) radio telescope was released by the CHIME/FRB Collaboration. This large collection of bursts, observed with a single instrument and uniform selection effects, has advanced our understanding of the FRB population. Here we update the results for 140 of these FRBs for which channelized raw voltage ('baseband') data are available. With the voltages measured by the telescope's antennas, it is possible to maximize the telescope sensitivity in any direction within the primary beam, an operation called 'beamforming'. This allows us to increase the signal-to-noise ratio (S/N) of the bursts and to localize them to sub-arcminute precision. The improved localization is also used to correct the beam response of the instrument and to measure fluxes and fluences with a ~10% uncertainty. Additionally, the time resolution is increased by three orders of magnitude relative to that in the first CHIME/FRB catalog, and, applying coherent dedispersion, burst morphologies can be studied in detail. Polarization information is also available for the full sample of 140 FRBs, providing an unprecedented dataset to study the polarization properties of the population. We release the baseband data beamformed to the most probable position of each FRB. These data are analyzed in detail in a series of accompanying papers. △ Less

Submitted 22 May, 2024; v1 submitted 31 October, 2023; originally announced November 2023.

Fluid dynamics alters liquid-liquid phase separation in confined aqueous two-phase systems

Authors: Eric W. Hester, Sean P. Carney, Vishwesh Shah, Alyssa Arnheim, Bena Patel, Dino Di Carlo, Andrea L. Bertozzi

Abstract: Liquid-liquid phase separation is key to understanding aqueous two-phase systems (ATPS) arising throughout cell biology, medical science, and the pharmaceutical industry. Controlling the detailed morphology of phase-separating compound droplets leads to new technologies for efficient single-cell analysis, targeted drug delivery, and effective cell scaffolds for wound healing. We present a computat… ▽ More Liquid-liquid phase separation is key to understanding aqueous two-phase systems (ATPS) arising throughout cell biology, medical science, and the pharmaceutical industry. Controlling the detailed morphology of phase-separating compound droplets leads to new technologies for efficient single-cell analysis, targeted drug delivery, and effective cell scaffolds for wound healing. We present a computational model of liquid-liquid phase separation relevant to recent laboratory experiments with gelatin-polyethylene glycol mixtures. We include buoyancy and surface-tension-driven finite viscosity fluid dynamics with thermally induced phase separation. We show that the fluid dynamics greatly alters the evolution and equilibria of the phase separation problem. Notably, buoyancy plays a critical role in driving the ATPS to energy-minimizing crescent-shaped morphologies and shear flows can generate a tenfold speedup in particle formation. Neglecting fluid dynamics produces incorrect minimum-energy droplet shapes. The model allows for optimization of current manufacturing procedures for structured microparticles and improves understanding of ATPS evolution in confined and flowing settings important in biology and biotechnology. △ Less

Submitted 26 October, 2023; originally announced October 2023.

Comments: 9 pages, 8 figures, 3 supplementary movies, to appear in Proceedings of the National Academy of Sciences, accompanying code and parameters to generate data available at https://github.com/ericwhester/multiphase-fluids-code

MSC Class: 76-10 (Primary) 76T30; 76T06; 74A50; 80A22 (Secondary)

Predictions for Electromagnetic Counterparts to Neutron Star Mergers Discovered during LIGO-Virgo-KAGRA Observing Runs 4 and 5

Authors: Ved G. Shah, Gautham Narayan, Haille M. L. Perkins, Ryan J. Foley, Deep Chatterjee, Bryce Cousins, Phillip Macias

Abstract: We present a comprehensive, configurable open-source framework for estimating the rate of electromagnetic detection of kilonovae (KNe) associated with gravitational wave detections of binary neutron star (BNS) mergers. We simulate the current LIGO-Virgo-KAGRA (LVK) observing run (O4) using up-to-date sensitivity and up-time values as well as the next observing run (O5) using predicted sensitivitie… ▽ More We present a comprehensive, configurable open-source framework for estimating the rate of electromagnetic detection of kilonovae (KNe) associated with gravitational wave detections of binary neutron star (BNS) mergers. We simulate the current LIGO-Virgo-KAGRA (LVK) observing run (O4) using up-to-date sensitivity and up-time values as well as the next observing run (O5) using predicted sensitivities. We find the number of discoverable kilonovae during LVK O4 to be ${ 1}_{- 1}^{+ 4}$ or ${ 2 }_{- 2 }^{+ 3 }$, (at 90% confidence) depending on the distribution of NS masses in coalescing binaries, with the number increasing by an order of magnitude during O5 to ${ 19 }_{- 11 }^{+ 24 }$. Regardless of mass model, we predict at most five detectable KNe (at 95% confidence) in O4. We also produce optical and near-infrared light curves that correspond to the physical properties of each merging system. We have collated important information for allocating observing resources and directing search and follow-up observations including distributions of peak magnitudes in several broad bands and timescales for which specific facilities can detect each KN. The framework is easily adaptable, and new simulations can quickly be produced as input information such as merger rates and NS mass distributions are refined. Finally, we compare our suite of simulations to the thus-far completed portion of O4 (as of October 14, 2023), finding a median number of discoverable KNe of 0 and a 95-percentile upper limit of 2, consistent with no detection so far in O4. △ Less

Submitted 28 November, 2023; v1 submitted 23 October, 2023; originally announced October 2023.

Comments: 16 pages, 13 figures, MNRAS: Accepted 2023 November 25. Received 2023 November 16; in original form 2023 October 25

When is a Foundation Model a Foundation Model

Authors: Saghir Alfasly, Peyman Nejat, Sobhan Hemati, Jibran Khan, Isaiah Lahr, Areej Alsaafin, Abubakr Shafique, Nneka Comfere, Dennis Murphree, Chady Meroueh, Saba Yasir, Aaron Mangold, Lisa Boardman, Vijay Shah, Joaquin J. Garcia, H. R. Tizhoosh

Abstract: Recently, several studies have reported on the fine-tuning of foundation models for image-text modeling in the field of medicine, utilizing images from online data sources such as Twitter and PubMed. Foundation models are large, deep artificial neural networks capable of learning the context of a specific domain through training on exceptionally extensive datasets. Through validation, we have obse… ▽ More Recently, several studies have reported on the fine-tuning of foundation models for image-text modeling in the field of medicine, utilizing images from online data sources such as Twitter and PubMed. Foundation models are large, deep artificial neural networks capable of learning the context of a specific domain through training on exceptionally extensive datasets. Through validation, we have observed that the representations generated by such models exhibit inferior performance in retrieval tasks within digital pathology when compared to those generated by significantly smaller, conventional deep networks. △ Less

Submitted 14 September, 2023; originally announced September 2023.

Deep Learning based Fast and Accurate Beamforming for Millimeter-Wave Systems

Authors: Tarun S Cousik, Vijay K Shah, Jeffrey H. Reed Harry X Tran, Rittwik Jana

Abstract: The widespread proliferation of mmW devices has led to a surge of interest in antenna arrays. This interest in arrays is due to their ability to steer beams in desired directions, for the purpose of increasing signal-power and/or decreasing interference levels. To enable beamforming, array coefficients are typically stored in look-up tables (LUTs) for subsequent referencing. While LUTs enable fast… ▽ More The widespread proliferation of mmW devices has led to a surge of interest in antenna arrays. This interest in arrays is due to their ability to steer beams in desired directions, for the purpose of increasing signal-power and/or decreasing interference levels. To enable beamforming, array coefficients are typically stored in look-up tables (LUTs) for subsequent referencing. While LUTs enable fast sweep times, their limited memory size restricts the number of beams the array can produce. Consequently, a receiver is likely to be offset from the main beam, thus decreasing received power, and resulting in sub-optimal performance. In this letter, we present BeamShaper, a deep neural network (DNN) framework, which enables fast and accurate beamsteering in any desirable 3-D direction. Unlike traditional finite-memory LUTs which support a fixed set of beams, BeamShaper utilizes a trained NN model to generate the array coefficients for arbitrary directions in \textit{real-time}. Our simulations show that BeamShaper outperforms contemporary LUT based solutions in terms of cosine-similarity and central angle in time scales that are slightly higher than LUT based solutions. Additionally, we show that our DNN based approach has the added advantage of being more resilient to the effects of quantization noise generated while using digital phase-shifters. △ Less

Submitted 19 September, 2023; originally announced September 2023.

Comments: 7 pages, 5 figures, accepted to Milcom2023. Not published yet(Sep 2023)

Experimental Study of Adversarial Attacks on ML-based xApps in O-RAN

Authors: Naveen Naik Sapavath, Brian Kim, Kaushik Chowdhury, Vijay K Shah

Abstract: Open Radio Access Network (O-RAN) is considered as a major step in the evolution of next-generation cellular networks given its support for open interfaces and utilization of artificial intelligence (AI) into the deployment, operation, and maintenance of RAN. However, due to the openness of the O-RAN architecture, such AI models are inherently vulnerable to various adversarial machine learning (ML… ▽ More Open Radio Access Network (O-RAN) is considered as a major step in the evolution of next-generation cellular networks given its support for open interfaces and utilization of artificial intelligence (AI) into the deployment, operation, and maintenance of RAN. However, due to the openness of the O-RAN architecture, such AI models are inherently vulnerable to various adversarial machine learning (ML) attacks, i.e., adversarial attacks which correspond to slight manipulation of the input to the ML model. In this work, we showcase the vulnerability of an example ML model used in O-RAN, and experimentally deploy it in the near-real time (near-RT) RAN intelligent controller (RIC). Our ML-based interference classifier xApp (extensible application in near-RT RIC) tries to classify the type of interference to mitigate the interference effect on the O-RAN system. We demonstrate the first-ever scenario of how such an xApp can be impacted through an adversarial attack by manipulating the data stored in a shared database inside the near-RT RIC. Through a rigorous performance analysis deployed on a laboratory O-RAN testbed, we evaluate the performance in terms of capacity and the prediction accuracy of the interference classifier xApp using both clean and perturbed data. We show that even small adversarial attacks can significantly decrease the accuracy of ML application in near-RT RIC, which can directly impact the performance of the entire O-RAN deployment. △ Less

Submitted 7 September, 2023; originally announced September 2023.

Comments: Accepted for Globecom 2023

RL-based Variable Horizon Model Predictive Control of Multi-Robot Systems using Versatile On-Demand Collision Avoidance

Authors: Shreyash Gupta, Abhinav Kumar, Niladri S. Tripathy, Suril V. Shah

Abstract: Multi-robot systems have become very popular in recent years because of their wide spectrum of applications, ranging from surveillance to cooperative payload transportation. Model Predictive Control (MPC) is a promising controller for multi-robot control because of its preview capability and ability to handle constraints easily. The performance of the MPC widely depends on many parameters, among w… ▽ More Multi-robot systems have become very popular in recent years because of their wide spectrum of applications, ranging from surveillance to cooperative payload transportation. Model Predictive Control (MPC) is a promising controller for multi-robot control because of its preview capability and ability to handle constraints easily. The performance of the MPC widely depends on many parameters, among which the prediction horizon is the major contributor. Increasing the prediction horizon beyond a limit drastically increases the computation cost. Tuning the value of the prediction horizon can be very time-consuming, and the tuning process must be repeated for every task. Moreover, instead of using a fixed horizon for an entire task, a better balance between performance and computation cost can be established if different prediction horizons can be employed for every robot at each time step. Further, for such variable prediction horizon MPC for multiple robots, on-demand collision avoidance is the key requirement. We propose Versatile On-demand Collision Avoidance (VODCA) strategy to comply with the variable horizon model predictive control. We also present a framework for learning the prediction horizon for the multi-robot system as a function of the states of the robots using the Soft Actor-Critic (SAC) RL algorithm. The results are illustrated and validated numerically for different multi-robot tasks. △ Less

Submitted 14 August, 2023; originally announced August 2023.

The Unequal Opportunities of Large Language Models: Revealing Demographic Bias through Job Recommendations

Authors: Abel Salinas, Parth Vipul Shah, Yuzhong Huang, Robert McCormack, Fred Morstatter

Abstract: Large Language Models (LLMs) have seen widespread deployment in various real-world applications. Understanding these biases is crucial to comprehend the potential downstream consequences when using LLMs to make decisions, particularly for historically disadvantaged groups. In this work, we propose a simple method for analyzing and comparing demographic bias in LLMs, through the lens of job recomme… ▽ More Large Language Models (LLMs) have seen widespread deployment in various real-world applications. Understanding these biases is crucial to comprehend the potential downstream consequences when using LLMs to make decisions, particularly for historically disadvantaged groups. In this work, we propose a simple method for analyzing and comparing demographic bias in LLMs, through the lens of job recommendations. We demonstrate the effectiveness of our method by measuring intersectional biases within ChatGPT and LLaMA, two cutting-edge LLMs. Our experiments primarily focus on uncovering gender identity and nationality bias; however, our method can be extended to examine biases associated with any intersection of demographic identities. We identify distinct biases in both models toward various demographic identities, such as both models consistently suggesting low-paying jobs for Mexican workers or preferring to recommend secretarial roles to women. Our study highlights the importance of measuring the bias of LLMs in downstream applications to understand the potential for harm and inequitable outcomes. △ Less

Submitted 9 January, 2024; v1 submitted 3 August, 2023; originally announced August 2023.

Comments: Accepted to EAAMO 2023

Shifting Cryptocurrency Influence: A High-Resolution Network Analysis of Market Leaders

Authors: Arnav Hiray, Pratvi Shah, Vishwa Shah, Agam Shah, Sudheer Chava, Mukesh Tiwari

Abstract: Over the last decade, the cryptocurrency market has experienced unprecedented growth, emerging as a prominent financial market. As this market rapidly evolves, it necessitates re-evaluating which cryptocurrencies command the market and steer the direction of blockchain technology. We implement a network-based cryptocurrency market analysis to investigate this changing landscape. We use novel hourl… ▽ More Over the last decade, the cryptocurrency market has experienced unprecedented growth, emerging as a prominent financial market. As this market rapidly evolves, it necessitates re-evaluating which cryptocurrencies command the market and steer the direction of blockchain technology. We implement a network-based cryptocurrency market analysis to investigate this changing landscape. We use novel hourly-resolution data and Kendall's Tau correlation to explore the interconnectedness of the cryptocurrency market. We observed critical differences in the hierarchy of cryptocurrencies determined by our method compared to rankings derived from daily data and Pearson's correlation. This divergence emphasizes the potential information loss stemming from daily data aggregation and highlights the limitations of Pearson's correlation. Our findings show that in the early stages of this growth, Bitcoin held a leading role. However, during the 2021 bull run, the landscape changed drastically. We see that while Ethereum has emerged as the overall leader, it was FTT and its associated exchange, FTX, that greatly led to the increase at the beginning of the bull run. We also find that highly-influential cryptocurrencies are increasingly gaining a commanding influence over the market as time progresses, despite the growing number of cryptocurrencies making up the market. △ Less

Submitted 30 January, 2024; v1 submitted 31 July, 2023; originally announced July 2023.

Comments: Withdrawing this preprint due to a minor error in the code implementation that affects the results

Adaptive RRI Selection Algorithms for Improved Cooperative Awareness in Decentralized NR-V2X

Authors: Avik Dayal, Vijay K. Shah, Harpreet S. Dhillon, Jeffrey H. Reed

Abstract: Decentralized vehicle-to-everything (V2X) networks (i.e., C-V2X Mode-4 and NR-V2X Mode-2) utilize sensing-based semi-persistent scheduling (SPS) where vehicles sense and reserve suitable radio resources for Basic Safety Message (BSM) transmissions at prespecified periodic intervals termed as Resource Reservation Interval (RRI). Vehicles rely on these received periodic BSMs to localize nearby (tran… ▽ More Decentralized vehicle-to-everything (V2X) networks (i.e., C-V2X Mode-4 and NR-V2X Mode-2) utilize sensing-based semi-persistent scheduling (SPS) where vehicles sense and reserve suitable radio resources for Basic Safety Message (BSM) transmissions at prespecified periodic intervals termed as Resource Reservation Interval (RRI). Vehicles rely on these received periodic BSMs to localize nearby (transmitting) vehicles and infrastructure, referred to as cooperative awareness. Cooperative awareness enables line of sight and non-line of sight localization, extending a vehicle's sensing and perception range. In this work, we first show that under high vehicle density scenarios, existing SPS (with prespecified RRIs) suffer from poor cooperative awareness, quantified as tracking error. Decentralized vehicle-to-everything (V2X) networks (i.e., C-V2X Mode-4 and NR-V2X Mode-2) utilize sensing-based semi-persistent scheduling (SPS) where vehicles sense and reserve suitable radio resources for Basic Safety Message (BSM) transmissions at prespecified periodic intervals termed as Resource Reservation Interval (RRI). Vehicles rely on these received periodic BSMs to localize nearby (transmitting) vehicles and infrastructure, referred to as cooperative awareness. Cooperative awareness enables line of sight and non-line of sight localization, extending a vehicle's sensing and perception range. In this work, we first show that under high vehicle density scenarios, existing SPS (with prespecified RRIs) suffer from poor cooperative awareness, quantified as tracking error. △ Less

Submitted 23 July, 2023; originally announced July 2023.

A CHIME/FRB study of burst rate and morphological evolution of the periodically repeating FRB 20180916B

Authors: Ketan R. Sand, Daniela Breitman, Daniele Michilli, Victoria M. Kaspi, Pragya Chawla, Emmanuel Fonseca, Ryan Mckinven, Kenzie Nimmo, Ziggy Pleunis, Kaitlyn Shin, Bridget C. Andersen, Mohit Bhardwaj, P. J. Boyle, Charanjot Brar, Tomas Cassanelli, Amanda M. Cook, Alice P. Curtin, Fengqiu Adam Dong, Gwendolyn M. Eadie, B. M. Gaensler, Jane Kaczmarek, Adam Lanman, Calvin Leung, Kiyoshi W. Masui, Mubdi Rahman , et al. (9 additional authors not shown)

Abstract: FRB 20180916B is a repeating Fast Radio Burst (FRB) with a 16.3-day periodicity in its activity. In this study, we present morphological properties of 60 FRB 20180916B bursts detected by CHIME/FRB between 2018 August and 2021 December. We recorded raw voltage data for 45 of these bursts, enabling microseconds time resolution in some cases. We studied variation of spectro-temporal properties with t… ▽ More FRB 20180916B is a repeating Fast Radio Burst (FRB) with a 16.3-day periodicity in its activity. In this study, we present morphological properties of 60 FRB 20180916B bursts detected by CHIME/FRB between 2018 August and 2021 December. We recorded raw voltage data for 45 of these bursts, enabling microseconds time resolution in some cases. We studied variation of spectro-temporal properties with time and activity phase. We find that the variation in Dispersion Measure (DM) is $\lesssim$1 pc cm$^{-3}$ and that there is burst-to-burst variation in scattering time estimates ranging from $\sim$0.16 to over 2 ms, with no discernible trend with activity phase for either property. Furthermore, we find no DM and scattering variability corresponding to the recent change in rotation measure from the source, which has implications for the immediate environment of the source. We find that FRB 20180916B has thus far shown no epochs of heightened activity as have been seen in other active repeaters by CHIME/FRB, with its burst count consistent with originating from a Poissonian process. We also observe no change in the value of the activity period over the duration of our observations and set a 1$σ$ upper limit of $1.5\times10^{-4}$ day day$^{-1}$ on the absolute period derivative. Finally, we discuss constraints on progenitor models yielded by our results, noting that our upper limits on changes in scattering and dispersion measure as a function of phase do not support models invoking a massive binary companion star as the origin of the 16.3-day periodicity. △ Less

Submitted 11 July, 2023; originally announced July 2023.

Comments: 25 pages, 10 figures

Machine Vision Using Cellphone Camera: A Comparison of deep networks for classifying three challenging denominations of Indian Coins

Authors: Keyur D. Joshi, Dhruv Shah, Varshil Shah, Nilay Gandhi, Sanket J. Shah, Sanket B. Shah

Abstract: Indian currency coins come in a variety of denominations. Off all the varieties Rs.1, RS.2, and Rs.5 have similar diameters. Majority of the coin styles in market circulation for denominations of Rs.1 and Rs.2 coins are nearly the same except for numerals on its reverse side. If a coin is resting on its obverse side, the correct denomination is not distinguishable by humans. Therefore, it was hypo… ▽ More Indian currency coins come in a variety of denominations. Off all the varieties Rs.1, RS.2, and Rs.5 have similar diameters. Majority of the coin styles in market circulation for denominations of Rs.1 and Rs.2 coins are nearly the same except for numerals on its reverse side. If a coin is resting on its obverse side, the correct denomination is not distinguishable by humans. Therefore, it was hypothesized that a digital image of a coin resting on its either size could be classified into its correct denomination by training a deep neural network model. The digital images were generated by using cheap cell phone cameras. To find the most suitable deep neural network architecture, four were selected based on the preliminary analysis carried out for comparison. The results confirm that two of the four deep neural network models can classify the correct denomination from either side of a coin with an accuracy of 97%. △ Less

Submitted 12 May, 2023; originally announced June 2023.

Comments: 6 Pages, 4 Figures, 6 Tables, Conference paper

Translation and Fusion Improves Zero-shot Cross-lingual Information Extraction

Authors: Yang Chen, Vedaant Shah, Alan Ritter

Abstract: Large language models (LLMs) combined with instruction tuning have shown significant progress in information extraction (IE) tasks, exhibiting strong generalization capabilities to unseen datasets by following annotation guidelines. However, their applicability to low-resource languages remains limited due to lack of both labeled data for fine-tuning, and unlabeled text for pre-training. In this p… ▽ More Large language models (LLMs) combined with instruction tuning have shown significant progress in information extraction (IE) tasks, exhibiting strong generalization capabilities to unseen datasets by following annotation guidelines. However, their applicability to low-resource languages remains limited due to lack of both labeled data for fine-tuning, and unlabeled text for pre-training. In this paper, we propose TransFusion, a framework in which models are fine-tuned to use English translations of low-resource language data, enabling more precise predictions through annotation fusion. Based on TransFusion, we introduce GoLLIE-TF, a cross-lingual instruction-tuned LLM for IE tasks, designed to close the performance gap between high and low-resource languages. Our experiments across twelve multilingual IE datasets spanning 50 languages demonstrate that GoLLIE-TF achieves better zero-shot cross-lingual transfer over the base model. In addition, we show that TransFusion significantly improves low-resource language named entity recognition when applied to proprietary models such as GPT-4 (+5 F1) with a prompting approach, or fine-tuning different language models including decoder-only (+14 F1) and encoder-only (+13 F1) architectures. △ Less

Submitted 20 June, 2024; v1 submitted 22 May, 2023; originally announced May 2023.

JoIN: Joint GANs Inversion for Intrinsic Image Decomposition

Authors: Viraj Shah, Svetlana Lazebnik, Julien Philip

Abstract: In this work, we propose to solve ill-posed inverse imaging problems using a bank of Generative Adversarial Networks (GAN) as a prior and apply our method to the case of Intrinsic Image Decomposition for faces and materials. Our method builds on the demonstrated success of GANs to capture complex image distributions. At the core of our approach is the idea that the latent space of a GAN is a well-… ▽ More In this work, we propose to solve ill-posed inverse imaging problems using a bank of Generative Adversarial Networks (GAN) as a prior and apply our method to the case of Intrinsic Image Decomposition for faces and materials. Our method builds on the demonstrated success of GANs to capture complex image distributions. At the core of our approach is the idea that the latent space of a GAN is a well-suited optimization domain to solve inverse problems. Given an input image, we propose to jointly inverse the latent codes of a set of GANs and combine their outputs to reproduce the input. Contrary to most GAN inversion methods which are limited to inverting only a single GAN, we demonstrate that it is possible to maintain distribution priors while inverting several GANs jointly. We show that our approach is modular, allowing various forward imaging models, and that it can successfully decompose both synthetic and real images. △ Less

Submitted 22 January, 2024; v1 submitted 18 May, 2023; originally announced May 2023.

Comments: Project webpage is available at https://virajshah.com/join

Make It So: Steering StyleGAN for Any Image Inversion and Editing

Authors: Anand Bhattad, Viraj Shah, Derek Hoiem, D. A. Forsyth

Abstract: StyleGAN's disentangled style representation enables powerful image editing by manipulating the latent variables, but accurately mapping real-world images to their latent variables (GAN inversion) remains a challenge. Existing GAN inversion methods struggle to maintain editing directions and produce realistic results. To address these limitations, we propose Make It So, a novel GAN inversion met… ▽ More StyleGAN's disentangled style representation enables powerful image editing by manipulating the latent variables, but accurately mapping real-world images to their latent variables (GAN inversion) remains a challenge. Existing GAN inversion methods struggle to maintain editing directions and produce realistic results. To address these limitations, we propose Make It So, a novel GAN inversion method that operates in the $\mathcal{Z}$ (noise) space rather than the typical $\mathcal{W}$ (latent style) space. Make It So preserves editing capabilities, even for out-of-domain images. This is a crucial property that was overlooked in prior methods. Our quantitative evaluations demonstrate that Make It So outperforms the state-of-the-art method PTI~\cite{roich2021pivotal} by a factor of five in inversion accuracy and achieves ten times better edit quality for complex indoor scenes. △ Less

Submitted 27 April, 2023; originally announced April 2023.

Comments: project: https://anandbhattad.github.io/makeitso/

TONE: A CHIME/FRB Outrigger Pathfinder for localizations of Fast Radio Bursts using Very Long Baseline Interferometry

Authors: Pranav Sanghavi, Calvin Leung, Kevin Bandura, Tomas Cassanelli, Jane Kaczmarek, Victoria M. Kaspi, Kholoud Khairy, Adam Lanman, Mattias Lazda, Kiyoshi W. Masui, Juan Mena-Parra, Daniele Michilli, Ue-Li Pen, Jeffrey B. Peterson, Mubdi Rahman, Vishwangi Shah

Abstract: The sensitivity and field of view of the Canadian Hydrogen Intensity Mapping Experiment (CHIME) has enabled its fast radio burst (FRB) backend to detect thousands of FRBs. However, the low angular resolution of CHIME prevents it from localizing most FRBs to their host galaxies. Very long baseline interferometry (VLBI) can readily provide the subarcsecond resolution needed to localize many FRBs to… ▽ More The sensitivity and field of view of the Canadian Hydrogen Intensity Mapping Experiment (CHIME) has enabled its fast radio burst (FRB) backend to detect thousands of FRBs. However, the low angular resolution of CHIME prevents it from localizing most FRBs to their host galaxies. Very long baseline interferometry (VLBI) can readily provide the subarcsecond resolution needed to localize many FRBs to their hosts. Thus we developed TONE: an interferometric array of eight $6~\mathrm{m}$ dishes to serve as a pathfinder for the CHIME/FRB Outriggers project, which will use wide field of view cylinders to determine the sky positions for a large sample of FRBs, revealing their positions within their host galaxies to subarcsecond precision. In the meantime, TONE's $\sim3333~\mathrm{km}$ baseline with CHIME proves to be an excellent testbed for the development and characterization of single-pulse VLBI techniques at the time of discovery. This work describes the TONE instrument, its sensitivity, and its astrometric precision in single-pulse VLBI. We believe that our astrometric errors are dominated by uncertainties in the clock measurements which build up between successive Crab pulsar calibrations which happen every $\approx 24~\mathrm{h}$; the wider fields of view and higher sensitivity of the Outriggers will provide opportunities for higher-cadence calibration. At present, CHIME-TONE localizations of the Crab pulsar yield systematic localization errors of ${0.1}-{0.2}~\mathrm{arcsec}$ - comparable to the resolution afforded by state-of-the-art optical instruments ($\sim 0.05 ~\mathrm{arcsec}$). △ Less

Submitted 25 April, 2023; v1 submitted 20 April, 2023; originally announced April 2023.

Comments: 32 Pages, 26 Figures, Submitted to Journal of Astronomical Instrumentation. typos and figures corrected, clarify language pre-submission to the journal

Battlefield transfers in coalitional Blotto games

Authors: Vade Shah, Jason R. Marden

Abstract: In this work, we consider the framework of coalitional Blotto games in which two players compete against a common adversary by allocating their budgeted resources across disjoint sets of valued battlefields; the agent that allocates a higher amount wins the corresponding battlefield value. At the beginning of the game, the budgets of the agents and the values of the battlefields are specified. In… ▽ More In this work, we consider the framework of coalitional Blotto games in which two players compete against a common adversary by allocating their budgeted resources across disjoint sets of valued battlefields; the agent that allocates a higher amount wins the corresponding battlefield value. At the beginning of the game, the budgets of the agents and the values of the battlefields are specified. In the first stage, the players are allowed to perform a battlefield transfer in which one player offloads a number of its battlefields onto the other player. In the second stage, the adversary observes this transfer and determines how to allocate their budget accordingly. Finally, in the third stage, the players and the adversary allocate their budgets to their battlefields, the game is played, and their payoffs are realized. We provide necessary and sufficient conditions for the existence of a battlefield transfer that strictly increases the payoff of each player. We then augment the model, allowing players to not only transfer subsets of battlefields, but also portions of their budget, in the first stage. We also provide sufficient conditions for the existence of a joint transfer of battlefields and budgets. The results demonstrate that in almost all game instances, both players would benefit from such a joint transfer. △ Less

Submitted 4 April, 2023; originally announced April 2023.

Generalizing Greenwald-Khanna Streaming Quantile Summaries for Weighted Inputs

Authors: Sepehr Assadi, Nirmit Joshi, Milind Prabhu, Vihan Shah

Abstract: Estimating quantiles, like the median or percentiles, is a fundamental task in data mining and data science. A (streaming) quantile summary is a data structure that can process a set S of n elements in a streaming fashion and at the end, for any phi in (0,1], return a phi-quantile of S up to an eps error, i.e., return a phi'-quantile with phi'=phi +- eps. We are particularly interested in comparis… ▽ More Estimating quantiles, like the median or percentiles, is a fundamental task in data mining and data science. A (streaming) quantile summary is a data structure that can process a set S of n elements in a streaming fashion and at the end, for any phi in (0,1], return a phi-quantile of S up to an eps error, i.e., return a phi'-quantile with phi'=phi +- eps. We are particularly interested in comparison-based summaries that only compare elements of the universe under a total ordering and are otherwise completely oblivious of the universe. The best known deterministic quantile summary is the 20-year old Greenwald-Khanna (GK) summary that uses O((1/eps) log(eps n)) space [SIGMOD'01]. This bound was recently proved to be optimal for all deterministic comparison-based summaries by Cormode and Vesleý [PODS'20]. In this paper, we study weighted quantiles, a generalization of the quantiles problem, where each element arrives with a positive integer weight which denotes the number of copies of that element being inserted. The only known method of handling weighted inputs via GK summaries is the naive approach of breaking each weighted element into multiple unweighted items and feeding them one by one to the summary, which results in a prohibitively large update time (proportional to the maximum weight of input elements). We give the first non-trivial extension of GK summaries for weighted inputs and show that it takes O((1/eps) log(eps n)) space and O(log(1/eps)+ log log(eps n)) update time per element to process a stream of length n (under some quite mild assumptions on the range of weights and eps). En route to this, we also simplify the original GK summaries for unweighted quantiles. △ Less

Submitted 10 March, 2023; originally announced March 2023.

Comments: 33 pages, 7 figures, International Conference on Database Theory 2023

Keep It Simple: CNN Model Complexity Studies for Interference Classification Tasks

Authors: Taiwo Oyedare, Vijay K. Shah, Daniel J. Jakubisin, Jeffrey H. Reed

Abstract: The growing number of devices using the wireless spectrum makes it important to find ways to minimize interference and optimize the use of the spectrum. Deep learning models, such as convolutional neural networks (CNNs), have been widely utilized to identify, classify, or mitigate interference due to their ability to learn from the data directly. However, there have been limited research on the co… ▽ More The growing number of devices using the wireless spectrum makes it important to find ways to minimize interference and optimize the use of the spectrum. Deep learning models, such as convolutional neural networks (CNNs), have been widely utilized to identify, classify, or mitigate interference due to their ability to learn from the data directly. However, there have been limited research on the complexity of such deep learning models. The major focus of deep learning-based wireless classification literature has been on improving classification accuracy, often at the expense of model complexity. This may not be practical for many wireless devices, such as, internet of things (IoT) devices, which usually have very limited computational resources and cannot handle very complex models. Thus, it becomes important to account for model complexity when designing deep learning-based models for interference classification. To address this, we conduct an analysis of CNN based wireless classification that explores the trade-off amongst dataset size, CNN model complexity, and classification accuracy under various levels of classification difficulty: namely, interference classification, heterogeneous transmitter classification, and homogeneous transmitter classification. Our study, based on three wireless datasets, shows that a simpler CNN model with fewer parameters can perform just as well as a more complex model, providing important insights into the use of CNNs in computationally constrained applications. △ Less

Submitted 6 March, 2023; originally announced March 2023.

Comments: 6 pages, 7 figures, 3 tables

Simulating the Evolution of Signaling Signatures during CART-Cell -- Tumor Cell Interactions

Authors: Viren Shah, Justin Womack, Anthony E. Zamora, Scott S. Terhune, Ranjan K. Dash

Abstract: Immunotherapies have been proven to have significant therapeutic efficacy in the treatment of cancer. The last decade has seen adoptive cell therapies, such as chimeric antigen receptor T-cell (CART-cell) therapy, gain FDA approval against specific cancers. Additionally, there are numerous clinical trials ongoing investigating additional designs and targets. Nevertheless, despite the excitement an… ▽ More Immunotherapies have been proven to have significant therapeutic efficacy in the treatment of cancer. The last decade has seen adoptive cell therapies, such as chimeric antigen receptor T-cell (CART-cell) therapy, gain FDA approval against specific cancers. Additionally, there are numerous clinical trials ongoing investigating additional designs and targets. Nevertheless, despite the excitement and promising potential of CART-cell therapy, response rates to therapy vary greatly between studies, patients, and cancers. There remains an unmet need to develop computational frameworks that more accurately predict CART-cell function and clinical efficacy. Here we present a coarse-grained model simulated with logical rules that demonstrates the evolution of signaling signatures following the inter-action between CART-cells and tumor cells and allows for in silico based prediction of CART-cell functionality prior to experimentation. △ Less

Submitted 8 February, 2023; originally announced February 2023.

Learning Vision-based Robotic Manipulation Tasks Sequentially in Offline Reinforcement Learning Settings

Authors: Sudhir Pratap Yadav, Rajendra Nagar, Suril V. Shah

Abstract: With the rise of deep reinforcement learning (RL) methods, many complex robotic manipulation tasks are being solved. However, harnessing the full power of deep learning requires large datasets. Online-RL does not suit itself readily into this paradigm due to costly and time-taking agent environment interaction. Therefore recently, many offline-RL algorithms have been proposed to learn robotic task… ▽ More With the rise of deep reinforcement learning (RL) methods, many complex robotic manipulation tasks are being solved. However, harnessing the full power of deep learning requires large datasets. Online-RL does not suit itself readily into this paradigm due to costly and time-taking agent environment interaction. Therefore recently, many offline-RL algorithms have been proposed to learn robotic tasks. But mainly, all such methods focus on a single task or multi-task learning, which requires retraining every time we need to learn a new task. Continuously learning tasks without forgetting previous knowledge combined with the power of offline deep-RL would allow us to scale the number of tasks by keep adding them one-after-another. In this paper, we investigate the effectiveness of regularisation-based methods like synaptic intelligence for sequentially learning image-based robotic manipulation tasks in an offline-RL setup. We evaluate the performance of this combined framework against common challenges of sequential learning: catastrophic forgetting and forward knowledge transfer. We performed experiments with different task combinations to analyze the effect of task ordering. We also investigated the effect of the number of object configurations and density of robot trajectories. We found that learning tasks sequentially helps in the propagation of knowledge from previous tasks, thereby reducing the time required to learn a new task. Regularisation based approaches for continuous learning like the synaptic intelligence method although helps in mitigating catastrophic forgetting but has shown only limited transfer of knowledge from previous tasks. △ Less

Submitted 31 January, 2023; originally announced January 2023.

Comments: 7 pages, 5 Figures

CHIME/FRB Discovery of 25 Repeating Fast Radio Burst Sources

Authors: The CHIME/FRB Collaboration, :, Bridget C. Andersen, Kevin Bandura, Mohit Bhardwaj, P. J. Boyle, Charanjot Brar, Tomas Cassanelli, S. Chatterjee, Pragya Chawla, Amanda M. Cook, Alice P. Curtin, Matt Dobbs, Fengqiu Adam Dong, Jakob T. Faber, Mateus Fandino, Emmanuel Fonseca, B. M. Gaensler, Utkarsh Giri, Antonio Herrera-Martin, Alex S. Hill, Adaeze Ibik, Alexander Josephy, Jane F. Kaczmarek, Zarif Kader , et al. (35 additional authors not shown)

Abstract: We present the discovery of 25 new repeating fast radio burst (FRB) sources found among CHIME/FRB events detected between 2019 September 30 and 2021 May 1. The sources were found using a new clustering algorithm that looks for multiple events co-located on the sky having similar dispersion measures (DMs). The new repeaters have DMs ranging from $\sim$220 pc cm$^{-3}$ to $\sim$1700 pc cm$^{-3}$, an… ▽ More We present the discovery of 25 new repeating fast radio burst (FRB) sources found among CHIME/FRB events detected between 2019 September 30 and 2021 May 1. The sources were found using a new clustering algorithm that looks for multiple events co-located on the sky having similar dispersion measures (DMs). The new repeaters have DMs ranging from $\sim$220 pc cm$^{-3}$ to $\sim$1700 pc cm$^{-3}$, and include sources having exhibited as few as two bursts to as many as twelve. We report a statistically significant difference in both the DM and extragalactic DM (eDM) distributions between repeating and apparently nonrepeating sources, with repeaters having lower mean DM and eDM, and we discuss the implications. We find no clear bimodality between the repetition rates of repeaters and upper limits on repetition from apparently nonrepeating sources after correcting for sensitivity and exposure effects, although some active repeating sources stand out as anomalous. We measure the repeater fraction over time and find that it tends to an equilibrium of $2.6_{-2.6}^{+2.9}$% over our total time-on-sky thus far. We also report on 14 more sources which are promising repeating FRB candidates and which merit follow-up observations for confirmation. △ Less

Submitted 15 March, 2023; v1 submitted 20 January, 2023; originally announced January 2023.

Comments: ApJ in press. Comments are still welcome and follow-up observations are encouraged!

Neural Feature-Adaptation for Symbolic Predictions Using Pre-Training and Semantic Loss

Authors: Vedant Shah, Aditya Agrawal, Lovekesh Vig, Ashwin Srinivasan, Gautam Shroff, Tanmay Verlekar

Abstract: We are interested in neurosymbolic systems consisting of a high-level symbolic layer for explainable prediction in terms of human-intelligible concepts; and a low-level neural layer for extracting symbols required to generate the symbolic explanation. Real data is often imperfect meaning that even if the symbolic theory remains unchanged, we may still need to address the problem of mapping raw dat… ▽ More We are interested in neurosymbolic systems consisting of a high-level symbolic layer for explainable prediction in terms of human-intelligible concepts; and a low-level neural layer for extracting symbols required to generate the symbolic explanation. Real data is often imperfect meaning that even if the symbolic theory remains unchanged, we may still need to address the problem of mapping raw data to high-level symbols, each time there is a change in the data acquisition environment or equipment. Manual (re-)annotation of the raw data each time this happens is laborious and expensive; and automated labelling methods are often imperfect, especially for complex problems. NEUROLOG proposed the use of a semantic loss function that allows an existing feature-based symbolic model to guide the extraction of feature-values from raw data, using `abduction'. However, the experiments demonstrating the use of semantic loss through abduction appear to rely heavily on a domain-specific pre-processing step that enables a prior delineation of feature locations in the raw data. We examine the use of semantic loss in domains where such pre-processing is not possible, or is not obvious. We show that without any prior information about the features, the NEUROLOG approach can continue to predict accurately even with substantially incorrect feature predictions. We show also that prior information about the features in the form of even imperfect pre-training can help correct this situation. These findings are replicated on the original problem considered by NEUROLOG, without the use of feature-delineation. This suggests that symbolic explanations constructed for data in a domain could be re-used in a related domain, by `feature-adaptation' of pre-trained neural extractors using the semantic loss function constrained by abductive feedback. △ Less

Submitted 29 November, 2022; originally announced November 2022.

Tight Bounds for Vertex Connectivity in Dynamic Streams

Authors: Sepehr Assadi, Vihan Shah

Abstract: We present a streaming algorithm for the vertex connectivity problem in dynamic streams with a (nearly) optimal space bound: for any $n$-vertex graph $G$ and any integer $k \geq 1$, our algorithm with high probability outputs whether or not $G$ is $k$-vertex-connected in a single pass using $\widetilde{O}(k n)$ space. Our upper bound matches the known $Ω(k n)$ lower bound for this problem even i… ▽ More We present a streaming algorithm for the vertex connectivity problem in dynamic streams with a (nearly) optimal space bound: for any $n$-vertex graph $G$ and any integer $k \geq 1$, our algorithm with high probability outputs whether or not $G$ is $k$-vertex-connected in a single pass using $\widetilde{O}(k n)$ space. Our upper bound matches the known $Ω(k n)$ lower bound for this problem even in insertion-only streams -- which we extend to multi-pass algorithms in this paper -- and closes one of the last remaining gaps in our understanding of dynamic versus insertion-only streams. Our result is obtained via a novel analysis of the previous best dynamic streaming algorithm of Guha, McGregor, and Tench [PODS 2015] who obtained an $\widetilde{O}(k^2 n)$ space algorithm for this problem. This also gives a model-independent algorithm for computing a "certificate" of $k$-vertex-connectivity as a union of $O(k^2\log{n})$ spanning forests, each on a random subset of $O(n/k)$ vertices, which may be of independent interest. △ Less

Submitted 9 November, 2022; originally announced November 2022.

Comments: Full version of the paper accepted to SOSA 2023. 15 pages, 3 Figures

AI Testing Framework for Next-G O-RAN Networks: Requirements, Design, and Research Opportunities

Authors: Bo Tang, Vijay K. Shah, Vuk Marojevic, Jeffrey H. Reed

Abstract: Openness and intelligence are two enabling features to be introduced in next generation wireless networks, e.g. Beyond 5G and 6G, to support service heterogeneity, open hardware, optimal resource utilization, and on-demand service deployment. The open radio access network (O-RAN) is a promising RAN architecture to achieve both openness and intelligence through virtualized network elements and well… ▽ More Openness and intelligence are two enabling features to be introduced in next generation wireless networks, e.g. Beyond 5G and 6G, to support service heterogeneity, open hardware, optimal resource utilization, and on-demand service deployment. The open radio access network (O-RAN) is a promising RAN architecture to achieve both openness and intelligence through virtualized network elements and well-defined interfaces. While deploying artificial intelligence (AI) models is becoming easier in O-RAN, one significant challenge that has been long neglected is the comprehensive testing of their performance in realistic environments. This article presents a general automated, distributed and AI-enabled testing framework to test AI models deployed in O-RAN in terms of their decision-making performance, vulnerability and security. This framework adopts a master-actor architecture to manage a number of end devices for distributed testing. More importantly, it leverages AI to automatically and intelligently explore the decision space of AI models in O-RAN. Both software simulation testing and software-defined radio hardware testing are supported, enabling rapid proof of concept research and experimental research on wireless research platforms. △ Less

Submitted 7 November, 2022; originally announced November 2022.

Comments: To be published in IEEE Wireless Communications Magazine