Showing 1–50 of 98 results for author: Shukla, N

Facial Demorphing via Identity Preserving Image Decomposition

Authors: Nitish Shukla, Arun Ross

Abstract: A face morph is created by combining the face images usually pertaining to two distinct identities. The goal is to generate an image that can be matched with two identities thereby undermining the security of a face recognition system. To deal with this problem, several morph attack detection techniques have been developed. But these methods do not extract any information about the underlying bona… ▽ More A face morph is created by combining the face images usually pertaining to two distinct identities. The goal is to generate an image that can be matched with two identities thereby undermining the security of a face recognition system. To deal with this problem, several morph attack detection techniques have been developed. But these methods do not extract any information about the underlying bonafides used to create them. Demorphing addresses this limitation. However, current demorphing techniques are mostly reference-based, i.e, they need an image of one of the identities to recover the other. In this work, we treat demorphing as an ill-posed decomposition problem. We propose a novel method that is reference-free and recovers the bonafides with high accuracy. Our method decomposes the morph into several identity-preserving feature components. A merger network then weighs and combines these components to recover the bonafides. Our method is observed to reconstruct high-quality bonafides in terms of definition and fidelity. Experiments on the CASIA-WebFace, SMDD and AMSL datasets demonstrate the effectiveness of our method. △ Less

Submitted 20 August, 2024; originally announced August 2024.

Time series forecasting with high stakes: A field study of the air cargo industry

Authors: Abhinav Garg, Naman Shukla, Maarten Wormer

Abstract: Time series forecasting in the air cargo industry presents unique challenges due to volatile market dynamics and the significant impact of accurate forecasts on generated revenue. This paper explores a comprehensive approach to demand forecasting at the origin-destination (O\&D) level, focusing on the development and implementation of machine learning models in decision-making for the air cargo in… ▽ More Time series forecasting in the air cargo industry presents unique challenges due to volatile market dynamics and the significant impact of accurate forecasts on generated revenue. This paper explores a comprehensive approach to demand forecasting at the origin-destination (O\&D) level, focusing on the development and implementation of machine learning models in decision-making for the air cargo industry. We leverage a mixture of experts framework, combining statistical and advanced deep learning models to provide reliable forecasts for cargo demand over a six-month horizon. The results demonstrate that our approach outperforms industry benchmarks, offering actionable insights for cargo capacity allocation and strategic decision-making in the air cargo industry. While this work is applied in the airline industry, the methodology is broadly applicable to any field where forecast-based decision-making in a volatile environment is crucial. △ Less

Submitted 13 August, 2024; v1 submitted 29 July, 2024; originally announced July 2024.

Comments: The 10th Mining and Learning from Time Series Workshop: From Classical Methods to LLMs. SIGKDD, Barcelona, Spain, 6 page

Minimum uncertainty states and squeezed states from sum uncertainty relation

Authors: Yatindra Kumar, Yashraj Jha, Namrata Shukla

Abstract: Heisenberg uncertainty relation is at the origin of understanding minimum uncertainty states and squeezed states of light. In the recent past, sum uncertainty relation was formulated by Maccone and Pati [Phys. Rev. Lett. 113, 260401 (2014)] which is claimed to be stronger than the existing Heisenberg-Robertson product uncertainty relation for the set of two incompatible observables. We deduce a di… ▽ More Heisenberg uncertainty relation is at the origin of understanding minimum uncertainty states and squeezed states of light. In the recent past, sum uncertainty relation was formulated by Maccone and Pati [Phys. Rev. Lett. 113, 260401 (2014)] which is claimed to be stronger than the existing Heisenberg-Robertson product uncertainty relation for the set of two incompatible observables. We deduce a different sum uncertainty relation that is weaker than the previous but necessary and sufficient to define MUS for sum uncertainty relations. We claim that the MUS for the sum uncertainty relation is always the MUS for the traditional product uncertainty relation. This means that the definition of squeezed states remains completely unaffected by the stronger sum uncertainty relation. △ Less

Submitted 23 July, 2024; originally announced July 2024.

Comments: 4 pages, 2 figures

Enhancement in Photoluminescence of Pt/Ag-Pt Embedded ZrO2 Thin Films by Plasma Co-sputtering

Authors: Shailendra Kumar Mishra, Ibnul Farid, Aritra Tarafder, Joyanti Chutia, Subir Biswas, Arup Ratan Pal, Neeraj Shukla

Abstract: Platinum, Silver-Platinum embedded Zirconia (Pt/Ag-Pt ZrO2) thin films have been fabricated on silicon wafers and glass substrates using the plasma co-sputtering method. Zirconia thin films are of significant technological importance due to their remarkable electrical, optical, and mechanical properties, as well as their high melting temperature of 2715°C, which makes them increasingly attractive… ▽ More Platinum, Silver-Platinum embedded Zirconia (Pt/Ag-Pt ZrO2) thin films have been fabricated on silicon wafers and glass substrates using the plasma co-sputtering method. Zirconia thin films are of significant technological importance due to their remarkable electrical, optical, and mechanical properties, as well as their high melting temperature of 2715°C, which makes them increasingly attractive for various applications. In this study, ZrO2 thin films were deposited for 3 minutes, followed by the deposition of Pt-Ag/Pt onto the fabricated zirconia thin films, with deposition times ranging from 15 to 60 seconds. The varying deposition times of Pt-Ag/Pt influenced the optical and electronic properties of the thin films due to alterations in their surface roughness. The characteristics of the grown zirconia and Pt/Ag-Pt sputtered zirconia nanostructures were investigated using Atomic Force Microscopy (AFM), Scanning Electron Microscopy (SEM), X-ray Diffraction (XRD), UV-visible spectroscopy, and Photoluminescence spectroscopy. The optical transmittance of these thin films was examined across the visible and near-infrared spectral ranges. The investigation revealed various properties, such as enhanced photoluminescence and the emergence of new peaks in the visible range spectra. Plasmonic peaks were induced, and an increase in the sharpness of these peaks was observed between 403.15 nm and 512.10 nm for the Pt/Ag-Pt deposited samples. This enhancement in photoluminescence is attributed to the plasmonic properties of Pt-Ag nanoparticles on the zirconia thin film. The study demonstrates that these optically tuned thin film coatings, with their enhanced photoluminescence properties, can significantly improve the heat-resistance capacity of devices, mitigating issues related to overheating and device shutdown. △ Less

Submitted 29 June, 2024; originally announced July 2024.

Comments: 8 figures, 1 table

Anisotropic potential immersed in a dipolar Bose-Einstein condensate

Authors: Neelam Shukla, Artem G. Volosniev, Jeremy R. Armstrong

Abstract: We study a modified three-dimensional Gross-Pitaevski equation that describes a static impurity in a dipolar Bose-Einstein condensate (BEC). Our focus is on the interplay between the shape of the impurity and the anisotropy of the medium manifested in the energy and the density of the system. Without external confinement, properties of the system are derived with basic analytical approaches. For a… ▽ More We study a modified three-dimensional Gross-Pitaevski equation that describes a static impurity in a dipolar Bose-Einstein condensate (BEC). Our focus is on the interplay between the shape of the impurity and the anisotropy of the medium manifested in the energy and the density of the system. Without external confinement, properties of the system are derived with basic analytical approaches. For a system in a harmonic trap, the model is investigated numerically, using the split-step Crank-Nicolson method. Our results demonstrate that the impurity would prefer to change its shape to accommodate the anisotropic character of the bath, in particular it would prefer to align itself with the direction of the dipoles. Our work complements studies of impurities in Bose gases with zero-range interactions, and paves the way for studies of dipolar polarons with a modified Gross-Pitaevski equation. △ Less

Submitted 31 May, 2024; originally announced June 2024.

Learning to Localize Objects Improves Spatial Reasoning in Visual-LLMs

Authors: Kanchana Ranasinghe, Satya Narayan Shukla, Omid Poursaeed, Michael S. Ryoo, Tsung-Yu Lin

Abstract: Integration of Large Language Models (LLMs) into visual domain tasks, resulting in visual-LLMs (V-LLMs), has enabled exceptional performance in vision-language tasks, particularly for visual question answering (VQA). However, existing V-LLMs (e.g. BLIP-2, LLaVA) demonstrate weak spatial reasoning and localization awareness. Despite generating highly descriptive and elaborate textual answers, these… ▽ More Integration of Large Language Models (LLMs) into visual domain tasks, resulting in visual-LLMs (V-LLMs), has enabled exceptional performance in vision-language tasks, particularly for visual question answering (VQA). However, existing V-LLMs (e.g. BLIP-2, LLaVA) demonstrate weak spatial reasoning and localization awareness. Despite generating highly descriptive and elaborate textual answers, these models fail at simple tasks like distinguishing a left vs right location. In this work, we explore how image-space coordinate based instruction fine-tuning objectives could inject spatial awareness into V-LLMs. We discover optimal coordinate representations, data-efficient instruction fine-tuning objectives, and pseudo-data generation strategies that lead to improved spatial awareness in V-LLMs. Additionally, our resulting model improves VQA across image and video domains, reduces undesired hallucination, and generates better contextual object descriptions. Experiments across 5 vision-language tasks involving 14 different datasets establish the clear performance improvements achieved by our proposed framework. △ Less

Submitted 10 April, 2024; originally announced April 2024.

Designing a K-state P-bit Engine

Authors: Mohammad Khairul Bashar, Abir Hasan, Nikhil Shukla

Abstract: Probabilistic bit (p-bit)-based compute engines utilize the unique capability of a p-bit to probabilistically switch between two states to solve computationally challenging problems. However, when solving problems that require more than two states (e.g., problems such as Max-3-Cut, verifying if a graph is K-partite (K>2) etc.), additional pre-processing steps such as graph reduction are required t… ▽ More Probabilistic bit (p-bit)-based compute engines utilize the unique capability of a p-bit to probabilistically switch between two states to solve computationally challenging problems. However, when solving problems that require more than two states (e.g., problems such as Max-3-Cut, verifying if a graph is K-partite (K>2) etc.), additional pre-processing steps such as graph reduction are required to make the problem compatible with a two-state p-bit platform. Moreover, this not only increases the problem size by entailing the use of auxiliary variables but can also degrade the solution quality. In this work, we develop a unique framework for implementing a K-state (K>2) p-bit engine. Furthermore, from an implementation standpoint, we show that such a K-state p-bit engine can be implemented using N traditional (2-state) p-bits, and one multi-state p-bit -- a novel concept proposed here. Augmenting traditional p-bit platforms, our approach enables us to solve an archetypal combinatoric problem class requiring multiple states, namely Max-K-Cut (K=3, 4 shown here), without using any additional auxiliary variables. Thus, our work fundamentally advances the functional capability of p-bit engines, enabling them to solve a broader class of computationally challenging problems more efficiently. △ Less

Submitted 27 March, 2024; v1 submitted 11 March, 2024; originally announced March 2024.

Universal Pyramid Adversarial Training for Improved ViT Performance

Authors: Ping-yeh Chiang, Yipin Zhou, Omid Poursaeed, Satya Narayan Shukla, Ashish Shah, Tom Goldstein, Ser-Nam Lim

Abstract: Recently, Pyramid Adversarial training (Herrmann et al., 2022) has been shown to be very effective for improving clean accuracy and distribution-shift robustness of vision transformers. However, due to the iterative nature of adversarial training, the technique is up to 7 times more expensive than standard training. To make the method more efficient, we propose Universal Pyramid Adversarial traini… ▽ More Recently, Pyramid Adversarial training (Herrmann et al., 2022) has been shown to be very effective for improving clean accuracy and distribution-shift robustness of vision transformers. However, due to the iterative nature of adversarial training, the technique is up to 7 times more expensive than standard training. To make the method more efficient, we propose Universal Pyramid Adversarial training, where we learn a single pyramid adversarial pattern shared across the whole dataset instead of the sample-wise patterns. With our proposed technique, we decrease the computational cost of Pyramid Adversarial training by up to 70% while retaining the majority of its benefit on clean performance and distribution-shift robustness. In addition, to the best of our knowledge, we are also the first to find that universal adversarial training can be leveraged to improve clean model performance. △ Less

Submitted 26 December, 2023; originally announced December 2023.

CMOS-based Single-Cycle In-Memory XOR/XNOR

Authors: Shamiul Alam, Jack Hutchins, Nikhil Shukla, Kazi Asifuzzaman, Ahmedullah Aziz

Abstract: Big data applications are on the rise, and so is the number of data centers. The ever-increasing massive data pool needs to be periodically backed up in a secure environment. Moreover, a massive amount of securely backed-up data is required for training binary convolutional neural networks for image classification. XOR and XNOR operations are essential for large-scale data copy verification, encry… ▽ More Big data applications are on the rise, and so is the number of data centers. The ever-increasing massive data pool needs to be periodically backed up in a secure environment. Moreover, a massive amount of securely backed-up data is required for training binary convolutional neural networks for image classification. XOR and XNOR operations are essential for large-scale data copy verification, encryption, and classification algorithms. The disproportionate speed of existing compute and memory units makes the von Neumann architecture inefficient to perform these Boolean operations. Compute-in-memory (CiM) has proved to be an optimum approach for such bulk computations. The existing CiM-based XOR/XNOR techniques either require multiple cycles for computing or add to the complexity of the fabrication process. Here, we propose a CMOS-based hardware topology for single-cycle in-memory XOR/XNOR operations. Our design provides at least 2 times improvement in the latency compared with other existing CMOS-compatible solutions. We verify the proposed system through circuit/system-level simulations and evaluate its robustness using a 5000-point Monte Carlo variation analysis. This all-CMOS design paves the way for practical implementation of CiM XOR/XNOR at scaled technology nodes. △ Less

Submitted 26 October, 2023; originally announced October 2023.

Comments: 12 pages, 6 figures, 1 table

A Note on Analyzing the Stability of Oscillator Ising Machines

Authors: Mohammad Khairul Bashar, Zongli Lin, Nikhil Shukla

Abstract: The rich non-linear dynamics of the coupled oscillators (under second harmonic injection) can be leveraged to solve computationally hard problems in combinatorial optimization such as finding the ground state of the Ising Hamiltonian. While prior work on the stability of the so-called Oscillator Ising Machines (OIMs) has used the linearization method, in this letter, we present a complementary met… ▽ More The rich non-linear dynamics of the coupled oscillators (under second harmonic injection) can be leveraged to solve computationally hard problems in combinatorial optimization such as finding the ground state of the Ising Hamiltonian. While prior work on the stability of the so-called Oscillator Ising Machines (OIMs) has used the linearization method, in this letter, we present a complementary method to analyze stability using the second order derivative test of the energy / cost function. We establish the equivalence between the two methods, thus augmenting the tool kit for the design and implementation of OIMs. △ Less

Submitted 13 October, 2023; originally announced October 2023.

Revisiting Kernel Temporal Segmentation as an Adaptive Tokenizer for Long-form Video Understanding

Authors: Mohamed Afham, Satya Narayan Shukla, Omid Poursaeed, Pengchuan Zhang, Ashish Shah, Sernam Lim

Abstract: While most modern video understanding models operate on short-range clips, real-world videos are often several minutes long with semantically consistent segments of variable length. A common approach to process long videos is applying a short-form video model over uniformly sampled clips of fixed temporal length and aggregating the outputs. This approach neglects the underlying nature of long vide… ▽ More While most modern video understanding models operate on short-range clips, real-world videos are often several minutes long with semantically consistent segments of variable length. A common approach to process long videos is applying a short-form video model over uniformly sampled clips of fixed temporal length and aggregating the outputs. This approach neglects the underlying nature of long videos since fixed-length clips are often redundant or uninformative. In this paper, we aim to provide a generic and adaptive sampling approach for long-form videos in lieu of the de facto uniform sampling. Viewing videos as semantically consistent segments, we formulate a task-agnostic, unsupervised, and scalable approach based on Kernel Temporal Segmentation (KTS) for sampling and tokenizing long videos. We evaluate our method on long-form video understanding tasks such as video classification and temporal action localization, showing consistent gains over existing approaches and achieving state-of-the-art performance on long-form video modeling. △ Less

Submitted 20 September, 2023; originally announced September 2023.

Subspace Dual and orthogonal frames\\ by action of an abelian group

Authors: Sudipta Sarka, Niraj K. Shukla

Abstract: In this article, we discuss subspace duals of a frame of translates by an action of a closed abelian subgroup $Γ$ of a locally compact group $\mathscr G.$ These subspace duals are not required to lie in the space generated by the frame. We characterise translation-generated subspace duals of a frame/Riesz basis involving the Zak transform for the pair $(\mathscr G, Γ) .$ We continue our discussion… ▽ More In this article, we discuss subspace duals of a frame of translates by an action of a closed abelian subgroup $Γ$ of a locally compact group $\mathscr G.$ These subspace duals are not required to lie in the space generated by the frame. We characterise translation-generated subspace duals of a frame/Riesz basis involving the Zak transform for the pair $(\mathscr G, Γ) .$ We continue our discussion on the orthogonality of two translation-generated Bessel pairs using the Zak transform, which allows us to explore the dual of super-frames. As an example, we extend our findings to splines, Gabor systems, $p$-adic fields $\mathbb Q p,$ locally compact abelian groups using the fiberization map. △ Less

Submitted 16 September, 2023; originally announced September 2023.

Comments: 21 pages

MSC Class: 42C15; 42C40; 43A32; 46C05; 47A15;

The Belebele Benchmark: a Parallel Reading Comprehension Dataset in 122 Language Variants

Authors: Lucas Bandarkar, Davis Liang, Benjamin Muller, Mikel Artetxe, Satya Narayan Shukla, Donald Husa, Naman Goyal, Abhinandan Krishnan, Luke Zettlemoyer, Madian Khabsa

Abstract: We present Belebele, a multiple-choice machine reading comprehension (MRC) dataset spanning 122 language variants. Significantly expanding the language coverage of natural language understanding (NLU) benchmarks, this dataset enables the evaluation of text models in high-, medium-, and low-resource languages. Each question is based on a short passage from the Flores-200 dataset and has four multip… ▽ More We present Belebele, a multiple-choice machine reading comprehension (MRC) dataset spanning 122 language variants. Significantly expanding the language coverage of natural language understanding (NLU) benchmarks, this dataset enables the evaluation of text models in high-, medium-, and low-resource languages. Each question is based on a short passage from the Flores-200 dataset and has four multiple-choice answers. The questions were carefully curated to discriminate between models with different levels of general language comprehension. The English dataset on its own proves difficult enough to challenge state-of-the-art language models. Being fully parallel, this dataset enables direct comparison of model performance across all languages. We use this dataset to evaluate the capabilities of multilingual masked language models (MLMs) and large language models (LLMs). We present extensive results and find that despite significant cross-lingual transfer in English-centric LLMs, much smaller MLMs pretrained on balanced multilingual data still understand far more languages. We also observe that larger vocabulary size and conscious vocabulary construction correlate with better performance on low-resource languages. Overall, Belebele opens up new avenues for evaluating and analyzing the multilingual capabilities of NLP systems. △ Less

Submitted 25 July, 2024; v1 submitted 31 August, 2023; originally announced August 2023.

Comments: ACL 2024

ACM Class: I.2.7

SDeMorph: Towards Better Facial De-morphing from Single Morph

Authors: Nitish Shukla

Abstract: Face Recognition Systems (FRS) are vulnerable to morph attacks. A face morph is created by combining multiple identities with the intention to fool FRS and making it match the morph with multiple identities. Current Morph Attack Detection (MAD) can detect the morph but are unable to recover the identities used to create the morph with satisfactory outcomes. Existing work in de-morphing is mostly r… ▽ More Face Recognition Systems (FRS) are vulnerable to morph attacks. A face morph is created by combining multiple identities with the intention to fool FRS and making it match the morph with multiple identities. Current Morph Attack Detection (MAD) can detect the morph but are unable to recover the identities used to create the morph with satisfactory outcomes. Existing work in de-morphing is mostly reference-based, i.e. they require the availability of one identity to recover the other. Sudipta et al. \cite{ref9} proposed a reference-free de-morphing technique but the visual realism of outputs produced were feeble. In this work, we propose SDeMorph (Stably Diffused De-morpher), a novel de-morphing method that is reference-free and recovers the identities of bona fides. Our method produces feature-rich outputs that are of significantly high quality in terms of definition and facial fidelity. Our method utilizes Denoising Diffusion Probabilistic Models (DDPM) by destroying the input morphed signal and then reconstructing it back using a branched-UNet. Experiments on ASML, FRLL-FaceMorph, FRLL-MorDIFF, and SMDD datasets support the effectiveness of the proposed method. △ Less

Submitted 22 August, 2023; originally announced August 2023.

MOPO-LSI: A User Guide

Authors: Yong Zheng, Kumar Neelotpal Shukla, Jasmine Xu, David, Wang, Michael O'Leary

Abstract: MOPO-LSI is an open-source Multi-Objective Portfolio Optimization Library for Sustainable Investments. This document provides a user guide for MOPO-LSI version 1.0, including problem setup, workflow and the hyper-parameters in configurations. MOPO-LSI is an open-source Multi-Objective Portfolio Optimization Library for Sustainable Investments. This document provides a user guide for MOPO-LSI version 1.0, including problem setup, workflow and the hyper-parameters in configurations. △ Less

Submitted 12 July, 2023; v1 submitted 4 July, 2023; originally announced July 2023.

Generating Adversarial Attacks in the Latent Space

Authors: Nitish Shukla, Sudipta Banerjee

Abstract: Adversarial attacks in the input (pixel) space typically incorporate noise margins such as $L_1$ or $L_{\infty}$-norm to produce imperceptibly perturbed data that confound deep learning networks. Such noise margins confine the magnitude of permissible noise. In this work, we propose injecting adversarial perturbations in the latent (feature) space using a generative adversarial network, removing t… ▽ More Adversarial attacks in the input (pixel) space typically incorporate noise margins such as $L_1$ or $L_{\infty}$-norm to produce imperceptibly perturbed data that confound deep learning networks. Such noise margins confine the magnitude of permissible noise. In this work, we propose injecting adversarial perturbations in the latent (feature) space using a generative adversarial network, removing the need for margin-based priors. Experiments on MNIST, CIFAR10, Fashion-MNIST, CIFAR100 and Stanford Dogs datasets support the effectiveness of the proposed method in generating adversarial attacks in the latent space while ensuring a high degree of visual realism with respect to pixel-based adversarial attack methods. △ Less

Submitted 10 April, 2023; originally announced April 2023.

Mixed-Type Wafer Classification For Low Memory Devices Using Knowledge Distillation

Authors: Nitish Shukla, Anurima Dey, Srivatsan K

Abstract: Manufacturing wafers is an intricate task involving thousands of steps. Defect Pattern Recognition (DPR) of wafer maps is crucial for determining the root cause of production defects, which may further provide insight for yield improvement in wafer foundry. During manufacturing, various defects may appear standalone in the wafer or may appear as different combinations. Identifying multiple defects… ▽ More Manufacturing wafers is an intricate task involving thousands of steps. Defect Pattern Recognition (DPR) of wafer maps is crucial for determining the root cause of production defects, which may further provide insight for yield improvement in wafer foundry. During manufacturing, various defects may appear standalone in the wafer or may appear as different combinations. Identifying multiple defects in a wafer is generally harder compared to identifying a single defect. Recently, deep learning methods have gained significant traction in mixed-type DPR. However, the complexity of defects requires complex and large models making them very difficult to operate on low-memory embedded devices typically used in fabrication labs. Another common issue is the unavailability of labeled data to train complex networks. In this work, we propose an unsupervised training routine to distill the knowledge of complex pre-trained models to lightweight deployment-ready models. We empirically show that this type of training compresses the model without sacrificing accuracy despite being up to 10 times smaller than the teacher model. The compressed model also manages to outperform contemporary state-of-the-art models. △ Less

Submitted 18 October, 2023; v1 submitted 24 March, 2023; originally announced March 2023.

Comments: Study is not relevant

Efficient Mixed-Type Wafer Defect Pattern Recognition Using Compact Deformable Convolutional Transformers

Authors: Nitish Shukla

Abstract: Manufacturing wafers is an intricate task involving thousands of steps. Defect Pattern Recognition (DPR) of wafer maps is crucial to find the root cause of the issue and further improving the yield in the wafer foundry. Mixed-type DPR is much more complicated compared to single-type DPR due to varied spatial features, the uncertainty of defects, and the number of defects present. To accurately pre… ▽ More Manufacturing wafers is an intricate task involving thousands of steps. Defect Pattern Recognition (DPR) of wafer maps is crucial to find the root cause of the issue and further improving the yield in the wafer foundry. Mixed-type DPR is much more complicated compared to single-type DPR due to varied spatial features, the uncertainty of defects, and the number of defects present. To accurately predict the number of defects as well as the types of defects, we propose a novel compact deformable convolutional transformer (DC Transformer). Specifically, DC Transformer focuses on the global features present in the wafer map by virtue of learnable deformable kernels and multi-head attention to the global features. The proposed method succinctly models the internal relationship between the wafer maps and the defects. DC Transformer is evaluated on a real dataset containing 38 defect patterns. Experimental results show that DC Transformer performs exceptionally well in recognizing both single and mixed-type defects. The proposed method outperforms the current state of the models by a considerable margin △ Less

Submitted 16 October, 2023; v1 submitted 24 March, 2023; originally announced March 2023.

Comments: Study is not relevant

An Embarrassingly Simple Approach for Wafer Feature Extraction and Defect Pattern Recognition

Authors: Nitish Shukla

Abstract: Identifying defect patterns in a wafer map during manufacturing is crucial to find the root cause of the underlying issue and provides valuable insights on improving yield in the foundry. Currently used methods use deep neural networks to identify the defects. These methods are generally very huge and have significant inference time. They also require GPU support to efficiently operate. All these… ▽ More Identifying defect patterns in a wafer map during manufacturing is crucial to find the root cause of the underlying issue and provides valuable insights on improving yield in the foundry. Currently used methods use deep neural networks to identify the defects. These methods are generally very huge and have significant inference time. They also require GPU support to efficiently operate. All these issues make these models not fit for on-line prediction in the manufacturing foundry. In this paper, we propose an extremely simple yet effective technique to extract features from wafer images. The proposed method is extremely fast, intuitive, and non-parametric while being explainable. The experiment results show that the proposed pipeline outperforms conventional deep learning models. Our feature extraction requires no training or fine-tuning while preserving the relative shape and location of data points as revealed by our interpretability analysis. △ Less

Submitted 16 October, 2023; v1 submitted 21 March, 2023; originally announced March 2023.

Comments: study is not relevant

Stability of Oscillator Ising Machines: Not All Solutions Are Created Equal

Authors: Mohammad Khairul Bashar, Zongli Lin, Nikhil Shukla

Abstract: Nonlinear dynamical systems such as coupled oscillators are being actively investigated as Ising machines for solving computationally hard problems in combinatorial optimization. Prior works have established the equivalence between the global minima of the Lyapunov function (commonly referred to as the energy function) describing the coupled oscillator system and the ground state of the Ising Hami… ▽ More Nonlinear dynamical systems such as coupled oscillators are being actively investigated as Ising machines for solving computationally hard problems in combinatorial optimization. Prior works have established the equivalence between the global minima of the Lyapunov function (commonly referred to as the energy function) describing the coupled oscillator system and the ground state of the Ising Hamiltonian. However, the properties of the oscillator Ising machine (OIM) from a nonlinear control viewpoint, such as the stability of the OIM solutions remains unexplored. Therefore, in this work, using nonlinear control-theoretic analysis, we (i) Identify the conditions required to ensure the functionality of the coupled oscillators as an Ising machine; (ii) Show that all globally optimal phase configurations may not always be stable, resulting in some configurations being more favored over others, and thus, creating a biased OIM; (c) Elucidate the impact of the stability of locally optimal phase configurations on the quality of the solution computed by the system. Our work, fostered through the unique convergence between nonlinear control theory and analog systems for computing, provides a new toolbox for the design and implementation of dynamical system-based computing platforms. △ Less

Submitted 18 January, 2023; originally announced January 2023.

A characterization of MG Dual frames using infimum cosine angle

Authors: Sudipta Sarkar, Niraj K. Shukla

Abstract: This article discusses the construction of dual frames and their uniqueness for the multiplication generated frames on $L^2(X; \mathcal H)$, where $X$ is a $σ$-finite measure. A necessary and sufficient condition of such duals associated to infimum cosine angle is obtained. The result is illustrated for the translation-generated systems on a locally compact group (not necessarily abelian ) by acti… ▽ More This article discusses the construction of dual frames and their uniqueness for the multiplication generated frames on $L^2(X; \mathcal H)$, where $X$ is a $σ$-finite measure. A necessary and sufficient condition of such duals associated to infimum cosine angle is obtained. The result is illustrated for the translation-generated systems on a locally compact group (not necessarily abelian ) by action of its abelian subgroup. △ Less

Submitted 18 January, 2023; originally announced January 2023.

Comments: 12 pages

MSC Class: 42C40; 42C15

Reproducing formulas associated to translation generated systems on Nilpotent Lie Groups

Authors: Sudipta Sarkar, Niraj K. Shukla

Abstract: Let $G$ be a connected, simply connected, nilpotent Lie group whose irreducible unitary representations are square-integrable modulo the center. We obtain characterization results for reproducing formulas associated with the left translation generated systems in $ L^2(G)$. Unlike the previous study of discrete frames on the nilpotent Lie groups, the current research occurs within the set up of con… ▽ More Let $G$ be a connected, simply connected, nilpotent Lie group whose irreducible unitary representations are square-integrable modulo the center. We obtain characterization results for reproducing formulas associated with the left translation generated systems in $ L^2(G)$. Unlike the previous study of discrete frames on the nilpotent Lie groups, the current research occurs within the set up of continuous frames, which means the resulting reproducing formulas are given in terms of integral representations instead of discrete sums. As a consequence of our results for the Heisenberg group, a reproducing formula associated with the orthonormal Gabor systems of $L^2(\mathbb R^d)$ is obtained. △ Less

Submitted 8 January, 2023; originally announced January 2023.

Comments: 12 pages

MSC Class: 22E25; 22E30; 43A60; 43A80

An Application of the supremum cosine angle between multiplication invariant spaces in $L^2(X; \mc H)$

Authors: Sudipta Sarkar, Sahil Kalra, Niraj K. Shukla

Abstract: In this article, we describe the supremum cosine angle between two multiplication invariant (MI) spaces and its connection with the closedness of the sum of those spaces. The results obtained for MI spaces are preserved by the corresponding fiber spaces almost everywhere. Employing the Zak transform, we obtain the results for translation invariant spaces on locally compact groups by action of its… ▽ More In this article, we describe the supremum cosine angle between two multiplication invariant (MI) spaces and its connection with the closedness of the sum of those spaces. The results obtained for MI spaces are preserved by the corresponding fiber spaces almost everywhere. Employing the Zak transform, we obtain the results for translation invariant spaces on locally compact groups by action of its closed abelian subgroup. Additionally, we provide the application of our results to sampling theory. △ Less

Submitted 28 November, 2022; originally announced November 2022.

MSC Class: 42C40; 47A15; 43A32; 43A65; 94A20

Surface plasmon resonance biosensors based on Kretschmann configuration: basic instrumentation and applications

Authors: Nishant Shukla, Pawan Chetri, Ratan Boruah, Ankur Gogoi, Gazi A Ahmed

Abstract: Surface Plasmon Resonance (SPR) offers a powerful tool for label-free and non-invasive characterization of biomolecular interactions. To date, several experimental configurations, based on two fundamental physical phenomena, e.g., attenuated total reflection and diffraction, have been developed to measure the SPR signal generated due to the resonant interactions between incident light and plasma w… ▽ More Surface Plasmon Resonance (SPR) offers a powerful tool for label-free and non-invasive characterization of biomolecular interactions. To date, several experimental configurations, based on two fundamental physical phenomena, e.g., attenuated total reflection and diffraction, have been developed to measure the SPR signal generated due to the resonant interactions between incident light and plasma waves on the metal surface. These configurations are divided into three categories: grating-based, prism-based, and waveguide-based coupling. Among such techniques, one of the prism-based SPR coupling schemes, popularly known as Kretschmann configuration, is most widely used due to its high sensitivity, operational simplicity, lower cost, and real-time detection. This chapter explains the basic instrumentation and reviews the recent trends in the development of Kretschmann configuration-based SPR biosensors with its applications. △ Less

Submitted 12 November, 2022; originally announced November 2022.

Constructing Dynamical Systems to Model Higher Order Ising Spin Interactions and their Application in Solving Combinatorial Optimization Problems

Authors: Mohammad Khairul Bashar, Nikhil Shukla

Abstract: The Ising model provides a natural mapping for many computationally hard combinatorial optimization problems (COPs). Consequently, dynamical system-inspired computing models and hardware platforms that minimize the Ising Hamiltonian, have recently been proposed as a potential candidate for solving COPs, with the promise of significant performance benefit. However, the Ising model, and consequently… ▽ More The Ising model provides a natural mapping for many computationally hard combinatorial optimization problems (COPs). Consequently, dynamical system-inspired computing models and hardware platforms that minimize the Ising Hamiltonian, have recently been proposed as a potential candidate for solving COPs, with the promise of significant performance benefit. However, the Ising model, and consequently, the corresponding dynamical system-based computational models primarily consider quadratic interactions among the nodes. Computational models considering higher order interactions among Ising spins remain largely unexplored. Therefore, in this work, we propose dynamical-system-based computational models to consider higher order (>2) interactions among the Ising spins, which subsequently, enables us to propose computational models to directly solve many COPs that entail such higher order interactions (COPs on hypergraphs). Specifically, we demonstrate our approach by developing dynamical systems to compute the solution for the Boolean NAE-K-SAT (K is greater than 3) problem as well as solve the Max-K-Cut of a hypergraph. Our work advances the potential of the physics-inspired 'toolbox' for solving COPs. △ Less

Submitted 10 November, 2022; originally announced November 2022.

DoSA : A System to Accelerate Annotations on Business Documents with Human-in-the-Loop

Authors: Neelesh K Shukla, Msp Raja, Raghu Katikeri, Amit Vaid

Abstract: Business documents come in a variety of structures, formats and information needs which makes information extraction a challenging task. Due to these variations, having a document generic model which can work well across all types of documents and for all the use cases seems far-fetched. For document-specific models, we would need customized document-specific labels. We introduce DoSA (Document Sp… ▽ More Business documents come in a variety of structures, formats and information needs which makes information extraction a challenging task. Due to these variations, having a document generic model which can work well across all types of documents and for all the use cases seems far-fetched. For document-specific models, we would need customized document-specific labels. We introduce DoSA (Document Specific Automated Annotations), which helps annotators in generating initial annotations automatically using our novel bootstrap approach by leveraging document generic datasets and models. These initial annotations can further be reviewed by a human for correctness. An initial document-specific model can be trained and its inference can be used as feedback for generating more automated annotations. These automated annotations can be reviewed by human-in-the-loop for the correctness and a new improved model can be trained using the current model as pre-trained model before going for the next iteration. In this paper, our scope is limited to Form like documents due to limited availability of generic annotated datasets, but this idea can be extended to a variety of other documents as more datasets are built. An open-source ready-to-use implementation is made available on GitHub https://github.com/neeleshkshukla/DoSA. △ Less

Submitted 9 November, 2022; originally announced November 2022.

Comments: Accepted at DaSH@EMNLP2022, 5 pages, 4 figures

Formulating Oscillator-Inspired Dynamical Systems to Solve Boolean Satisfiability

Authors: Mohammad Khairul Bashar, Zongli Lin, Nikhil Shukla

Abstract: Dynamical systems can offer a novel non-Boolean approach to computing. Specifically, the natural minimization of energy in the system is a valuable property for minimizing the objective functions of combinatorial optimization problems, many of which are still challenging to solve using conventional digital solvers. In this work, we formulate two oscillator-inspired dynamical systems to solve quint… ▽ More Dynamical systems can offer a novel non-Boolean approach to computing. Specifically, the natural minimization of energy in the system is a valuable property for minimizing the objective functions of combinatorial optimization problems, many of which are still challenging to solve using conventional digital solvers. In this work, we formulate two oscillator-inspired dynamical systems to solve quintessential computationally intractable problems in Boolean satisfiability (SAT). The system dynamics are engineered such that they facilitate solutions to two different flavors of the SAT problem. We formulate the first dynamical system to compute the solution to the 3-SAT problem, while for the second system, we show that its dynamics map to the solution of the Max-NAE-3-SAT problem. Our work advances understanding of how this physics-inspired approach can be used to address challenging problems in computing. △ Less

Submitted 22 August, 2022; originally announced September 2022.

Characterizations of Extra-invariant spaces under the left translations on a Lie group

Authors: Sudipta Sarkar, Niraj K. Shukla

Abstract: In the context of a connected, simply connected, nilpotent Lie group, whose representations are square-integrable modulo the center, we find characterization results of extra-invariant spaces under the left translations associated with the range functions. Consequently, the theory is valid for the Heisenberg group $\mathbb H^d$, a 2-step nilpotent Lie group. In the context of a connected, simply connected, nilpotent Lie group, whose representations are square-integrable modulo the center, we find characterization results of extra-invariant spaces under the left translations associated with the range functions. Consequently, the theory is valid for the Heisenberg group $\mathbb H^d$, a 2-step nilpotent Lie group. △ Less

Submitted 1 September, 2022; originally announced September 2022.

Comments: 9 pages

MSC Class: 22E25; 22E30; 43A60; 43A80

Dynamical system-based computational models for solving combinatorial optimization on hypergraphs

Authors: Mohammad Khairul Bashar, Antik Mallick, Avik W. Ghosh, Nikhil Shukla

Abstract: The intrinsic energy minimization in dynamical systems offers a valuable tool for minimizing the objective functions of computationally challenging problems in combinatorial optimization. However, most prior works have focused on mapping such dynamics to combinatorial optimization problems whose objective functions have quadratic degree (e.g., MaxCut); such problems can be represented and analyzed… ▽ More The intrinsic energy minimization in dynamical systems offers a valuable tool for minimizing the objective functions of computationally challenging problems in combinatorial optimization. However, most prior works have focused on mapping such dynamics to combinatorial optimization problems whose objective functions have quadratic degree (e.g., MaxCut); such problems can be represented and analyzed using graphs. However, the work on developing such models for problems that need objective functions with degree greater than two, and subsequently, entail the use of hypergraph data structures, is relatively sparse. In this work, we develop dynamical system-inspired computational models for several such problems. Specifically, we define the 'energy function' for hypergraph-based combinatorial problems ranging from Boolean SAT and its variants to integer factorization, and subsequently, define the resulting system dynamics. We also show that the design approach is applicable to optimization problems with quadratic degree, and use it develop a new dynamical system formulation for minimizing the Ising Hamiltonian. Our work not only expands on the scope of problems that can be directly mapped to, and solved using physics-inspired models, but also creates new opportunities to design high-performance accelerators for solving combinatorial optimization. △ Less

Submitted 19 July, 2022; originally announced July 2022.

Computational Models based on Synchronized Oscillators for Solving Combinatorial Optimization Problems

Authors: Antik Mallick, Mohammad Khairul Bashar, Zongli Lin, Nikhil Shukla

Abstract: The equivalence between the natural minimization of energy in a dynamical system and the minimization of an objective function characterizing a combinatorial optimization problem offers a promising approach to designing dynamical system-inspired computational models and solvers for such problems. For instance, the ground state energy of coupled electronic oscillators, under second harmonic injecti… ▽ More The equivalence between the natural minimization of energy in a dynamical system and the minimization of an objective function characterizing a combinatorial optimization problem offers a promising approach to designing dynamical system-inspired computational models and solvers for such problems. For instance, the ground state energy of coupled electronic oscillators, under second harmonic injection, can be directly mapped to the optimal solution of the Maximum Cut problem. However, prior work has focused on a limited set of such problems. Therefore, in this work, we formulate computing models based on synchronized oscillator dynamics for a broad spectrum of combinatorial optimization problems ranging from the Max-K-Cut (the general version of the Maximum Cut problem) to the Traveling Salesman Problem. We show that synchronized oscillator dynamics can be engineered to solve these different combinatorial optimization problems by appropriately designing the coupling function and the external injection to the oscillators. Our work marks a step forward towards expanding the functionalities of oscillator-based analog accelerators and furthers the scope of dynamical system solvers for combinatorial optimization problems. △ Less

Submitted 13 June, 2022; originally announced June 2022.

Comments: 38 pages, 10 figures

Uncertainty Relation for Non-Hermitian Systems

Authors: Namrata Shukla, Ranjan Modak, Bhabani Prasad Mandal

Abstract: We construct uncertainty relation for arbitrary finite dimensional PT invariant non-Hermitian quantum systems within a special inner product framework. This construction is led by good observables which are a more general class of operators. We show that the cumulative gain in the quantum Fisher information when measuring two good observables for such non-Hermitian systems is way better than their… ▽ More We construct uncertainty relation for arbitrary finite dimensional PT invariant non-Hermitian quantum systems within a special inner product framework. This construction is led by good observables which are a more general class of operators. We show that the cumulative gain in the quantum Fisher information when measuring two good observables for such non-Hermitian systems is way better than their Hermitian counterpart. Minimum uncertainty states being the best candidates for this gain near the exceptional point supports the intelligent or simultaneous non-Hermitian quantum sensors. △ Less

Submitted 26 March, 2023; v1 submitted 6 June, 2022; originally announced June 2022.

Comments: 9 pages, 5 figures

Journal ref: Phys. Rev. A 107, 042201 (2023)

CMOS-Compatible Ising Machines built using Bistable Latches Coupled through Ferroelectric Transistor Arrays

Authors: Antik Mallick, Zijian Zhao, Mohammad Khairul Bashar, Shamiul Alam, Md Mazharul Islam, Yi Xiao, Yixin Xu, Ahmedullah Aziz, Vijaykrishnan Narayanan, Kai Ni, Nikhil Shukla

Abstract: Realizing compact and scalable Ising machines that are compatible with CMOS-process technology is crucial to the effectiveness and practicality of using such hardware platforms for accelerating computationally intractable problems. Besides the need for realizing compact Ising spins, the implementation of the coupling network, which describes the spin interaction, is also a potential bottleneck in… ▽ More Realizing compact and scalable Ising machines that are compatible with CMOS-process technology is crucial to the effectiveness and practicality of using such hardware platforms for accelerating computationally intractable problems. Besides the need for realizing compact Ising spins, the implementation of the coupling network, which describes the spin interaction, is also a potential bottleneck in the scalability of such platforms. Therefore, in this work, we propose an Ising machine platform that exploits the novel behavior of compact bi-stable CMOS-latches (cross-coupled inverters) as classical Ising spins interacting through highly scalable and CMOS-process compatible ferroelectric-HfO2-based Ferroelectric FETs (FeFETs) which act as coupling elements. We experimentally demonstrate the prototype building blocks of this system, and evaluate the behavior of the scaled system using simulations. We project that the proposed architecture can compute Ising solutions with an efficiency of ~1.04 x 10^8 solutions/W/second. Our work not only provides a pathway to realizing CMOS-compatible designs but also to overcoming their scaling challenges. △ Less

Submitted 29 May, 2022; originally announced May 2022.

Comments: 29 pages, 10 figures

2-speed network ensemble for efficient classification of incremental land-use/land-cover satellite image chips

Authors: Michael James Horry, Subrata Chakraborty, Biswajeet Pradhan, Nagesh Shukla, Sanjoy Paul

Abstract: The ever-growing volume of satellite imagery data presents a challenge for industry and governments making data-driven decisions based on the timely analysis of very large data sets. Commonly used deep learning algorithms for automatic classification of satellite images are time and resource-intensive to train. The cost of retraining in the context of Big Data presents a practical challenge when n… ▽ More The ever-growing volume of satellite imagery data presents a challenge for industry and governments making data-driven decisions based on the timely analysis of very large data sets. Commonly used deep learning algorithms for automatic classification of satellite images are time and resource-intensive to train. The cost of retraining in the context of Big Data presents a practical challenge when new image data and/or classes are added to a training corpus. Recognizing the need for an adaptable, accurate, and scalable satellite image chip classification scheme, in this research we present an ensemble of: i) a slow to train but high accuracy vision transformer; and ii) a fast to train, low-parameter convolutional neural network. The vision transformer model provides a scalable and accurate foundation model. The high-speed CNN provides an efficient means of incorporating newly labelled data into analysis, at the expense of lower accuracy. To simulate incremental data, the very large (~400,000 images) So2Sat LCZ42 satellite image chip dataset is divided into four intervals, with the high-speed CNN retrained every interval and the vision transformer trained every half interval. This experimental setup mimics an increase in data volume and diversity over time. For the task of automated land-cover/land-use classification, the ensemble models for each data increment outperform each of the component models, with best accuracy of 65% against a holdout test partition of the So2Sat dataset. The proposed ensemble and staggered training schedule provide a scalable and cost-effective satellite image classification scheme that is optimized to process very large volumes of satellite data. △ Less

Submitted 15 March, 2022; originally announced March 2022.

Comments: 24 pages, 9 figures, 5 tables

Dispersion $C_3$ coefficients for physisorption of heavy ions and atoms with graphene and carbon nanotubes

Authors: Harpreet Kaur, Neelam Shukla, Rajesh Srivastava, Bindiya Arora

Abstract: In the present work, the calculations have been performed for dispersion interaction between heavy elements (Zn$^+$, Cd$^+$, Hg$^+$, Pb$^+$, Zn, Cd, Hg, and Pb) with graphene and carbon nanotubes by evaluating van der Waals $C_3$ coefficients using well-known Lifshitz theory. The dispersion coefficients are expressed in terms of reflection coefficients of graphene and carbon nanotubes which are ca… ▽ More In the present work, the calculations have been performed for dispersion interaction between heavy elements (Zn$^+$, Cd$^+$, Hg$^+$, Pb$^+$, Zn, Cd, Hg, and Pb) with graphene and carbon nanotubes by evaluating van der Waals $C_3$ coefficients using well-known Lifshitz theory. The dispersion coefficients are expressed in terms of reflection coefficients of graphene and carbon nanotubes which are calculated within the framework of Dirac model. In addition, accurate values of dynamic dipole polarizabilities at imaginary frequencies of considered ions and atoms which are vital, have been calculated using relativistic methods. The comparisons of our calculated static dipole polarizabilities for the considered elements with the values reported in the literature are also presented. The dispersion interactions of the considered heavy elements with the graphene and carbon nanotubes of different radii in a wide range of separation distances have been studied. The results have also been analysed with another subtle variable, i.e., gap parameter of graphene wall. The interaction coefficients obtained for both the materials, i.e., for graphene and carbon nanotubes are mutually compared and it is found that graphene can be said as preferable material for adsorption of these toxic heavy elements. △ Less

Submitted 18 January, 2022; originally announced January 2022.

Two-dipole and three-dipole interaction coefficients of GROUP XII elements

Authors: Neelam Shukla, Harpreet Kaur, Bindiya Arora, Rajesh Srivastava

Abstract: The study of long-range interactions is increasingly becoming essential due to its various applications in cold atomic physics. These interactions can be conveniently expressed in terms of dispersion coefficients. In the present work, theoretical calculations have been carried out to estimate the two-dipole ($C_6$) and three-dipole ($C_9$) dispersion coefficients between the group XII atoms and th… ▽ More The study of long-range interactions is increasingly becoming essential due to its various applications in cold atomic physics. These interactions can be conveniently expressed in terms of dispersion coefficients. In the present work, theoretical calculations have been carried out to estimate the two-dipole ($C_6$) and three-dipole ($C_9$) dispersion coefficients between the group XII atoms and their ions, \textit{viz.}, Zn, Cd, Hg, Zn$^+$, Cd$^+$, and Hg$^+$. To obtain these coefficients, the dynamic dipole polarizabilities and reduced matrix elements required are evaluated using the relativistic methods for both the considered atoms and ions. Further, using the calculated matrix elements, the oscillator strengths corresponding to leading transitions and static dipole polarizabilities are determined. These are compared with the available values in the literature through which the accuracy of the present calculations ascertains. However, the oscillator strengths for few transitions of Zn, Cd, Hg, Zn$^+$, Cd$^+$, and Hg$^+$, are not reported earlier, and we have provided their values in this work. Thereafter, the dispersion $C_6$ and $C_9$ coefficients are calculated for various combinations of the group XII elements, and most of these coefficients were not reported earlier in the literature. Furthermore, the combinations for which the other theoretical and experimental values were available for comparison showed good agreement. We, therefore, believe that our results reported for $C_6$ and $C_9$ coefficients for various combinations of group XII elements are reliable. △ Less

Submitted 18 January, 2022; originally announced January 2022.

Distribution Shift in Airline Customer Behavior during COVID-19

Authors: Abhinav Garg, Naman Shukla, Lavanya Marla, Sriram Somanchi

Abstract: Traditional AI approaches in customized (personalized) contextual pricing applications assume that the data distribution at the time of online pricing is similar to that observed during training. However, this assumption may be violated in practice because of the dynamic nature of customer buying patterns, particularly due to unanticipated system shocks such as COVID-19. We study the changes in cu… ▽ More Traditional AI approaches in customized (personalized) contextual pricing applications assume that the data distribution at the time of online pricing is similar to that observed during training. However, this assumption may be violated in practice because of the dynamic nature of customer buying patterns, particularly due to unanticipated system shocks such as COVID-19. We study the changes in customer behavior for a major airline during the COVID-19 pandemic by framing it as a covariate shift and concept drift detection problem. We identify which customers changed their travel and purchase behavior and the attributes affecting that change using (i) Fast Generalized Subset Scanning and (ii) Causal Forests. In our experiments with simulated and real-world data, we present how these two techniques can be used through qualitative analysis. △ Less

Submitted 23 December, 2021; v1 submitted 29 November, 2021; originally announced November 2021.

Comments: 6 pages, 5 figures, NeurIPS 2021 Workshop on Distribution Shifts: connecting methods and applications (DistShift)

FREGAN : an application of generative adversarial networks in enhancing the frame rate of videos

Authors: Rishik Mishra, Neeraj Gupta, Nitya Shukla

Abstract: A digital video is a collection of individual frames, while streaming the video the scene utilized the time slice for each frame. High refresh rate and high frame rate is the demand of all high technology applications. The action tracking in videos becomes easier and motion becomes smoother in gaming applications due to the high refresh rate. It provides a faster response because of less time in b… ▽ More A digital video is a collection of individual frames, while streaming the video the scene utilized the time slice for each frame. High refresh rate and high frame rate is the demand of all high technology applications. The action tracking in videos becomes easier and motion becomes smoother in gaming applications due to the high refresh rate. It provides a faster response because of less time in between each frame that is displayed on the screen. FREGAN (Frame Rate Enhancement Generative Adversarial Network) model has been proposed, which predicts future frames of a video sequence based on a sequence of past frames. In this paper, we investigated the GAN model and proposed FREGAN for the enhancement of frame rate in videos. We have utilized Huber loss as a loss function in the proposed FREGAN. It provided excellent results in super-resolution and we have tried to reciprocate that performance in the application of frame rate enhancement. We have validated the effectiveness of the proposed model on the standard datasets (UCF101 and RFree500). The experimental outcomes illustrate that the proposed model has a Peak signal-to-noise ratio (PSNR) of 34.94 and a Structural Similarity Index (SSIM) of 0.95. △ Less

Submitted 1 November, 2021; originally announced November 2021.

ACM Class: I.2.1

Negotiating Networks in Oligopoly Markets for Price-Sensitive Products

Authors: Naman Shukla, Kartik Yellepeddi

Abstract: We present a novel framework to learn functions that estimate decisions of sellers and buyers simultaneously in an oligopoly market for a price-sensitive product. In this setting, the aim of the seller network is to come up with a price for a given context such that the expected revenue is maximized by considering the buyer's satisfaction as well. On the other hand, the aim of the buyer network is… ▽ More We present a novel framework to learn functions that estimate decisions of sellers and buyers simultaneously in an oligopoly market for a price-sensitive product. In this setting, the aim of the seller network is to come up with a price for a given context such that the expected revenue is maximized by considering the buyer's satisfaction as well. On the other hand, the aim of the buyer network is to assign probability of purchase to the offered price to mimic the real world buyers' responses while also showing price sensitivity through its action. In other words, rejecting the unnecessarily high priced products. Similar to generative adversarial networks, this framework corresponds to a minimax two-player game. In our experiments with simulated and real-world transaction data, we compared our framework with the baseline model and demonstrated its potential through proposed evaluation metrics. △ Less

Submitted 25 October, 2021; originally announced October 2021.

Comments: 10 pages, 4 figures, NeurIPS 2021 Workshop on Learning in Presence of Strategic Behavior

An Oscillator-based MaxSAT solver

Authors: Mohammad Khairul Bashar, Jaykumar Vaidya, Antik Mallick, R S Surya Kanthi, Shamiul Alam, Nazmul Amin, Chonghan Lee, Feng Shi, Ahmedullah Aziz, Vijaykrishnan Narayanan, Nikhil Shukla

Abstract: The quest to solve hard combinatorial optimization problems efficiently -- still a longstanding challenge for traditional digital computers -- has inspired the exploration of many alternate computing models and platforms. As a case in point, oscillator networks offer a potentially promising energy efficient and scalable option. However, prior oscillator-based combinatorial optimization solvers hav… ▽ More The quest to solve hard combinatorial optimization problems efficiently -- still a longstanding challenge for traditional digital computers -- has inspired the exploration of many alternate computing models and platforms. As a case in point, oscillator networks offer a potentially promising energy efficient and scalable option. However, prior oscillator-based combinatorial optimization solvers have primarily focused on quadratic combinatorial optimization problems that consider only pairwise interaction among the oscillators. In this work, we propose a new computational model based on the maximum entropy production (MEP) principle that exploits higher order interactions among the oscillators, and demonstrate its application in solving the non-quadratic maximum satisfiability (MaxSAT) problem. We demonstrate that the solution to the MaxSAT problem can be directly mapped to the entropy production rate in the oscillator network, and subsequently, propose an area-efficient hardware implementation that leverages Compute-in-Memory (CiM) primitives. Using experiments along with analytical and circuit simulations, we elucidate the performance of the proposed approach in computing high-quality optimal / near-optimal solutions to the MaxSAT problem. Our work not only reveals how oscillators can solve non-quadratic combinatorial optimization problems such as MaxSAT but also extends the application of this dynamical system-based approach to a broader class of problems that can be easily decomposed to the MaxSAT solution. △ Less

Submitted 20 September, 2021; originally announced September 2021.

Slowdown of interpenetration of two counterpropagating plasma slab due to collective effects

Authors: N. Shukla, K. Schoeffler, J. Vieira, R. Fonseca, E. Boella, L. O. Silva

Abstract: The nonlinear evolution of electromagnetic instabilities driven by the interpenetration of two $e^-\,e^+$ plasma clouds is explored using {\it ab initio} kinetic plasma simulations. We show that the plasma clouds slow down due to both oblique and Weibel generated electromagnetic fields, which deflect the particle trajectories, transferring bulk forward momentum into transverse momentum and thermal… ▽ More The nonlinear evolution of electromagnetic instabilities driven by the interpenetration of two $e^-\,e^+$ plasma clouds is explored using {\it ab initio} kinetic plasma simulations. We show that the plasma clouds slow down due to both oblique and Weibel generated electromagnetic fields, which deflect the particle trajectories, transferring bulk forward momentum into transverse momentum and thermal velocity spread. This process causes the flow velocity $v_{inst}$ to decrease approximately by a factor of $\sqrt{1/3}$ in a time interval $Δt_{αB} ω_p \sim c/(v_{fl}\sqrt{α_B})$, where $α_B$ is the magnetic equipartition parameter determined by the non-linear saturation of the instabilities, $v_{fl}$ is the initial flow speed, and $ω_p$ is the plasma frequency. For the $α_B$ measured in our simulations, $Δt_{αB}$ is close to $10 \times$ the instability growth time. We show that as long as the plasma slab length $L > v_{fl} Δt_{αB}$, the plasma flow is expected to slow down by a factor close to $1/\sqrt{3}$. △ Less

Submitted 31 August, 2021; originally announced September 2021.

A Three-terminal Non-Volatile Ferroelectric Switch with an Insulator-Metal Transition Channel

Authors: Jaykumar Vaidya, R S Surya Kanthi, Shamiul Alam, Nazmul Amin, Ahmedullah Aziz, Nikhil Shukla

Abstract: Ferroelectrics offer a promising materials platform to realize energy-efficient non-volatile memory technology with the FeFET-based implementations being one of the most area-efficient ferroelectric memory architectures. However, the FeFET operation entails a fundamental trade-off between the read and the program operations. To overcome this trade-off, we propose in this work, a novel device, Mott… ▽ More Ferroelectrics offer a promising materials platform to realize energy-efficient non-volatile memory technology with the FeFET-based implementations being one of the most area-efficient ferroelectric memory architectures. However, the FeFET operation entails a fundamental trade-off between the read and the program operations. To overcome this trade-off, we propose in this work, a novel device, Mott-FeFET, that aims to replace the Silicon channel of the FeFET with VO2- a material that exhibits an electrically driven insulator-metal phase transition. The Mott-FeFET design, which demonstrates a (ferroelectric) polarization-dependent threshold voltage, enables the read current distinguishability (i.e., the ratio of current sensed when the Mott-FeFET is in state 1 and 0, respectively) to be independent of the program voltage. This enables the device to be programmed at low voltages without affecting the ability to sense/read the state of the device. Our work provides a pathway to realize low-voltage and energy-efficient non-volatile memory solutions. △ Less

Submitted 26 August, 2021; originally announced August 2021.

Comments: 23 pages, manuscript and supplementary information combined

Creating Electronic Oscillator-based Ising Machines without External Injection Locking

Authors: Jaykumar Vaidya, R S Surya Kanthi, Nikhil Shukla

Abstract: Coupled electronic oscillators have recently been explored as a compact, integrated circuit- and room temperature operation- compatible hardware platform to design Ising machines. However, such implementations presently require the injection of an externally generated second-harmonic signal to impose the phase bipartition among the oscillators. In this work, we experimentally demonstrate a new ele… ▽ More Coupled electronic oscillators have recently been explored as a compact, integrated circuit- and room temperature operation- compatible hardware platform to design Ising machines. However, such implementations presently require the injection of an externally generated second-harmonic signal to impose the phase bipartition among the oscillators. In this work, we experimentally demonstrate a new electronic autaptic oscillator (EAO) that uses engineered feedback to eliminate the need for the generation and injection of the external second harmonic signal to minimize the Ising Hamiltonian. The feedback in the EAO is engineered to effectively generate the second harmonic signal internally. Using this oscillator design, we show experimentally, that a system of capacitively coupled EAOs exhibits the desired bipartition in the oscillator phases, and subsequently, demonstrate its application in solving the computationally hard Maximum Cut (MaxCut) problem. Our work not only establishes a new oscillator design aligned to the needs of the oscillator Ising machine but also advances the efforts to creating application specific analog computing platforms. △ Less

Submitted 23 August, 2021; originally announced August 2021.

Comments: 18 pages, 5 figures

Heteroscedastic Temporal Variational Autoencoder For Irregularly Sampled Time Series

Authors: Satya Narayan Shukla, Benjamin M. Marlin

Abstract: Irregularly sampled time series commonly occur in several domains where they present a significant challenge to standard deep learning models. In this paper, we propose a new deep learning framework for probabilistic interpolation of irregularly sampled time series that we call the Heteroscedastic Temporal Variational Autoencoder (HeTVAE). HeTVAE includes a novel input layer to encode information… ▽ More Irregularly sampled time series commonly occur in several domains where they present a significant challenge to standard deep learning models. In this paper, we propose a new deep learning framework for probabilistic interpolation of irregularly sampled time series that we call the Heteroscedastic Temporal Variational Autoencoder (HeTVAE). HeTVAE includes a novel input layer to encode information about input observation sparsity, a temporal VAE architecture to propagate uncertainty due to input sparsity, and a heteroscedastic output layer to enable variable uncertainty in output interpolations. Our results show that the proposed architecture is better able to reflect variable uncertainty through time due to sparse and irregular sampling than a range of baseline and traditional models, as well as recently proposed deep latent variable models that use homoscedastic output layers. △ Less

Submitted 23 July, 2021; originally announced July 2021.

Transformer-based Machine Learning for Fast SAT Solvers and Logic Synthesis

Authors: Feng Shi, Chonghan Lee, Mohammad Khairul Bashar, Nikhil Shukla, Song-Chun Zhu, Vijaykrishnan Narayanan

Abstract: CNF-based SAT and MaxSAT solvers are central to logic synthesis and verification systems. The increasing popularity of these constraint problems in electronic design automation encourages studies on different SAT problems and their properties for further computational efficiency. There has been both theoretical and practical success of modern Conflict-driven clause learning SAT solvers, which allo… ▽ More CNF-based SAT and MaxSAT solvers are central to logic synthesis and verification systems. The increasing popularity of these constraint problems in electronic design automation encourages studies on different SAT problems and their properties for further computational efficiency. There has been both theoretical and practical success of modern Conflict-driven clause learning SAT solvers, which allows solving very large industrial instances in a relatively short amount of time. Recently, machine learning approaches provide a new dimension to solving this challenging problem. Neural symbolic models could serve as generic solvers that can be specialized for specific domains based on data without any changes to the structure of the model. In this work, we propose a one-shot model derived from the Transformer architecture to solve the MaxSAT problem, which is the optimization version of SAT where the goal is to satisfy the maximum number of clauses. Our model has a scale-free structure which could process varying size of instances. We use meta-path and self-attention mechanism to capture interactions among homogeneous nodes. We adopt cross-attention mechanisms on the bipartite graph to capture interactions among heterogeneous nodes. We further apply an iterative algorithm to our model to satisfy additional clauses, enabling a solution approaching that of an exact-SAT problem. The attention mechanisms leverage the parallelism for speedup. Our evaluation indicates improved speedup compared to heuristic approaches and improved completion rate compared to machine learning approaches. △ Less

Submitted 15 July, 2021; originally announced July 2021.

Multi-Time Attention Networks for Irregularly Sampled Time Series

Authors: Satya Narayan Shukla, Benjamin M. Marlin

Abstract: Irregular sampling occurs in many time series modeling applications where it presents a significant challenge to standard deep learning models. This work is motivated by the analysis of physiological time series data in electronic health records, which are sparse, irregularly sampled, and multivariate. In this paper, we propose a new deep learning framework for this setting that we call Multi-Time… ▽ More Irregular sampling occurs in many time series modeling applications where it presents a significant challenge to standard deep learning models. This work is motivated by the analysis of physiological time series data in electronic health records, which are sparse, irregularly sampled, and multivariate. In this paper, we propose a new deep learning framework for this setting that we call Multi-Time Attention Networks. Multi-Time Attention Networks learn an embedding of continuous-time values and use an attention mechanism to produce a fixed-length representation of a time series containing a variable number of observations. We investigate the performance of this framework on interpolation and classification tasks using multiple datasets. Our results show that the proposed approach performs as well or better than a range of baseline and recently proposed models while offering significantly faster training times than current state-of-the-art methods. △ Less

Submitted 7 June, 2021; v1 submitted 25 January, 2021; originally announced January 2021.

Comments: Accepted at International Conference on Learning Representations (ICLR) 2021

Using Noise to Augment Synchronization among Oscillators

Authors: Jaykumar Vaidya, Mohammad Khairul Bashar, Nikhil Shukla

Abstract: Noise is expected to play an important role in the dynamics of analog systems such as coupled oscillators which have recently been explored as a hardware platform for application in computing. In this work, we experimentally investigate the effect of noise on the synchronization of relaxation oscillators and their computational properties. Specifically, in contrast to its typically expected advers… ▽ More Noise is expected to play an important role in the dynamics of analog systems such as coupled oscillators which have recently been explored as a hardware platform for application in computing. In this work, we experimentally investigate the effect of noise on the synchronization of relaxation oscillators and their computational properties. Specifically, in contrast to its typically expected adverse effect, we first demonstrate that a common white noise input induces global frequency synchronization among uncoupled oscillators. Experiments show that the minimum noise voltage required to induce synchronization increases linearly with the amplitude of the oscillator output whereas it decreases with increasing number of oscillators. Further, our work reveals that in a coupled system of oscillators - relevant to solving computational problems such as graph coloring, the injection of white noise helps reduce the minimum required capacitive coupling strength. With the injection of noise, the coupled system demonstrates frequency synchronization along with the desired phase-based computational properties at 5x lower coupling strength than that required when no external noise is introduced. Consequently, this can reduce the footprint of the coupling element and the corresponding area-intensive coupling architecture. Our work shows that noise can be utilized as an effective knob to optimize the implementation of coupled oscillator-based computing platforms. △ Less

Submitted 10 January, 2021; v1 submitted 2 December, 2020; originally announced December 2020.

A Survey on Principles, Models and Methods for Learning from Irregularly Sampled Time Series

Authors: Satya Narayan Shukla, Benjamin M. Marlin

Abstract: Irregularly sampled time series data arise naturally in many application domains including biology, ecology, climate science, astronomy, and health. Such data represent fundamental challenges to many classical models from machine learning and statistics due to the presence of non-uniform intervals between observations. However, there has been significant progress within the machine learning commun… ▽ More Irregularly sampled time series data arise naturally in many application domains including biology, ecology, climate science, astronomy, and health. Such data represent fundamental challenges to many classical models from machine learning and statistics due to the presence of non-uniform intervals between observations. However, there has been significant progress within the machine learning community over the last decade on developing specialized models and architectures for learning from irregularly sampled univariate and multivariate time series data. In this survey, we first describe several axes along which approaches to learning from irregularly sampled time series differ including what data representations they are based on, what modeling primitives they leverage to deal with the fundamental problem of irregular sampling, and what inference tasks they are designed to perform. We then survey the recent literature organized primarily along the axis of modeling primitives. We describe approaches based on temporal discretization, interpolation, recurrence, attention and structural invariance. We discuss similarities and differences between approaches and highlight primary strengths and weaknesses. △ Less

Submitted 5 January, 2021; v1 submitted 30 November, 2020; originally announced December 2020.

Comments: Presented at NeurIPS 2020 Workshop: ML Retrospectives, Surveys & Meta-Analyses (ML-RSA)

Generating ultra-dense pair beams using 400 GeV/c protons

Authors: C. D. Arrowsmith, N. Shukla, N. Charitonidis, R. Boni, H. Chen, T. Davenne, D. H. Froula, B. T. Huffman, Y. Kadi, B. Reville, S. Richardson, S. Sarkar, J. L. Shaw, L. O. Silva, R. M. G. M. Trines, R. Bingham, G. Gregori

Abstract: A previously unexplored experimental scheme is presented for generating low-divergence, ultra-dense, relativistic, electron-positron beams using 400 GeV/c protons available at facilities such as HiRadMat and AWAKE at CERN. Preliminary Monte-Carlo and Particle-in-cell simulations demonstrate the possibility of generating beams containing $10^{13}-10^{14}$ electron-positron pairs at sufficiently hig… ▽ More A previously unexplored experimental scheme is presented for generating low-divergence, ultra-dense, relativistic, electron-positron beams using 400 GeV/c protons available at facilities such as HiRadMat and AWAKE at CERN. Preliminary Monte-Carlo and Particle-in-cell simulations demonstrate the possibility of generating beams containing $10^{13}-10^{14}$ electron-positron pairs at sufficiently high densities to drive collisionless beam-plasma instabilities, which are expected to play an important role in magnetic field generation and the related radiation signatures of relativistic astrophysical phenomena. The pair beams are quasi-neutral, with size exceeding several skin-depths in all dimensions, allowing for the first time the examination of the effect of competition between transverse and longitudinal instability modes on the growth of magnetic fields. Furthermore, the presented scheme allows for the possibility of controlling the relative density of hadrons to electron-positron pairs in the beam, making it possible to explore the parameter spaces for different astrophysical environments. △ Less

Submitted 9 November, 2020; originally announced November 2020.

Journal ref: Phys. Rev. Research 3, 023103 (2021)

Collisionless shock acceleration in the corona of an inertial confinement fusion pellet with possible application to ion fast ignition

Authors: E. Boella, R. Bingham, R. A. Cairns, P. Norreys, R. Trines, R. Scott, M. Vranic, N. Shukla, L. O. Silva

Abstract: Two-dimensional Particle-In-Cell simulations are used to explore collisionless shock acceleration in the corona plasma surrounding the compressed core of an inertial confinement fusion pellet. We show that an intense laser pulse interacting with the long scale-length plasma corona is able to launch a collisionless shock around the critical density. The nonlinear wave travels up-ramp through the pl… ▽ More Two-dimensional Particle-In-Cell simulations are used to explore collisionless shock acceleration in the corona plasma surrounding the compressed core of an inertial confinement fusion pellet. We show that an intense laser pulse interacting with the long scale-length plasma corona is able to launch a collisionless shock around the critical density. The nonlinear wave travels up-ramp through the plasma reflecting and accelerating the background ions. Our results suggest that protons with characteristics suitable for ion fast ignition may be achieved in this way. △ Less

Submitted 2 November, 2020; originally announced November 2020.

Gaussian MRF Covariance Modeling for Efficient Black-Box Adversarial Attacks

Authors: Anit Kumar Sahu, Satya Narayan Shukla, J. Zico Kolter

Abstract: We study the problem of generating adversarial examples in a black-box setting, where we only have access to a zeroth order oracle, providing us with loss function evaluations. Although this setting has been investigated in previous work, most past approaches using zeroth order optimization implicitly assume that the gradients of the loss function with respect to the input images are \emph{unstruc… ▽ More We study the problem of generating adversarial examples in a black-box setting, where we only have access to a zeroth order oracle, providing us with loss function evaluations. Although this setting has been investigated in previous work, most past approaches using zeroth order optimization implicitly assume that the gradients of the loss function with respect to the input images are \emph{unstructured}. In this work, we show that in fact substantial correlations exist within these gradients, and we propose to capture these correlations via a Gaussian Markov random field (GMRF). Given the intractability of the explicit covariance structure of the MRF, we show that the covariance structure can be efficiently represented using the Fast Fourier Transform (FFT), along with low-rank updates to perform exact posterior estimation under this model. We use this modeling technique to find fast one-step adversarial attacks, akin to a black-box version of the Fast Gradient Sign Method~(FGSM), and show that the method uses fewer queries and achieves higher attack success rates than the current state of the art. We also highlight the general applicability of this gradient modeling setup. △ Less

Submitted 8 October, 2020; originally announced October 2020.