-
M-QALM: A Benchmark to Assess Clinical Reading Comprehension and Knowledge Recall in Large Language Models via Question Answering
Authors:
Anand Subramanian,
Viktor Schlegel,
Abhinav Ramesh Kashyap,
Thanh-Tung Nguyen,
Vijay Prakash Dwivedi,
Stefan Winkler
Abstract:
There is vivid research on adapting Large Language Models (LLMs) to perform a variety of tasks in high-stakes domains such as healthcare. Despite their popularity, there is a lack of understanding of the extent and contributing factors that allow LLMs to recall relevant knowledge and combine it with presented information in the clinical and biomedical domain: a fundamental pre-requisite for succes…
▽ More
There is vivid research on adapting Large Language Models (LLMs) to perform a variety of tasks in high-stakes domains such as healthcare. Despite their popularity, there is a lack of understanding of the extent and contributing factors that allow LLMs to recall relevant knowledge and combine it with presented information in the clinical and biomedical domain: a fundamental pre-requisite for success on down-stream tasks. Addressing this gap, we use Multiple Choice and Abstractive Question Answering to conduct a large-scale empirical study on 22 datasets in three generalist and three specialist biomedical sub-domains. Our multifaceted analysis of the performance of 15 LLMs, further broken down by sub-domain, source of knowledge and model architecture, uncovers success factors such as instruction tuning that lead to improved recall and comprehension. We further show that while recently proposed domain-adapted models may lack adequate knowledge, directly fine-tuning on our collected medical knowledge datasets shows encouraging results, even generalising to unseen specialist sub-domains. We complement the quantitative results with a skill-oriented manual error analysis, which reveals a significant gap between the models' capabilities to simply recall necessary knowledge and to integrate it with the presented context. To foster research and collaboration in this field we share M-QALM, our resources, standardised methodology, and evaluation results, with the research community to facilitate further advancements in clinical knowledge representation learning within language models.
△ Less
Submitted 5 June, 2024;
originally announced June 2024.
-
Péclet dependent Interactions of Self-Propelled Droplets
Authors:
Prateek Dwivedi,
Sobiya Ashraf,
Pawan Kumar,
Dipin Pillai,
Rahul Mangal
Abstract:
Interactions among biologically active agents is facilitated by their self-generated chemical and hydrodynamic fields. In order to elucidate the pair-wise interactions between such micro-organisms, we employ active droplets as a model system, capable of self-generating chemical and hydrodynamic fields. We demonstrate that the solute Péclet number ($Pe$), characterizing the relative strength of its…
▽ More
Interactions among biologically active agents is facilitated by their self-generated chemical and hydrodynamic fields. In order to elucidate the pair-wise interactions between such micro-organisms, we employ active droplets as a model system, capable of self-generating chemical and hydrodynamic fields. We demonstrate that the solute Péclet number ($Pe$), characterizing the relative strength of its convective to diffusive transport, plays a crucial role in determining how the chemical and hydrodynamic fields impact their interactions. Our findings reveal that at low $Pe$, the interaction is predominantly governed by chemo-repulsive effects, leading to droplets avoiding physical contact. Conversely, at elevated $Pe$, hydrodynamic interactions become more influential, leading to physical engagement. However, irrespective of $Pe$, the interaction of a droplet with the chemical trail of another droplet is always governed by chemo-repulsive effects. Furthermore, our results establish that the chemo-repulsive deflection/rebounding of droplets is influenced by the droplets' inherent chemical polarity, as determined by its $Pe$, independent of their approach orientation. Our findings offer a methodology for tuning the outcomes of binary interactions among chemically active droplets, laying the groundwork for potential studies on their collective dynamics.
△ Less
Submitted 21 April, 2024;
originally announced April 2024.
-
Motility and pair-wise interactions of chemically active droplets in 1-D confinement
Authors:
Pawan Kumar,
Prateek Dwivedi,
Sobiya Ashraf,
Dipin Pillai,
Rahul Mangal
Abstract:
Self-propelled droplets serve as ideal model systems to delve deeper into understanding of the motion of biological micro-swimmers by simulating their motility. Biological microorganisms are renowned for showcasing a diverse array of dynamic swimming behaviors when confronted with physical constraints. This study aims to elucidate the impact of physical constraints on swimming characteristics of b…
▽ More
Self-propelled droplets serve as ideal model systems to delve deeper into understanding of the motion of biological micro-swimmers by simulating their motility. Biological microorganisms are renowned for showcasing a diverse array of dynamic swimming behaviors when confronted with physical constraints. This study aims to elucidate the impact of physical constraints on swimming characteristics of biological microorganisms. To achieve this, we present observations on the individual and pair-wise behavior of micellar solubilized self-propelled 4-Cyano-4'-pentyl-biphenyl (5CB) oil droplets in a square capillary channel filled with a surfactant trimethyl ammonium bromide (TTAB) aqueous solution. To explore the effect of the underlying Péclet ($Pe$) number of the swimming droplets, the study is also performed in the presence of additives such as high molecular weight polymer Polyethylene oxide (PEO) and molecular solute glycerol. The capillary confinement restricts droplet to predominantly one-dimensional (1D) motion, albeit with noticeable differences in their motion across the three scenarios. Through a characterization of the chemical and hydrodynamic flow fields surrounding the droplets, we illustrate that the modification of the droplets' chemical field due to confinement varies significantly based on the underlying differences in the Péclet number ($Pe$) in these cases. This alteration in the chemical field distribution notably affects the individual droplets' motion. Moreover, these distinct chemical field interactions between the droplets also lead to variations in their pair-wise motion, ranging from behaviors like chasing to scattering.
△ Less
Submitted 20 January, 2024;
originally announced January 2024.
-
Automated Clinical Coding for Outpatient Departments
Authors:
Viktor Schlegel,
Abhinav Ramesh Kashyap,
Thanh-Tung Nguyen,
Tsung-Han Yang,
Vijay Prakash Dwivedi,
Wei-Hsian Yin,
Jeng Wei,
Stefan Winkler
Abstract:
Computerised clinical coding approaches aim to automate the process of assigning a set of codes to medical records. While there is active research pushing the state of the art on clinical coding for hospitalized patients, the outpatient setting -- where doctors tend to non-hospitalised patients -- is overlooked. Although both settings can be formalised as a multi-label classification task, they pr…
▽ More
Computerised clinical coding approaches aim to automate the process of assigning a set of codes to medical records. While there is active research pushing the state of the art on clinical coding for hospitalized patients, the outpatient setting -- where doctors tend to non-hospitalised patients -- is overlooked. Although both settings can be formalised as a multi-label classification task, they present unique and distinct challenges, which raises the question of whether the success of inpatient clinical coding approaches translates to the outpatient setting. This paper is the first to investigate how well state-of-the-art deep learning-based clinical coding approaches work in the outpatient setting at hospital scale. To this end, we collect a large outpatient dataset comprising over 7 million notes documenting over half a million patients. We adapt four state-of-the-art clinical coding approaches to this setting and evaluate their potential to assist coders. We find evidence that clinical coding in outpatient settings can benefit from more innovations in popular inpatient coding benchmarks. A deeper analysis of the factors contributing to the success -- amount and form of data and choice of document representation -- reveals the presence of easy-to-solve examples, the coding of which can be completely automated with a low error rate.
△ Less
Submitted 24 December, 2023; v1 submitted 20 December, 2023;
originally announced December 2023.
-
Graph Transformers for Large Graphs
Authors:
Vijay Prakash Dwivedi,
Yozen Liu,
Anh Tuan Luu,
Xavier Bresson,
Neil Shah,
Tong Zhao
Abstract:
Transformers have recently emerged as powerful neural networks for graph learning, showcasing state-of-the-art performance on several graph property prediction tasks. However, these results have been limited to small-scale graphs, where the computational feasibility of the global attention mechanism is possible. The next goal is to scale up these architectures to handle very large graphs on the sc…
▽ More
Transformers have recently emerged as powerful neural networks for graph learning, showcasing state-of-the-art performance on several graph property prediction tasks. However, these results have been limited to small-scale graphs, where the computational feasibility of the global attention mechanism is possible. The next goal is to scale up these architectures to handle very large graphs on the scale of millions or even billions of nodes. With large-scale graphs, global attention learning is proven impractical due to its quadratic complexity w.r.t. the number of nodes. On the other hand, neighborhood sampling techniques become essential to manage large graph sizes, yet finding the optimal trade-off between speed and accuracy with sampling techniques remains challenging. This work advances representation learning on single large-scale graphs with a focus on identifying model characteristics and critical design constraints for developing scalable graph transformer (GT) architectures. We argue such GT requires layers that can adeptly learn both local and global graph representations while swiftly sampling the graph topology. As such, a key innovation of this work lies in the creation of a fast neighborhood sampling technique coupled with a local attention mechanism that encompasses a 4-hop reception field, but achieved through just 2-hop operations. This local node embedding is then integrated with a global node embedding, acquired via another self-attention layer with an approximate global codebook, before finally sent through a downstream layer for node predictions. The proposed GT framework, named LargeGT, overcomes previous computational bottlenecks and is validated on three large-scale node classification benchmarks. We report a 3x speedup and 16.8% performance gain on ogbn-products and snap-patents, while we also scale LargeGT on ogbn-papers100M with a 5.9% performance improvement.
△ Less
Submitted 18 December, 2023;
originally announced December 2023.
-
A low repetition rate optical frequency comb
Authors:
Francesco Canella,
Johannes Weitenberg,
Muhammad Thariq,
Fabian Schmid,
Paras Dwivedi,
Gianluca Galzerano,
Theodor W. Haensch,
Thomas Udem,
Akira Ozawa
Abstract:
Reducing the pulse repetition rate of an optical frequency comb increases the pulse energy for a given average power. This enhances the efficiency of nonlinear frequency conversion and it facilitates extending the accessible wavelength range, for example into the extreme ultraviolet (XUV). The resulting spectrally dense frequency comb can still be used for precision spectroscopy of narrow atomic o…
▽ More
Reducing the pulse repetition rate of an optical frequency comb increases the pulse energy for a given average power. This enhances the efficiency of nonlinear frequency conversion and it facilitates extending the accessible wavelength range, for example into the extreme ultraviolet (XUV). The resulting spectrally dense frequency comb can still be used for precision spectroscopy of narrow atomic or molecular transitions. In this article, we demonstrate a low-noise infrared frequency comb with a repetition rate as low as 40 kHz using a Yb:KYW mode-locked laser, pulse picking, and subsequent amplification. The frequency comb structure is confirmed by generating a beat note with a continuous wave reference laser. A comb mode is actively stabilized to the reference laser, and the integrated rms phase noise from 20 Hz to 20 kHz is measured to be 195 mrad.
△ Less
Submitted 18 September, 2023;
originally announced September 2023.
-
RAMAN: A Re-configurable and Sparse tinyML Accelerator for Inference on Edge
Authors:
Adithya Krishna,
Srikanth Rohit Nudurupati,
Chandana D G,
Pritesh Dwivedi,
André van Schaik,
Mahesh Mehendale,
Chetan Singh Thakur
Abstract:
Deep Neural Network (DNN) based inference at the edge is challenging as these compute and data-intensive algorithms need to be implemented at low cost and low power while meeting the latency constraints of the target applications. Sparsity, in both activations and weights inherent to DNNs, is a key knob to leverage. In this paper, we present RAMAN, a Re-configurable and spArse tinyML Accelerator f…
▽ More
Deep Neural Network (DNN) based inference at the edge is challenging as these compute and data-intensive algorithms need to be implemented at low cost and low power while meeting the latency constraints of the target applications. Sparsity, in both activations and weights inherent to DNNs, is a key knob to leverage. In this paper, we present RAMAN, a Re-configurable and spArse tinyML Accelerator for infereNce on edge, architected to exploit the sparsity to reduce area (storage), power as well as latency. RAMAN can be configured to support a wide range of DNN topologies - consisting of different convolution layer types and a range of layer parameters (feature-map size and the number of channels). RAMAN can also be configured to support accuracy vs power/latency tradeoffs using techniques deployed at compile-time and run-time. We present the salient features of the architecture, provide implementation results and compare the same with the state-of-the-art. RAMAN employs novel dataflow inspired by Gustavson's algorithm that has optimal input activation (IA) and output activation (OA) reuse to minimize memory access and the overall data movement cost. The dataflow allows RAMAN to locally reduce the partial sum (Psum) within a processing element array to eliminate the Psum writeback traffic. Additionally, we suggest a method to reduce peak activation memory by overlapping IA and OA on the same memory space, which can reduce storage requirements by up to 50%. RAMAN was implemented on a low-power and resource-constrained Efinix Ti60 FPGA with 37.2K LUTs and 8.6K register utilization. RAMAN processes all layers of the MobileNetV1 model at 98.47 GOp/s/W and the DS-CNN model at 79.68 GOp/s/W by leveraging both weight and activation sparsity.
△ Less
Submitted 10 June, 2023;
originally announced June 2023.
-
Union Subgraph Neural Networks
Authors:
Jiaxing Xu,
Aihu Zhang,
Qingtian Bian,
Vijay Prakash Dwivedi,
Yiping Ke
Abstract:
Graph Neural Networks (GNNs) are widely used for graph representation learning in many application domains. The expressiveness of vanilla GNNs is upper-bounded by 1-dimensional Weisfeiler-Leman (1-WL) test as they operate on rooted subtrees through iterative message passing. In this paper, we empower GNNs by injecting neighbor-connectivity information extracted from a new type of substructure. We…
▽ More
Graph Neural Networks (GNNs) are widely used for graph representation learning in many application domains. The expressiveness of vanilla GNNs is upper-bounded by 1-dimensional Weisfeiler-Leman (1-WL) test as they operate on rooted subtrees through iterative message passing. In this paper, we empower GNNs by injecting neighbor-connectivity information extracted from a new type of substructure. We first investigate different kinds of connectivities existing in a local neighborhood and identify a substructure called union subgraph, which is able to capture the complete picture of the 1-hop neighborhood of an edge. We then design a shortest-path-based substructure descriptor that possesses three nice properties and can effectively encode the high-order connectivities in union subgraphs. By infusing the encoded neighbor connectivities, we propose a novel model, namely Union Subgraph Neural Network (UnionSNN), which is proven to be strictly more powerful than 1-WL in distinguishing non-isomorphic graphs. Additionally, the local encoding from union subgraphs can also be injected into arbitrary message-passing neural networks (MPNNs) and Transformer-based models as a plugin. Extensive experiments on 18 benchmarks of both graph-level and node-level tasks demonstrate that UnionSNN outperforms state-of-the-art baseline models, with competitive computational efficiency. The injection of our local encoding to existing models is able to boost the performance by up to 11.09%. Our code is available at https://github.com/AngusMonroe/UnionSNN.
△ Less
Submitted 9 January, 2024; v1 submitted 25 May, 2023;
originally announced May 2023.
-
Deterministic identity testing paradigms for bounded top-fanin depth-4 circuits
Authors:
Pranjal Dutta,
Prateek Dwivedi,
Nitin Saxena
Abstract:
Polynomial Identity Testing (PIT) is a fundamental computational problem. The famous depth-$4$ reduction result by Agrawal and Vinay (FOCS 2008) has made PIT for depth-$4$ circuits an enticing pursuit. A restricted depth-4 circuit computing a $n$-variate degree-$d$ polynomial of the form $\sum_{i = 1}^{k} \prod_{j} g_{ij}$, where $°g_{ij} \leq δ$ is called $Σ^{[k]}ΠΣΠ^{[δ]}$ circuit. On further re…
▽ More
Polynomial Identity Testing (PIT) is a fundamental computational problem. The famous depth-$4$ reduction result by Agrawal and Vinay (FOCS 2008) has made PIT for depth-$4$ circuits an enticing pursuit. A restricted depth-4 circuit computing a $n$-variate degree-$d$ polynomial of the form $\sum_{i = 1}^{k} \prod_{j} g_{ij}$, where $°g_{ij} \leq δ$ is called $Σ^{[k]}ΠΣΠ^{[δ]}$ circuit. On further restricting $g_{ij}$ to be sum of univariates we obtain $Σ^{[k]}ΠΣ\wedge$ circuits. The largely open, special-cases of $Σ^{[k]}ΠΣΠ^{[δ]}$ for constant $k$ and $δ$, and $Σ^{[k]}ΠΣ\wedge$ have been a source of many great ideas in the last two decades. For eg. depth-$3$ ideas of Dvir and Shpilka (STOC 2005), Kayal and Saxena (CCC 2006), and Saxena and Seshadhri (FOCS 2010 and STOC 2011). Further, depth-$4$ ideas of Beecken, Mittmann and Saxena (ICALP 2011), Saha, Saxena and Saptharishi (Comput.Compl. 2013), Forbes (FOCS 2015), and Kumar and Saraf (CCC 2016). Additionally, geometric Sylvester-Gallai ideas of Kayal and Saraf (FOCS 2009), Shpilka (STOC 2019), and Peleg and Shpilka (CCC 2020, STOC 2021). Very recently, a subexponential-time blackbox PIT algorithm for constant-depth circuits was obtained via lower bound breakthrough of Limaye, Srinivasan, Tavenas (FOCS 2021). We solve two of the basic underlying open problems in this work.
We give the first polynomial-time PIT for $Σ^{[k]}ΠΣ\wedge$. We also give the first quasipolynomial time blackbox PIT for both $Σ^{[k]}ΠΣ\wedge$ and $Σ^{[k]}ΠΣΠ^{[δ]}$. A key technical ingredient in all the three algorithms is how the logarithmic derivative, and its power-series, modify the top $Π$-gate to $\wedge$.
△ Less
Submitted 22 April, 2023;
originally announced April 2023.
-
sar reduction techniques for wearable application
Authors:
Prithvi Raj,
Ravi Prakash Dwivedi
Abstract:
The biocompatible, noninvasive, lightweight, compact size and low manufacturing cost of the wearable antenna has attracted the researchers to work more in this field to bring the use of wearable antennas to the mainstream wearable devices industry. In recent years there has been great growth in the field of wearable electronics due to their unmatched functionalities and use cases, with the increas…
▽ More
The biocompatible, noninvasive, lightweight, compact size and low manufacturing cost of the wearable antenna has attracted the researchers to work more in this field to bring the use of wearable antennas to the mainstream wearable devices industry. In recent years there has been great growth in the field of wearable electronics due to their unmatched functionalities and use cases, with the increased use of wearables there comes the concern about the safety in the usage of the antenna which directly points towards the SAR value of the particular antenna in use. This paper examines a wide range of antenna based on their SAR value and the techniques such as EBG, AMC, use of metamaterials, used to reduce the SAR for safe usage
△ Less
Submitted 16 April, 2023;
originally announced April 2023.
-
Deforming Active Droplets in Viscoelastic Media
Authors:
Prateek Dwivedi,
Atishay Shrivastava,
Naveen Tiwari,
Dipin Pillai,
Rahul Mangal
Abstract:
To mimic the motion of biological swimmers in bodily fluids, a novel experimental system of micellar solubilization driven active droplets in a visco-elastic polymeric solution is presented. The visco-elastic nature of the medium, characterized by the Deborah number (De), is tuned by varying the surfactant (fuel) and polymer concentration in the ambient medium. At moderate De, the droplet exhibits…
▽ More
To mimic the motion of biological swimmers in bodily fluids, a novel experimental system of micellar solubilization driven active droplets in a visco-elastic polymeric solution is presented. The visco-elastic nature of the medium, characterized by the Deborah number (De), is tuned by varying the surfactant (fuel) and polymer concentration in the ambient medium. At moderate De, the droplet exhibits a steady deformed shape, markedly different from the spherical shape observed in Newtonian media. A theoretical analysis based on the normal stress balance at the interface is shown to accurately predict the droplet shape. With a further increase in De, time-periodic deformations accompanied by oscillatory transitions in swimming modes are observed. The study unveils the rich complexity in the motion of active droplets in viscoelastic fluids, which has been hitherto unexplored.
△ Less
Submitted 28 September, 2022;
originally announced September 2022.
-
Alexa, Let's Work Together: Introducing the First Alexa Prize TaskBot Challenge on Conversational Task Assistance
Authors:
Anna Gottardi,
Osman Ipek,
Giuseppe Castellucci,
Shui Hu,
Lavina Vaz,
Yao Lu,
Anju Khatri,
Anjali Chadha,
Desheng Zhang,
Sattvik Sahai,
Prerna Dwivedi,
Hangjie Shi,
Lucy Hu,
Andy Huang,
Luke Dai,
Bofei Yang,
Varun Somani,
Pankaj Rajan,
Ron Rezac,
Michael Johnston,
Savanna Stiff,
Leslie Ball,
David Carmel,
Yang Liu,
Dilek Hakkani-Tur
, et al. (5 additional authors not shown)
Abstract:
Since its inception in 2016, the Alexa Prize program has enabled hundreds of university students to explore and compete to develop conversational agents through the SocialBot Grand Challenge. The goal of the challenge is to build agents capable of conversing coherently and engagingly with humans on popular topics for 20 minutes, while achieving an average rating of at least 4.0/5.0. However, as co…
▽ More
Since its inception in 2016, the Alexa Prize program has enabled hundreds of university students to explore and compete to develop conversational agents through the SocialBot Grand Challenge. The goal of the challenge is to build agents capable of conversing coherently and engagingly with humans on popular topics for 20 minutes, while achieving an average rating of at least 4.0/5.0. However, as conversational agents attempt to assist users with increasingly complex tasks, new conversational AI techniques and evaluation platforms are needed. The Alexa Prize TaskBot challenge, established in 2021, builds on the success of the SocialBot challenge by introducing the requirements of interactively assisting humans with real-world Cooking and Do-It-Yourself tasks, while making use of both voice and visual modalities. This challenge requires the TaskBots to identify and understand the user's need, identify and integrate task and domain knowledge into the interaction, and develop new ways of engaging the user without distracting them from the task at hand, among other challenges. This paper provides an overview of the TaskBot challenge, describes the infrastructure support provided to the teams with the CoBot Toolkit, and summarizes the approaches the participating teams took to overcome the research challenges. Finally, it analyzes the performance of the competing TaskBots during the first year of the competition.
△ Less
Submitted 13 September, 2022;
originally announced September 2022.
-
Mode-Switching of Active Droplets in Macromolecular Solutions
Authors:
Prateek Dwivedi,
Atishay Shrivastava,
Dipin Pillai,
Rahul Mangal
Abstract:
Typical bodily and environmental fluids encountered by biological swimmers consist of dissolved macromolecules such as proteins and polymers, often rendering them non Newtonian. To mimic such scenarios, we investigate the motion of swimming droplets in an ambient medium doped with polymers as macromolecular solutes. Active droplets mimic the essential propulsive characteristics of several biologic…
▽ More
Typical bodily and environmental fluids encountered by biological swimmers consist of dissolved macromolecules such as proteins and polymers, often rendering them non Newtonian. To mimic such scenarios, we investigate the motion of swimming droplets in an ambient medium doped with polymers as macromolecular solutes. Active droplets mimic the essential propulsive characteristics of several biological swimmers and serve as ideal model systems to widen our understanding of their locomotive strategies. Our experiments reveal extreme sensitivity of droplet motion to the presence of macromolecular solutes in the ambient medium. Through in-situ visualization of the self-generated chemical field around the droplet, we report unexpectedly high diffusivity of filled micelles in the presence of high molecular weight polymer solutes or macromolecules. This is attributed to the limitation of Stokes-Einstein relationship in accurately predicting micelle diffusivity due to significant size disparity between micelles and the macromolecular solute. With an increase in polymer concentration, particle image velocimetry reveals a mode-switching, from the conventional pusher mode to a puller mode of propulsion, characterized by a more persistent droplet motion. With a further increase in concentration, a secondary transition from smooth to a jittery mode of propulsion occurs. A robust Peclet number framework is proposed that successfully captures the observed mode-switching of active droplets. Our experiments unveil a novel route to orchestrate complex transitions in active droplet propulsion by doping the ambient medium with suitable choice of macromolecules.
△ Less
Submitted 31 October, 2022; v1 submitted 27 July, 2022;
originally announced July 2022.
-
Long Range Graph Benchmark
Authors:
Vijay Prakash Dwivedi,
Ladislav Rampášek,
Mikhail Galkin,
Ali Parviz,
Guy Wolf,
Anh Tuan Luu,
Dominique Beaini
Abstract:
Graph Neural Networks (GNNs) that are based on the message passing (MP) paradigm generally exchange information between 1-hop neighbors to build node representations at each layer. In principle, such networks are not able to capture long-range interactions (LRI) that may be desired or necessary for learning a given task on graphs. Recently, there has been an increasing interest in development of T…
▽ More
Graph Neural Networks (GNNs) that are based on the message passing (MP) paradigm generally exchange information between 1-hop neighbors to build node representations at each layer. In principle, such networks are not able to capture long-range interactions (LRI) that may be desired or necessary for learning a given task on graphs. Recently, there has been an increasing interest in development of Transformer-based methods for graphs that can consider full node connectivity beyond the original sparse structure, thus enabling the modeling of LRI. However, MP-GNNs that simply rely on 1-hop message passing often fare better in several existing graph benchmarks when combined with positional feature representations, among other innovations, hence limiting the perceived utility and ranking of Transformer-like architectures. Here, we present the Long Range Graph Benchmark (LRGB) with 5 graph learning datasets: PascalVOC-SP, COCO-SP, PCQM-Contact, Peptides-func and Peptides-struct that arguably require LRI reasoning to achieve strong performance in a given task. We benchmark both baseline GNNs and Graph Transformer networks to verify that the models which capture long-range dependencies perform significantly better on these tasks. Therefore, these datasets are suitable for benchmarking and exploration of MP-GNNs and Graph Transformer architectures that are intended to capture LRI.
△ Less
Submitted 28 November, 2023; v1 submitted 16 June, 2022;
originally announced June 2022.
-
Recipe for a General, Powerful, Scalable Graph Transformer
Authors:
Ladislav Rampášek,
Mikhail Galkin,
Vijay Prakash Dwivedi,
Anh Tuan Luu,
Guy Wolf,
Dominique Beaini
Abstract:
We propose a recipe on how to build a general, powerful, scalable (GPS) graph Transformer with linear complexity and state-of-the-art results on a diverse set of benchmarks. Graph Transformers (GTs) have gained popularity in the field of graph representation learning with a variety of recent publications but they lack a common foundation about what constitutes a good positional or structural encod…
▽ More
We propose a recipe on how to build a general, powerful, scalable (GPS) graph Transformer with linear complexity and state-of-the-art results on a diverse set of benchmarks. Graph Transformers (GTs) have gained popularity in the field of graph representation learning with a variety of recent publications but they lack a common foundation about what constitutes a good positional or structural encoding, and what differentiates them. In this paper, we summarize the different types of encodings with a clearer definition and categorize them as being $\textit{local}$, $\textit{global}$ or $\textit{relative}$. The prior GTs are constrained to small graphs with a few hundred nodes, here we propose the first architecture with a complexity linear in the number of nodes and edges $O(N+E)$ by decoupling the local real-edge aggregation from the fully-connected Transformer. We argue that this decoupling does not negatively affect the expressivity, with our architecture being a universal function approximator on graphs. Our GPS recipe consists of choosing 3 main ingredients: (i) positional/structural encoding, (ii) local message-passing mechanism, and (iii) global attention mechanism. We provide a modular framework $\textit{GraphGPS}$ that supports multiple types of encodings and that provides efficiency and scalability both in small and large graphs. We test our architecture on 16 benchmarks and show highly competitive results in all of them, show-casing the empirical benefits gained by the modularity and the combination of different strategies.
△ Less
Submitted 15 January, 2023; v1 submitted 24 May, 2022;
originally announced May 2022.
-
Inexact Graph Matching Using Centrality Measures
Authors:
Shri Prakash Dwivedi
Abstract:
Graph matching is the process of computing the similarity between two graphs. Depending on the requirement, it can be exact or inexact. Exact graph matching requires a strict correspondence between nodes of two graphs, whereas inexact matching allows some flexibility or tolerance during the graph matching. In this chapter, we describe an approximate inexact graph matching by reducing the size of t…
▽ More
Graph matching is the process of computing the similarity between two graphs. Depending on the requirement, it can be exact or inexact. Exact graph matching requires a strict correspondence between nodes of two graphs, whereas inexact matching allows some flexibility or tolerance during the graph matching. In this chapter, we describe an approximate inexact graph matching by reducing the size of the graphs using different centrality measures. Experimental evaluation shows that it can reduce running time for inexact graph matching.
△ Less
Submitted 31 December, 2021;
originally announced January 2022.
-
Graph Neural Networks with Learnable Structural and Positional Representations
Authors:
Vijay Prakash Dwivedi,
Anh Tuan Luu,
Thomas Laurent,
Yoshua Bengio,
Xavier Bresson
Abstract:
Graph neural networks (GNNs) have become the standard learning architectures for graphs. GNNs have been applied to numerous domains ranging from quantum chemistry, recommender systems to knowledge graphs and natural language processing. A major issue with arbitrary graphs is the absence of canonical positional information of nodes, which decreases the representation power of GNNs to distinguish e.…
▽ More
Graph neural networks (GNNs) have become the standard learning architectures for graphs. GNNs have been applied to numerous domains ranging from quantum chemistry, recommender systems to knowledge graphs and natural language processing. A major issue with arbitrary graphs is the absence of canonical positional information of nodes, which decreases the representation power of GNNs to distinguish e.g. isomorphic nodes and other graph symmetries. An approach to tackle this issue is to introduce Positional Encoding (PE) of nodes, and inject it into the input layer, like in Transformers. Possible graph PE are Laplacian eigenvectors. In this work, we propose to decouple structural and positional representations to make easy for the network to learn these two essential properties. We introduce a novel generic architecture which we call LSPE (Learnable Structural and Positional Encodings). We investigate several sparse and fully-connected (Transformer-like) GNNs, and observe a performance increase for molecular datasets, from 1.79% up to 64.14% when considering learnable PE for both GNN classes.
△ Less
Submitted 10 February, 2022; v1 submitted 15 October, 2021;
originally announced October 2021.
-
Na$_{4}$Co$_{3}$(PO$_{4}$)$_{2}$P$_{2}$O$_{7}$/NC composite as a negative electrode for sodium-ion batteries
Authors:
Pravin K. Dwivedi,
Simranjot K. Sapra,
Jayashree Pati,
Rajendra S. Dhaka
Abstract:
In recent years, the mixed phosphates based polyanionic electrode materials have attracted great attention in sodium-ion batteries due to their structural stability during cycling and open framework for ion diffusion. Here, we report the electrochemical performance of Na$_{4}$Co$_{3}$(PO$_{4}$)$_{2}$P$_{2}$O$_{7}$/nitrogen doped carbon (NCPP/NC) composite as a negative electrode (anode) for sodium…
▽ More
In recent years, the mixed phosphates based polyanionic electrode materials have attracted great attention in sodium-ion batteries due to their structural stability during cycling and open framework for ion diffusion. Here, we report the electrochemical performance of Na$_{4}$Co$_{3}$(PO$_{4}$)$_{2}$P$_{2}$O$_{7}$/nitrogen doped carbon (NCPP/NC) composite as a negative electrode (anode) for sodium ion batteries in the working potential range of 0.01--3.0~V. It delivers a reversible discharge capacity of 250~mAhg$^{-1}$ at 0.5~C current rate, which corresponds to the insertion/extraction of four sodium ions. The rate capability study indicates the reversible mechanism and highly stable capacity (61 mAhg$^{-1}$) even at high rate up to 5~C as compared to pristine NCPP. The incorporation of the N doped carbon spheres in the composite is expected to enhance the electronic/ionic conductivity, which plays an important role in improving the performance and stability up to 400 cycles at 1~C rate. Intriguingly, the analysis of cyclic voltammetry data measured at different scan rates confirm the capacitive/diffusive controlled mechanism and the extracted diffusion coefficient is found to be around 10$^{-10}$ cm$^2$s$^{-1}$. Our results demonstrate that the NCPP/NC composite is also a potential candidate as anode in sodium-ion batteries due to its three dimensional framework, cost effectiveness, enhanced specific capacity as well as further possibility of improving the stability.
△ Less
Submitted 20 July, 2021;
originally announced July 2021.
-
Interaction of Active Janus Particles with Passive Tracers
Authors:
Karnika Singh,
Ankit Yadav,
Prateek Dwivedi,
Rahul Mangal
Abstract:
In this study, we investigated the motion of active SiO2-Pt Janus particles in the 2D bath of smaller silica tracers dispersed in varying areal densities. The effect on the organization of the tracer particles around the active JPs was also explored. Our experiments indicate that the interaction between the tracers and the active JPs mainly depend on the nature of collision marked by the duration…
▽ More
In this study, we investigated the motion of active SiO2-Pt Janus particles in the 2D bath of smaller silica tracers dispersed in varying areal densities. The effect on the organization of the tracer particles around the active JPs was also explored. Our experiments indicate that the interaction between the tracers and the active JPs mainly depend on the nature of collision marked by the duration of contact. For all the concentration regimes, we have shown that the short time collisions do not have significant impact on the motion of active JPs, however, during moderate/long-time collisions tracer(s) can lead to a significant change in active JPs motion and even cause them to rotate. In the concentrated regime, our experiments reveal the emergence of a novel organizational behavior of the passive tracers on the trailing Pt and the leading SiO2 with a strong dependence on the nature of collision.
△ Less
Submitted 7 July, 2021;
originally announced July 2021.
-
Rheotaxis of Active Droplets
Authors:
Prateek Dwivedi,
Atishay Shrivastava,
Dipin Pillai,
Rahul Mangal
Abstract:
Rheotaxis is a well-known phenomenon among microbial organisms and artificial active colloids, wherein the swimmers respond to an imposed flow. We report the first experimental evidence of upstream rheotaxis by spherical active droplets. It is shown that the presence of a nearby wall and the resulting strong flow-gradient at the droplet level is at the root of this phenomenon. Experiments with opt…
▽ More
Rheotaxis is a well-known phenomenon among microbial organisms and artificial active colloids, wherein the swimmers respond to an imposed flow. We report the first experimental evidence of upstream rheotaxis by spherical active droplets. It is shown that the presence of a nearby wall and the resulting strong flow-gradient at the droplet level is at the root of this phenomenon. Experiments with optical cells of different heights reveal that rheotaxis is observed only for a finite range of shear rates, independent of the bulk flow-rate. We conjecture that the flow induced distortion of an otherwise isotropic distribution of filled/empty micelles around the droplet propels it against the flow. We also show that nematic droplets exhibit elastic stress-induced oscillations during their rheotactic flight. A promising potential of manipulating the rheotactic behavior to trap as well as shuttle droplets between target locations is demonstrated, paving way to potentially significant advancement in bio-medical applications.
△ Less
Submitted 4 August, 2021; v1 submitted 2 June, 2021;
originally announced June 2021.
-
Prime numbers and random walks in a square grid
Authors:
Alberto Fraile,
Osame Kinouchi,
Prashant Dwivedi,
Roberto Martínez,
Theophanes E. Raptis,
Daniel Fernández
Abstract:
In recent years, computer simulations are playing a fundamental role in unveiling some of the most intriguing features of prime numbers. In this work, we define an algorithm for a deterministic walk through a two-dimensional grid that we refer to as Prime Walk. The walk is constructed from a sequence of steps dictated by and dependent on the sequence of last digits of the primes. Despite the appar…
▽ More
In recent years, computer simulations are playing a fundamental role in unveiling some of the most intriguing features of prime numbers. In this work, we define an algorithm for a deterministic walk through a two-dimensional grid that we refer to as Prime Walk. The walk is constructed from a sequence of steps dictated by and dependent on the sequence of last digits of the primes. Despite the apparent randomness of this generating sequence, the resulting structure -- both in 2d and 3d -- created by the algorithm presents remarkable properties and regularities in its pattern that we proceed to analyze in detail.
△ Less
Submitted 26 May, 2021;
originally announced May 2021.
-
Some Algorithms on Exact, Approximate and Error-Tolerant Graph Matching
Authors:
Shri Prakash Dwivedi
Abstract:
The graph is one of the most widely used mathematical structures in engineering and science because of its representational power and inherent ability to demonstrate the relationship between objects. The objective of this work is to introduce the novel graph matching techniques using the representational power of the graph and apply it to structural pattern recognition applications. We present an…
▽ More
The graph is one of the most widely used mathematical structures in engineering and science because of its representational power and inherent ability to demonstrate the relationship between objects. The objective of this work is to introduce the novel graph matching techniques using the representational power of the graph and apply it to structural pattern recognition applications. We present an extensive survey of various exact and inexact graph matching techniques. Graph matching using the concept of homeomorphism is presented. A category of graph matching algorithms is presented, which reduces the graph size by removing the less important nodes using some measure of relevance. We present an approach to error-tolerant graph matching using node contraction where the given graph is transformed into another graph by contracting smaller degree nodes. We use this scheme to extend the notion of graph edit distance, which can be used as a trade-off between execution time and accuracy. We describe an approach to graph matching by utilizing the various node centrality information, which reduces the graph size by removing a fraction of nodes from both graphs based on a given centrality measure. The graph matching problem is inherently linked to the geometry and topology of graphs. We introduce a novel approach to measure graph similarity using geometric graphs. We define the vertex distance between two geometric graphs using the position of their vertices and show it to be a metric over the set of all graphs with vertices only. We define edge distance between two graphs based on the angular orientation, length and position of the edges. Then we combine the notion of vertex distance and edge distance to define the graph distance between two geometric graphs and show it to be a metric. Finally, we use the proposed graph similarity framework to perform exact and error-tolerant graph matching.
△ Less
Submitted 30 December, 2020;
originally announced December 2020.
-
A Generalization of Transformer Networks to Graphs
Authors:
Vijay Prakash Dwivedi,
Xavier Bresson
Abstract:
We propose a generalization of transformer neural network architecture for arbitrary graphs. The original transformer was designed for Natural Language Processing (NLP), which operates on fully connected graphs representing all connections between the words in a sequence. Such architecture does not leverage the graph connectivity inductive bias, and can perform poorly when the graph topology is im…
▽ More
We propose a generalization of transformer neural network architecture for arbitrary graphs. The original transformer was designed for Natural Language Processing (NLP), which operates on fully connected graphs representing all connections between the words in a sequence. Such architecture does not leverage the graph connectivity inductive bias, and can perform poorly when the graph topology is important and has not been encoded into the node features. We introduce a graph transformer with four new properties compared to the standard model. First, the attention mechanism is a function of the neighborhood connectivity for each node in the graph. Second, the positional encoding is represented by the Laplacian eigenvectors, which naturally generalize the sinusoidal positional encodings often used in NLP. Third, the layer normalization is replaced by a batch normalization layer, which provides faster training and better generalization performance. Finally, the architecture is extended to edge feature representation, which can be critical to tasks s.a. chemistry (bond type) or link prediction (entity relationship in knowledge graphs). Numerical experiments on a graph benchmark demonstrate the performance of the proposed graph transformer architecture. This work closes the gap between the original transformer, which was designed for the limited case of line graphs, and graph neural networks, that can work with arbitrary graphs. As our architecture is simple and generic, we believe it can be used as a black box for future applications that wish to consider transformer and graphs.
△ Less
Submitted 24 January, 2021; v1 submitted 17 December, 2020;
originally announced December 2020.
-
Solute Induced Jittery Motion of Self-Propelled Droplets
Authors:
Prateek Dwivedi,
Bishwa Ranjan Si,
Dipin S. Pillai,
Rahul Mangal
Abstract:
The intriguing role of the presence of solutes in the activity of a self-propelling droplet is investigated. A system of self-propelling micron sized 4-pentyl-4-biphenylcarbonitrile (5CB) droplets in an aqueous solution of tetradecyltrimethylammonium bromide (TTAB) as surfactant is considered. It is shown that addition of glycerol causes the active 5CB droplet to exhibit a transition from smooth t…
▽ More
The intriguing role of the presence of solutes in the activity of a self-propelling droplet is investigated. A system of self-propelling micron sized 4-pentyl-4-biphenylcarbonitrile (5CB) droplets in an aqueous solution of tetradecyltrimethylammonium bromide (TTAB) as surfactant is considered. It is shown that addition of glycerol causes the active 5CB droplet to exhibit a transition from smooth to jittery motion. The motion is found to be independent of the droplet size and the nematic state of 5CB. Analogous experiments with Polyacrylamide (PAAm), Polyvinylpyrrolidone (PVP) and Polyvinyl Alcohol (PVA), as solutes confirm that such a transition cannot merely be explained solely based on the viscosity or Peclet number of the system. We propose that the specific nature of physicochemical interactions between the solute and the droplet interface is at the root of this transition. The experiments show that the time-scales associated with the influx and redistribution of surfactants at the interface are altered in the presence of solutes. Glycerol and PVP significantly enhance the rate of solubilization of the 5CB droplets resulting in a quicker re-distribution of the adsorbed TTAB molecules on the interface, causing the droplet to momentarily stop and then restart in an independent direction. On the other hand, low solubilization rates in the presence of PAAm and PVA lead to smooth trajectories. Our hypothesis is supported by the time evolution of droplet size and interfacial velocity measurements in the presence and absence of solute. Overall, our results provide fundamental insights into the complex interactions emerging due to the presence of solutes.
△ Less
Submitted 20 November, 2020; v1 submitted 24 July, 2020;
originally announced July 2020.
-
Data augmentation enhanced speaker enrollment for text-dependent speaker verification
Authors:
Achintya Kumar Sarkar,
Himangshu Sarma,
Priyanka Dwivedi,
Zheng-Hua Tan
Abstract:
Data augmentation is commonly used for generating additional data from the available training data to achieve a robust estimation of the parameters of complex models like the one for speaker verification (SV), especially for under-resourced applications. SV involves training speaker-independent (SI) models and speaker-dependent models where speakers are represented by models derived from an SI mod…
▽ More
Data augmentation is commonly used for generating additional data from the available training data to achieve a robust estimation of the parameters of complex models like the one for speaker verification (SV), especially for under-resourced applications. SV involves training speaker-independent (SI) models and speaker-dependent models where speakers are represented by models derived from an SI model using the training data for the particular speaker during the enrollment phase. While data augmentation for training SI models is well studied, data augmentation for speaker enrollment is rarely explored. In this paper, we propose the use of data augmentation methods for generating extra data to empower speaker enrollment. Each data augmentation method generates a new data set. Two strategies of using the data sets are explored: the first one is to training separate systems and fuses them at the score level and the other is to conduct multi-conditional training. Furthermore, we study the effect of data augmentation under noisy conditions. Experiments are performed on RedDots challenge 2016 database, and the results validate the effectiveness of the proposed methods.
△ Less
Submitted 12 July, 2020;
originally announced July 2020.
-
Benchmarking Graph Neural Networks
Authors:
Vijay Prakash Dwivedi,
Chaitanya K. Joshi,
Anh Tuan Luu,
Thomas Laurent,
Yoshua Bengio,
Xavier Bresson
Abstract:
In the last few years, graph neural networks (GNNs) have become the standard toolkit for analyzing and learning from data on graphs. This emerging field has witnessed an extensive growth of promising techniques that have been applied with success to computer science, mathematics, biology, physics and chemistry. But for any successful field to become mainstream and reliable, benchmarks must be deve…
▽ More
In the last few years, graph neural networks (GNNs) have become the standard toolkit for analyzing and learning from data on graphs. This emerging field has witnessed an extensive growth of promising techniques that have been applied with success to computer science, mathematics, biology, physics and chemistry. But for any successful field to become mainstream and reliable, benchmarks must be developed to quantify progress. This led us in March 2020 to release a benchmark framework that i) comprises of a diverse collection of mathematical and real-world graphs, ii) enables fair model comparison with the same parameter budget to identify key architectures, iii) has an open-source, easy-to-use and reproducible code infrastructure, and iv) is flexible for researchers to experiment with new theoretical ideas. As of December 2022, the GitHub repository has reached 2,000 stars and 380 forks, which demonstrates the utility of the proposed open-source framework through the wide usage by the GNN community. In this paper, we present an updated version of our benchmark with a concise presentation of the aforementioned framework characteristics, an additional medium-sized molecular dataset AQSOL, similar to the popular ZINC, but with a real-world measured chemical target, and discuss how this framework can be leveraged to explore new GNN designs and insights. As a proof of value of our benchmark, we study the case of graph positional encoding (PE) in GNNs, which was introduced with this benchmark and has since spurred interest of exploring more powerful PE for Transformers and GNNs in a robust experimental setting.
△ Less
Submitted 27 December, 2022; v1 submitted 2 March, 2020;
originally announced March 2020.
-
A Charge Density Wave-like Transition in High Temperature Quenched $Bi_2Se_3$
Authors:
Yanan Li,
Christian Parsons,
Sanath Kumar Ramakrishna,
Anand Prashant Dwivedi,
Marvin A. Schofield,
Arneil P. Reyes,
Prasenjit Guptasarma
Abstract:
Hexagonally deformed Fermi surfaces and strong nesting, found in topological insulators (TIs) such as $Bi_2Se_3$ and $Bi_2Te_3$, have led to several predictions of the existence of Density Wave order in these systems. Recent evidence for strong Fermi surface nesting in superconducting $Cu-Bi_2Se_3$ and $Nb-Bi_2Se_3$ has further led to speculation about the importance of charge order in the context…
▽ More
Hexagonally deformed Fermi surfaces and strong nesting, found in topological insulators (TIs) such as $Bi_2Se_3$ and $Bi_2Te_3$, have led to several predictions of the existence of Density Wave order in these systems. Recent evidence for strong Fermi surface nesting in superconducting $Cu-Bi_2Se_3$ and $Nb-Bi_2Se_3$ has further led to speculation about the importance of charge order in the context of unconventional superconductivity. Here, we report the first observation of a novel anomaly in $Bi_2Se_3$ at 140K, which may be associated with a Charge Density Wave (CDW)-like transition. This transition was identified from both structural and electronic measurements, where: a) a periodic lattice distortion at above room temperature was characterized as a diffuse charge order in $Bi_2Se_3$ between \vec{k} and \vec{k}\pm\mathrmΔ\vec{k} from electron diffraction; and b) an opening of energy gap signatured with metal-to-insulator like transition at 140K was identified from resistivity vs temperature measurement. This is further corroborated by nuclear magnetic resonance (NMR) studies of the spin-lattice relaxation ( $\frac{1}{T_1}$) rate of the $^{209}Bi$ nucleus, which also displays a transition at 140K associated with an opening of an energy gap of ~8meV. Additionally, we also observe another anomaly in $\frac{1}{T_1}$ near 200K, which appears to display anisotropy with the direction of the applied magnetic field.
△ Less
Submitted 6 February, 2023; v1 submitted 28 February, 2020;
originally announced February 2020.
-
Table-top NMR system for high-pressure studies with in-situ laser heating
Authors:
Thomas Meier,
Anand Prashant Dwivedi,
Saiana Khandarkhaeva,
Timofey Fedotenko,
Natalia Dubrovinskaia,
Leonid Dubrovinsky
Abstract:
High pressure Nuclear Magnetic Resonance (NMR) is known to uncover behavior of matter at extreme conditions. However, significant maintenance demands, space requirements and high costs of superconducting magnets render its application unfeasible for regular modern high pressure laboratories. Here, we present a table-top NMR system based on permanent Halbach magnet arrays with dimensions of 25 cm d…
▽ More
High pressure Nuclear Magnetic Resonance (NMR) is known to uncover behavior of matter at extreme conditions. However, significant maintenance demands, space requirements and high costs of superconducting magnets render its application unfeasible for regular modern high pressure laboratories. Here, we present a table-top NMR system based on permanent Halbach magnet arrays with dimensions of 25 cm diameter and 4 cm height. At the highest field of 1013 mT, 1H-NMR spectra of Ice VII have been recorded at 25 GPa and ambient temperature. The table-top NMR system can be used together with double sided laser heating set-ups. Feasibility of high-pressure high-temperature NMR was demonstrated by collecting 1H-NMR spectra of H2O at 25 GPa and 1063(50) K. We found that the change in signal intensity in laser-heated NMR diamond anvil cell yields a convenient way for temperature measurements.
△ Less
Submitted 20 September, 2019;
originally announced September 2019.
-
Lateral position correction in ptychography with sub-pixel accuracy
Authors:
P. Dwivedi,
A. P. Konijnenberg,
S. F. Pereira,
H. P. Urbach
Abstract:
Ptychography, a form of Coherent Diffractive Imaging, is used with short wavelengths (e.g. X-rays, electron beams) to achieve high-resolution image reconstructions. One of the limiting factors for the reconstruction quality is the accurate knowledge of the illumination probe positions. Recently, many advances have been made to relax the requirement for the probe positions accuracy. Here, we analyz…
▽ More
Ptychography, a form of Coherent Diffractive Imaging, is used with short wavelengths (e.g. X-rays, electron beams) to achieve high-resolution image reconstructions. One of the limiting factors for the reconstruction quality is the accurate knowledge of the illumination probe positions. Recently, many advances have been made to relax the requirement for the probe positions accuracy. Here, we analyze and demonstrate a straightforward approach that can be used to correct the probe positions with sub-pixel accuracy. Simulations and experimental results with visible light are presented in this work.
△ Less
Submitted 29 March, 2018;
originally announced March 2018.
-
Tell Me Why Is It So? Explaining Knowledge Graph Relationships by Finding Descriptive Support Passages
Authors:
Sumit Bhatia,
Purusharth Dwivedi,
Avneet Kaur
Abstract:
We address the problem of finding descriptive explanations of facts stored in a knowledge graph. This is important in high-risk domains such as healthcare, intelligence, etc. where users need additional information for decision making and is especially crucial for applications that rely on automatically constructed knowledge bases where machine learned systems extract facts from an input corpus an…
▽ More
We address the problem of finding descriptive explanations of facts stored in a knowledge graph. This is important in high-risk domains such as healthcare, intelligence, etc. where users need additional information for decision making and is especially crucial for applications that rely on automatically constructed knowledge bases where machine learned systems extract facts from an input corpus and working of the extractors is opaque to the end-user. We follow an approach inspired from information retrieval and propose a simple and efficient, yet effective solution that takes into account passage level as well as document level properties to produce a ranked list of passages describing a given input relation. We test our approach using Wikidata as the knowledge base and Wikipedia as the source corpus and report results of user studies conducted to study the effectiveness of our proposed model.
△ Less
Submitted 17 March, 2018;
originally announced March 2018.
-
Computing Multiplicative Order and Primitive Root in Finite Cyclic Group
Authors:
Shri Prakash Dwivedi
Abstract:
Multiplicative order of an element $a$ of group $G$ is the least positive integer $n$ such that $a^n=e$, where $e$ is the identity element of $G$. If the order of an element is equal to $|G|$, it is called generator or primitive root. This paper describes the algorithms for computing multiplicative order and primitive root in $\mathbb{Z}^*_{p}$, we also present a logarithmic improvement over class…
▽ More
Multiplicative order of an element $a$ of group $G$ is the least positive integer $n$ such that $a^n=e$, where $e$ is the identity element of $G$. If the order of an element is equal to $|G|$, it is called generator or primitive root. This paper describes the algorithms for computing multiplicative order and primitive root in $\mathbb{Z}^*_{p}$, we also present a logarithmic improvement over classical algorithms.
△ Less
Submitted 21 August, 2014;
originally announced August 2014.
-
GCD Computation of n Integers
Authors:
Shri Prakash Dwivedi
Abstract:
Greatest Common Divisor (GCD) computation is one of the most important operation of algorithmic number theory. In this paper we present the algorithms for GCD computation of $n$ integers. We extend the Euclid's algorithm and binary GCD algorithm to compute the GCD of more than two integers.
Greatest Common Divisor (GCD) computation is one of the most important operation of algorithmic number theory. In this paper we present the algorithms for GCD computation of $n$ integers. We extend the Euclid's algorithm and binary GCD algorithm to compute the GCD of more than two integers.
△ Less
Submitted 25 July, 2014;
originally announced July 2014.
-
An Efficient Multiplication Algorithm Using Nikhilam Method
Authors:
Shri Prakash Dwivedi
Abstract:
Multiplication is one of the most important operation in computer arithmetic. Many integer operations such as squaring, division and computing reciprocal require same order of time as multiplication whereas some other operations such as computing GCD and residue operation require at most a factor of $\log n$ time more than multiplication. We propose an integer multiplication algorithm using Nikhil…
▽ More
Multiplication is one of the most important operation in computer arithmetic. Many integer operations such as squaring, division and computing reciprocal require same order of time as multiplication whereas some other operations such as computing GCD and residue operation require at most a factor of $\log n$ time more than multiplication. We propose an integer multiplication algorithm using Nikhilam method of Vedic mathematics which can be used to multiply two binary numbers efficiently.
△ Less
Submitted 10 July, 2013;
originally announced July 2013.
-
Adaptive Scheduling in Real-Time Systems Through Period Adjustment
Authors:
Shri Prakash Dwivedi
Abstract:
Real time system technology traditionally developed for safety critical systems, has now been extended to support multimedia systems and virtual reality. A large number of real-time application, related to multimedia and adaptive control system, require more flexibility than classical real-time theory usually permits. This paper proposes an efficient adaptive scheduling framework in real-time syst…
▽ More
Real time system technology traditionally developed for safety critical systems, has now been extended to support multimedia systems and virtual reality. A large number of real-time application, related to multimedia and adaptive control system, require more flexibility than classical real-time theory usually permits. This paper proposes an efficient adaptive scheduling framework in real-time systems based on period adjustment. Under this model periodic task can change their execution rates based on their importance value to keep the system underloaded. We propose Period_Adjust algorithm, which consider the tasks whose periods are bounded as well as the tasks whose periods are not bounded.
△ Less
Submitted 14 December, 2012;
originally announced December 2012.
-
Structural/microstructural, optical and electrical investigations of Sb-SnO2 thin films deposited by spray pyrolysis
Authors:
Sushant Gupta,
B. C. Yadav,
Prabhat K. Dwivedi,
B. Das
Abstract:
The structural, optical and electrical properties of spray deposited antimony (Sb) doped tin oxide (SnO2) thin films, prepared from SnCl4 precursor, have been studied as a function of antimony doping concentration. The doping concentration was varied from 0 to 1.5 wt.% of Sb. The analysis of x-ray diffraction patterns revealed that the as deposited doped and undoped tin oxide thin films are pure c…
▽ More
The structural, optical and electrical properties of spray deposited antimony (Sb) doped tin oxide (SnO2) thin films, prepared from SnCl4 precursor, have been studied as a function of antimony doping concentration. The doping concentration was varied from 0 to 1.5 wt.% of Sb. The analysis of x-ray diffraction patterns revealed that the as deposited doped and undoped tin oxide thin films are pure crystalline tetragonal rutile phase of tin oxide which belongs to the space group P42/mnm (number 136). The surface morphological examination with field emission scanning electron microscopy (FESEM) revealed the fact that the grains are closely packed and pores/voids between the grains are very few. The transmittance spectra for as-deposited films were recorded in the wavelength range of 200 to 1000 nm. The transmittance of the films was observed to increase from 57% to 68% (at 800 nm) on initial addition of Sb (up to [Sb]/[Sn] = 0.5 wt.%) and then it is decreased for higher level of antimony doping ([Sb]/[Sn] > 0.5 wt.%). The sheet resistance of tin oxide films was found to decrease from 48 Ω/sq for undoped films to 8 Ω/sq for antimony doped films.
△ Less
Submitted 18 August, 2012;
originally announced August 2012.