Showing 1–29 of 29 results for author: Faisal, F

Data-Augmentation-Based Dialectal Adaptation for LLMs

Authors: Fahim Faisal, Antonios Anastasopoulos

Abstract: This report presents GMUNLP's participation to the Dialect-Copa shared task at VarDial 2024, which focuses on evaluating the commonsense reasoning capabilities of large language models (LLMs) on South Slavic micro-dialects. The task aims to assess how well LLMs can handle non-standard dialectal varieties, as their performance on standard languages is already well-established. We propose an approac… ▽ More This report presents GMUNLP's participation to the Dialect-Copa shared task at VarDial 2024, which focuses on evaluating the commonsense reasoning capabilities of large language models (LLMs) on South Slavic micro-dialects. The task aims to assess how well LLMs can handle non-standard dialectal varieties, as their performance on standard languages is already well-established. We propose an approach that combines the strengths of different types of language models and leverages data augmentation techniques to improve task performance on three South Slavic dialects: Chakavian, Cherkano, and Torlak. We conduct experiments using a language-family-focused encoder-based model (BERTić) and a domain-agnostic multilingual model (AYA-101). Our results demonstrate that the proposed data augmentation techniques lead to substantial performance gains across all three test datasets in the open-source model category. This work highlights the practical utility of data augmentation and the potential of LLMs in handling non-standard dialectal varieties, contributing to the broader goal of advancing natural language understanding in low-resource and dialectal settings. Code:https://github.com/ffaisal93/dialect_copa △ Less

Submitted 11 April, 2024; originally announced April 2024.

An Efficient Approach for Studying Cross-Lingual Transfer in Multilingual Language Models

Authors: Fahim Faisal, Antonios Anastasopoulos

Abstract: The capacity and effectiveness of pre-trained multilingual models (MLMs) for zero-shot cross-lingual transfer is well established. However, phenomena of positive or negative transfer, and the effect of language choice still need to be fully understood, especially in the complex setting of massively multilingual LMs. We propose an \textit{efficient} method to study transfer language influence in ze… ▽ More The capacity and effectiveness of pre-trained multilingual models (MLMs) for zero-shot cross-lingual transfer is well established. However, phenomena of positive or negative transfer, and the effect of language choice still need to be fully understood, especially in the complex setting of massively multilingual LMs. We propose an \textit{efficient} method to study transfer language influence in zero-shot performance on another target language. Unlike previous work, our approach disentangles downstream tasks from language, using dedicated adapter units. Our findings suggest that some languages do not largely affect others, while some languages, especially ones unseen during pre-training, can be extremely beneficial or detrimental for different target languages. We find that no transfer language is beneficial for all target languages. We do, curiously, observe languages previously unseen by MLMs consistently benefit from transfer from almost any language. We additionally use our modular approach to quantify negative interference efficiently and categorize languages accordingly. Furthermore, we provide a list of promising transfer-target language configurations that consistently lead to target language performance improvements. Code and data are publicly available: https://github.com/ffaisal93/neg_inf △ Less

Submitted 29 March, 2024; originally announced March 2024.

DIALECTBENCH: A NLP Benchmark for Dialects, Varieties, and Closely-Related Languages

Authors: Fahim Faisal, Orevaoghene Ahia, Aarohi Srivastava, Kabir Ahuja, David Chiang, Yulia Tsvetkov, Antonios Anastasopoulos

Abstract: Language technologies should be judged on their usefulness in real-world use cases. An often overlooked aspect in natural language processing (NLP) research and evaluation is language variation in the form of non-standard dialects or language varieties (hereafter, varieties). Most NLP benchmarks are limited to standard language varieties. To fill this gap, we propose DIALECTBENCH, the first-ever l… ▽ More Language technologies should be judged on their usefulness in real-world use cases. An often overlooked aspect in natural language processing (NLP) research and evaluation is language variation in the form of non-standard dialects or language varieties (hereafter, varieties). Most NLP benchmarks are limited to standard language varieties. To fill this gap, we propose DIALECTBENCH, the first-ever large-scale benchmark for NLP on varieties, which aggregates an extensive set of task-varied variety datasets (10 text-level tasks covering 281 varieties). This allows for a comprehensive evaluation of NLP system performance on different language varieties. We provide substantial evidence of performance disparities between standard and non-standard language varieties, and we also identify language clusters with large performance divergence across tasks. We believe DIALECTBENCH provides a comprehensive view of the current state of NLP for language varieties and one step towards advancing it further. Code/data: https://github.com/ffaisal93/DialectBench △ Less

Submitted 7 July, 2024; v1 submitted 16 March, 2024; originally announced March 2024.

Comments: Equal contribution: Fahim Faisal, Orevaoghene Ahia

To token or not to token: A Comparative Study of Text Representations for Cross-Lingual Transfer

Authors: Md Mushfiqur Rahman, Fardin Ahsan Sakib, Fahim Faisal, Antonios Anastasopoulos

Abstract: Choosing an appropriate tokenization scheme is often a bottleneck in low-resource cross-lingual transfer. To understand the downstream implications of text representation choices, we perform a comparative analysis on language models having diverse text representation modalities including 2 segmentation-based models (\texttt{BERT}, \texttt{mBERT}), 1 image-based model (\texttt{PIXEL}), and 1 charac… ▽ More Choosing an appropriate tokenization scheme is often a bottleneck in low-resource cross-lingual transfer. To understand the downstream implications of text representation choices, we perform a comparative analysis on language models having diverse text representation modalities including 2 segmentation-based models (\texttt{BERT}, \texttt{mBERT}), 1 image-based model (\texttt{PIXEL}), and 1 character-level model (\texttt{CANINE}). First, we propose a scoring Language Quotient (LQ) metric capable of providing a weighted representation of both zero-shot and few-shot evaluation combined. Utilizing this metric, we perform experiments comprising 19 source languages and 133 target languages on three tasks (POS tagging, Dependency parsing, and NER). Our analysis reveals that image-based models excel in cross-lingual transfer when languages are closely related and share visually similar scripts. However, for tasks biased toward word meaning (POS, NER), segmentation-based models prove to be superior. Furthermore, in dependency parsing tasks where word relationships play a crucial role, models with their character-level focus, outperform others. Finally, we propose a recommendation scheme based on our findings to guide model selection according to task and language requirements. △ Less

Submitted 12 October, 2023; originally announced October 2023.

Comments: Accepted at 3RD MULTILINGUAL REPRESENTATION LEARNING (MRL) WORKSHOP, 2023

Multilingual Text Representation

Authors: Fahim Faisal

Abstract: Modern NLP breakthrough includes large multilingual models capable of performing tasks across more than 100 languages. State-of-the-art language models came a long way, starting from the simple one-hot representation of words capable of performing tasks like natural language understanding, common-sense reasoning, or question-answering, thus capturing both the syntax and semantics of texts. At the… ▽ More Modern NLP breakthrough includes large multilingual models capable of performing tasks across more than 100 languages. State-of-the-art language models came a long way, starting from the simple one-hot representation of words capable of performing tasks like natural language understanding, common-sense reasoning, or question-answering, thus capturing both the syntax and semantics of texts. At the same time, language models are expanding beyond our known language boundary, even competitively performing over very low-resource dialects of endangered languages. However, there are still problems to solve to ensure an equitable representation of texts through a unified modeling space across language and speakers. In this survey, we shed light on this iterative progression of multilingual text representation and discuss the driving factors that ultimately led to the current state-of-the-art. Subsequently, we discuss how the full potential of language democratization could be obtained, reaching beyond the known limits and what is the scope of improvement in that space. △ Less

Submitted 2 September, 2023; originally announced September 2023.

Comments: PhD Comprehensive exam report

Investigation on Machine Learning Based Approaches for Estimating the Critical Temperature of Superconductors

Authors: Fatin Abrar Shams, Rashed Hasan Ratul, Ahnaf Islam Naf, Syed Shaek Hossain Samir, Mirza Muntasir Nishat, Fahim Faisal, Md. Ashraful Hoque

Abstract: Superconductors have been among the most fascinating substances, as the fundamental concept of superconductivity as well as the correlation of critical temperature and superconductive materials have been the focus of extensive investigation since their discovery. However, superconductors at normal temperatures have yet to be identified. Additionally, there are still many unknown factors and gaps o… ▽ More Superconductors have been among the most fascinating substances, as the fundamental concept of superconductivity as well as the correlation of critical temperature and superconductive materials have been the focus of extensive investigation since their discovery. However, superconductors at normal temperatures have yet to be identified. Additionally, there are still many unknown factors and gaps of understanding regarding this unique phenomenon, particularly the connection between superconductivity and the fundamental criteria to estimate the critical temperature. To bridge the gap, numerous machine learning techniques have been established to estimate critical temperatures as it is extremely challenging to determine. Furthermore, the need for a sophisticated and feasible method for determining the temperature range that goes beyond the scope of the standard empirical formula appears to be strongly emphasized by various machine-learning approaches. This paper uses a stacking machine learning approach to train itself on the complex characteristics of superconductive materials in order to accurately predict critical temperatures. In comparison to other previous accessible research investigations, this model demonstrated a promising performance with an RMSE of 9.68 and an R2 score of 0.922. The findings presented here could be a viable technique to shed new insight on the efficient implementation of the stacking ensemble method with hyperparameter optimization (HPO). △ Less

Submitted 2 August, 2023; originally announced August 2023.

Comments: Accepted for publication on IEEE INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE, ROBOTICS,SIGNAL, AND IMAGE PROCESSING (AIRoSIP 2023)

GlobalBench: A Benchmark for Global Progress in Natural Language Processing

Authors: Yueqi Song, Catherine Cui, Simran Khanuja, Pengfei Liu, Fahim Faisal, Alissa Ostapenko, Genta Indra Winata, Alham Fikri Aji, Samuel Cahyawijaya, Yulia Tsvetkov, Antonios Anastasopoulos, Graham Neubig

Abstract: Despite the major advances in NLP, significant disparities in NLP system performance across languages still exist. Arguably, these are due to uneven resource allocation and sub-optimal incentives to work on less resourced languages. To track and further incentivize the global development of equitable language technology, we introduce GlobalBench. Prior multilingual benchmarks are static and have f… ▽ More Despite the major advances in NLP, significant disparities in NLP system performance across languages still exist. Arguably, these are due to uneven resource allocation and sub-optimal incentives to work on less resourced languages. To track and further incentivize the global development of equitable language technology, we introduce GlobalBench. Prior multilingual benchmarks are static and have focused on a limited number of tasks and languages. In contrast, GlobalBench is an ever-expanding collection that aims to dynamically track progress on all NLP datasets in all languages. Rather than solely measuring accuracy, GlobalBench also tracks the estimated per-speaker utility and equity of technology across all languages, providing a multi-faceted view of how language technology is serving people of the world. Furthermore, GlobalBench is designed to identify the most under-served languages, and rewards research efforts directed towards those languages. At present, the most under-served languages are the ones with a relatively high population, but nonetheless overlooked by composite multilingual benchmarks (like Punjabi, Portuguese, and Wu Chinese). Currently, GlobalBench covers 966 datasets in 190 languages, and has 1,128 system submissions spanning 62 languages. △ Less

Submitted 24 May, 2023; originally announced May 2023.

Comments: Preprint, 9 pages

GMNLP at SemEval-2023 Task 12: Sentiment Analysis with Phylogeny-Based Adapters

Authors: Md Mahfuz Ibn Alam, Ruoyu Xie, Fahim Faisal, Antonios Anastasopoulos

Abstract: This report describes GMU's sentiment analysis system for the SemEval-2023 shared task AfriSenti-SemEval. We participated in all three sub-tasks: Monolingual, Multilingual, and Zero-Shot. Our approach uses models initialized with AfroXLMR-large, a pre-trained multilingual language model trained on African languages and fine-tuned correspondingly. We also introduce augmented training data along wit… ▽ More This report describes GMU's sentiment analysis system for the SemEval-2023 shared task AfriSenti-SemEval. We participated in all three sub-tasks: Monolingual, Multilingual, and Zero-Shot. Our approach uses models initialized with AfroXLMR-large, a pre-trained multilingual language model trained on African languages and fine-tuned correspondingly. We also introduce augmented training data along with original training data. Alongside finetuning, we perform phylogeny-based adapter tuning to create several models and ensemble the best models for the final submission. Our system achieves the best F1-score on track 5: Amharic, with 6.2 points higher F1-score than the second-best performing system on this track. Overall, our system ranks 5th among the 10 systems participating in all 15 tracks. △ Less

Submitted 25 April, 2023; originally announced April 2023.

Comments: Accepted at SemEval Workshop at ACL 2023

Geographic and Geopolitical Biases of Language Models

Authors: Fahim Faisal, Antonios Anastasopoulos

Abstract: Pretrained language models (PLMs) often fail to fairly represent target users from certain world regions because of the under-representation of those regions in training datasets. With recent PLMs trained on enormous data sources, quantifying their potential biases is difficult, due to their black-box nature and the sheer scale of the data sources. In this work, we devise an approach to study the… ▽ More Pretrained language models (PLMs) often fail to fairly represent target users from certain world regions because of the under-representation of those regions in training datasets. With recent PLMs trained on enormous data sources, quantifying their potential biases is difficult, due to their black-box nature and the sheer scale of the data sources. In this work, we devise an approach to study the geographic bias (and knowledge) present in PLMs, proposing a Geographic-Representation Probing Framework adopting a self-conditioning method coupled with entity-country mappings. Our findings suggest PLMs' representations map surprisingly well to the physical world in terms of country-to-country associations, but this knowledge is unequally shared across languages. Last, we explain how large PLMs despite exhibiting notions of geographical proximity, over-amplify geopolitical favouritism at inference time. △ Less

Submitted 20 December, 2022; originally announced December 2022.

Phylogeny-Inspired Adaptation of Multilingual Models to New Languages

Authors: Fahim Faisal, Antonios Anastasopoulos

Abstract: Large pretrained multilingual models, trained on dozens of languages, have delivered promising results due to cross-lingual learning capabilities on variety of language tasks. Further adapting these models to specific languages, especially ones unseen during pre-training, is an important goal towards expanding the coverage of language technologies. In this study, we show how we can use language ph… ▽ More Large pretrained multilingual models, trained on dozens of languages, have delivered promising results due to cross-lingual learning capabilities on variety of language tasks. Further adapting these models to specific languages, especially ones unseen during pre-training, is an important goal towards expanding the coverage of language technologies. In this study, we show how we can use language phylogenetic information to improve cross-lingual transfer leveraging closely related languages in a structured, linguistically-informed manner. We perform adapter-based training on languages from diverse language families (Germanic, Uralic, Tupian, Uto-Aztecan) and evaluate on both syntactic and semantic tasks, obtaining more than 20% relative performance improvements over strong commonly used baselines, especially on languages unseen during pre-training. △ Less

Submitted 22 November, 2022; v1 submitted 19 May, 2022; originally announced May 2022.

Comments: accepted in AACL 2022 Main Conference

Survival Prediction of Children Undergoing Hematopoietic Stem Cell Transplantation Using Different Machine Learning Classifiers by Performing Chi-squared Test and Hyper-parameter Optimization: A Retrospective Analysis

Authors: Ishrak Jahan Ratul, Ummay Habiba Wani, Mirza Muntasir Nishat, Abdullah Al-Monsur, Abrar Mohammad Ar-Rafi, Fahim Faisal, Mohammad Ridwan Kabir

Abstract: Bone Marrow Transplant, a gradational rescue for a wide range of disorders emanating from the bone marrow, is an efficacious surgical treatment. Several risk factors, such as post-transplant illnesses, new malignancies, and even organ damage, can impair long-term survival. Therefore, technologies like Machine Learning are deployed for investigating the survival prediction of BMT receivers along wi… ▽ More Bone Marrow Transplant, a gradational rescue for a wide range of disorders emanating from the bone marrow, is an efficacious surgical treatment. Several risk factors, such as post-transplant illnesses, new malignancies, and even organ damage, can impair long-term survival. Therefore, technologies like Machine Learning are deployed for investigating the survival prediction of BMT receivers along with the influences that limit their resilience. In this study, an efficient survival classification model is presented in a comprehensive manner, incorporating the Chi-squared feature selection method to address the dimensionality problem and Hyper Parameter Optimization (HPO) to increase accuracy. A synthetic dataset is generated by imputing the missing values, transforming the data using dummy variable encoding, and compressing the dataset from 59 features to the 11 most correlated features using Chi-squared feature selection. The dataset was split into train and test sets at a ratio of 80:20, and the hyperparameters were optimized using Grid Search Cross-Validation. Several supervised ML methods were trained in this regard, like Decision Tree, Random Forest, Logistic Regression, K-Nearest Neighbors, Gradient Boosting Classifier, Ada Boost, and XG Boost. The simulations have been performed for both the default and optimized hyperparameters by using the original and reduced synthetic dataset. After ranking the features using the Chi-squared test, it was observed that the top 11 features with HPO, resulted in the same accuracy of prediction (94.73%) as the entire dataset with default parameters. Moreover, this approach requires less time and resources for predicting the survivability of children undergoing BMT. Hence, the proposed approach may aid in the development of a computer-aided diagnostic system with satisfactory accuracy and minimal computation time by utilizing medical data records. △ Less

Submitted 22 January, 2022; originally announced January 2022.

Comments: 25 pages, 14 figures, 38 tables

Report number: 9391136 ACM Class: J.3

Dataset Geography: Mapping Language Data to Language Users

Authors: Fahim Faisal, Yinkai Wang, Antonios Anastasopoulos

Abstract: As language technologies become more ubiquitous, there are increasing efforts towards expanding the language diversity and coverage of natural language processing (NLP) systems. Arguably, the most important factor influencing the quality of modern NLP systems is data availability. In this work, we study the geographical representativeness of NLP datasets, aiming to quantify if and by how much do N… ▽ More As language technologies become more ubiquitous, there are increasing efforts towards expanding the language diversity and coverage of natural language processing (NLP) systems. Arguably, the most important factor influencing the quality of modern NLP systems is data availability. In this work, we study the geographical representativeness of NLP datasets, aiming to quantify if and by how much do NLP datasets match the expected needs of the language speakers. In doing so, we use entity recognition and linking systems, also making important observations about their cross-lingual consistency and giving suggestions for more robust evaluation. Last, we explore some geographical and economic factors that may explain the observed dataset distributions. Code and data are available here: https://github.com/ffaisal93/dataset_geography. Additional visualizations are available here: https://nlp.cs.gmu.edu/project/datasetmaps/. △ Less

Submitted 23 March, 2022; v1 submitted 7 December, 2021; originally announced December 2021.

Comments: ACL 2022

Learning Cooperation and Online Planning Through Simulation and Graph Convolutional Network

Authors: Rafid Ameer Mahmud, Fahim Faisal, Saaduddin Mahmud, Md. Mosaddek Khan

Abstract: Multi-agent Markov Decision Process (MMDP) has been an effective way of modelling sequential decision making algorithms for multi-agent cooperative environments. A number of algorithms based on centralized and decentralized planning have been developed in this domain. However, dynamically changing environment, coupled with exponential size of the state and joint action space, make it difficult for… ▽ More Multi-agent Markov Decision Process (MMDP) has been an effective way of modelling sequential decision making algorithms for multi-agent cooperative environments. A number of algorithms based on centralized and decentralized planning have been developed in this domain. However, dynamically changing environment, coupled with exponential size of the state and joint action space, make it difficult for these algorithms to provide both efficiency and scalability. Recently, Centralized planning algorithm FV-MCTS-MP and decentralized planning algorithm \textit{Alternate maximization with Behavioural Cloning} (ABC) have achieved notable performance in solving MMDPs. However, they are not capable of adapting to dynamically changing environments and accounting for the lack of communication among agents, respectively. Against this background, we introduce a simulation based online planning algorithm, that we call SiCLOP, for multi-agent cooperative environments. Specifically, SiCLOP tailors Monte Carlo Tree Search (MCTS) and uses Coordination Graph (CG) and Graph Neural Network (GCN) to learn cooperation and provides real time solution of a MMDP problem. It also improves scalability through an effective pruning of action space. Additionally, unlike FV-MCTS-MP and ABC, SiCLOP supports transfer learning, which enables learned agents to operate in different environments. We also provide theoretical discussion about the convergence property of our algorithm within the context of multi-agent settings. Finally, our extensive empirical results show that SiCLOP significantly outperforms the state-of-the-art online planning algorithms. △ Less

Submitted 16 October, 2021; originally announced October 2021.

SD-QA: Spoken Dialectal Question Answering for the Real World

Authors: Fahim Faisal, Sharlina Keshava, Md Mahfuz ibn Alam, Antonios Anastasopoulos

Abstract: Question answering (QA) systems are now available through numerous commercial applications for a wide variety of domains, serving millions of users that interact with them via speech interfaces. However, current benchmarks in QA research do not account for the errors that speech recognition models might introduce, nor do they consider the language variations (dialects) of the users. To address thi… ▽ More Question answering (QA) systems are now available through numerous commercial applications for a wide variety of domains, serving millions of users that interact with them via speech interfaces. However, current benchmarks in QA research do not account for the errors that speech recognition models might introduce, nor do they consider the language variations (dialects) of the users. To address this gap, we augment an existing QA dataset to construct a multi-dialect, spoken QA benchmark on five languages (Arabic, Bengali, English, Kiswahili, Korean) with more than 68k audio prompts in 24 dialects from 255 speakers. We provide baseline results showcasing the real-world performance of QA systems and analyze the effect of language variety and other sensitive speaker attributes on downstream performance. Last, we study the fairness of the ASR and QA models with respect to the underlying user populations. The dataset, model outputs, and code for reproducing all our experiments are available: https://github.com/ffaisal93/SD-QA. △ Less

Submitted 24 September, 2021; originally announced September 2021.

Comments: EMNLP 2021 Findings

Investigating Post-pretraining Representation Alignment for Cross-Lingual Question Answering

Authors: Fahim Faisal, Antonios Anastasopoulos

Abstract: Human knowledge is collectively encoded in the roughly 6500 languages spoken around the world, but it is not distributed equally across languages. Hence, for information-seeking question answering (QA) systems to adequately serve speakers of all languages, they need to operate cross-lingually. In this work we investigate the capabilities of multilingually pre-trained language models on cross-lingu… ▽ More Human knowledge is collectively encoded in the roughly 6500 languages spoken around the world, but it is not distributed equally across languages. Hence, for information-seeking question answering (QA) systems to adequately serve speakers of all languages, they need to operate cross-lingually. In this work we investigate the capabilities of multilingually pre-trained language models on cross-lingual QA. We find that explicitly aligning the representations across languages with a post-hoc fine-tuning step generally leads to improved performance. We additionally investigate the effect of data size as well as the language choice in this fine-tuning step, also releasing a dataset for evaluating cross-lingual QA systems. Code and dataset are publicly available here: https://github.com/ffaisal93/aligned_qa △ Less

Submitted 24 September, 2021; originally announced September 2021.

Comments: Accepted at MRQA Workshop 2021

Design, Simulation and Feasibility Analysis of Bifacial Solar PV System in Marine Drive Road, Cox's Bazar

Authors: Abdullah Al Mehadi, Mirza Muntasir Nishat, Fahim Faisal, Ahmed Raza Hasan Bhuiyan, Mohyeu Hussain, Md Ashraful Hoque

Abstract: This paper proposes a design and simulation based investigative analysis of a vertically mounted bifacial solar photovoltaic model in Marine Drive Road, Cox's Bazar. Cox's bazar is a famous tourist destination which seems to be a flexible site for implementing such energy harvesting system without affecting the nearby eco-system and solves the existing land shortage problem. Moreover, the infrastr… ▽ More This paper proposes a design and simulation based investigative analysis of a vertically mounted bifacial solar photovoltaic model in Marine Drive Road, Cox's Bazar. Cox's bazar is a famous tourist destination which seems to be a flexible site for implementing such energy harvesting system without affecting the nearby eco-system and solves the existing land shortage problem. Moreover, the infrastructure will provide insulation to noise related problem faced by nearby residents, arising from traffic noises. A model road of 200 meters is reconnoitered for energy harvesting by solar power using three prominent software namely PVSOL, PVsyst, and SAM where a promising mean annual yield of 70492.9 kWh is obtained, and the bifacial gain is calculated to be 12.26%. In addition, a deviation analysis is performed among each of the software and it is found that PVSOL and PVsyst have shown less deviation. Furthermore, a comprehensive financial analysis shows total installation cost to be 84759.74$. △ Less

Submitted 20 September, 2021; originally announced September 2021.

Comments: Accepted and presented in 2021 International Conference on Science & Contemporary Technologies (ICSCT). Will be published in IEEE Xplore

Code to Comment Translation: A Comparative Study on Model Effectiveness & Errors

Authors: Junayed Mahmud, Fahim Faisal, Raihan Islam Arnob, Antonios Anastasopoulos, Kevin Moran

Abstract: Automated source code summarization is a popular software engineering research topic wherein machine translation models are employed to "translate" code snippets into relevant natural language descriptions. Most evaluations of such models are conducted using automatic reference-based metrics. However, given the relatively large semantic gap between programming languages and natural language, we ar… ▽ More Automated source code summarization is a popular software engineering research topic wherein machine translation models are employed to "translate" code snippets into relevant natural language descriptions. Most evaluations of such models are conducted using automatic reference-based metrics. However, given the relatively large semantic gap between programming languages and natural language, we argue that this line of research would benefit from a qualitative investigation into the various error modes of current state-of-the-art models. Therefore, in this work, we perform both a quantitative and qualitative comparison of three recently proposed source code summarization models. In our quantitative evaluation, we compare the models based on the smoothed BLEU-4, METEOR, and ROUGE-L machine translation metrics, and in our qualitative evaluation, we perform a manual open-coding of the most common errors committed by the models when compared to ground truth captions. Our investigation reveals new insights into the relationship between metric-based performance and model prediction errors grounded in an empirically derived error taxonomy that can be used to drive future research efforts △ Less

Submitted 15 June, 2021; originally announced June 2021.

Comments: Accepted to the 2021 NLP4Prog Workshop co-located with The Joint Conference of the 59th Annual Meeting of the Association for Computational Linguistics and the 11th International Joint Conference on Natural Language Processing (ACL-IJCNLP 2021)

Mining Temporal Evolution of Knowledge Graph and Genealogical Features for Literature-based Discovery Prediction

Authors: Nazim Choudhury, Fahim Faisal, Matloob Khushi

Abstract: Literature-based knowledge discovery process identifies the important but implicit relations among information embedded in published literature. Existing techniques from Information Retrieval and Natural Language Processing attempt to identify the hidden or unpublished connections between information concepts within published literature, however, these techniques undermine the concept of predictin… ▽ More Literature-based knowledge discovery process identifies the important but implicit relations among information embedded in published literature. Existing techniques from Information Retrieval and Natural Language Processing attempt to identify the hidden or unpublished connections between information concepts within published literature, however, these techniques undermine the concept of predicting the future and emerging relations among scientific knowledge components encapsulated within the literature. Keyword Co-occurrence Network (KCN), built upon author selected keywords (i.e., knowledge entities), is considered as a knowledge graph that focuses both on these knowledge components and knowledge structure of a scientific domain by examining the relationships between knowledge entities. Using data from two multidisciplinary research domains other than the medical domain, capitalizing on bibliometrics, the dynamicity of temporal KCNs, and a Long Short Term Memory recurrent neural network, this study proposed a framework to successfully predict the future literature-based discoveries - the emerging connections among knowledge units. Framing the problem as a dynamic supervised link prediction task, the proposed framework integrates some novel node and edge-level features. Temporal importance of keywords computed from both bipartite and unipartite networks, communities of keywords, built upon genealogical relations, and relative importance of temporal citation counts used in the feature construction process. Both node and edge-level features were input into an LSTM network to forecast the feature values for positive and negatively labeled non-connected keyword pairs and classify them accurately. High classification performance rates suggest that these features are supportive both in predicting the emerging connections between scientific knowledge units and emerging trend analysis. △ Less

Submitted 10 November, 2019; v1 submitted 22 July, 2019; originally announced July 2019.

Disease Identification From Unstructured User Input

Authors: Fahim Faisal, Shafkat Ahmed Bhuiyan, Dr. Abu Raihan Mostofa Kamal

Abstract: A method to identify probable diseases from the unstructured textual input (eg, health forum posts) by incorporating a lexicographic and semantic feature based two-phase text classification module and a symptom-disease correlation-based similarity measurement module. One notable aspect of my approach was to develop a competent algorithm to extract all inherent features from the data source to make… ▽ More A method to identify probable diseases from the unstructured textual input (eg, health forum posts) by incorporating a lexicographic and semantic feature based two-phase text classification module and a symptom-disease correlation-based similarity measurement module. One notable aspect of my approach was to develop a competent algorithm to extract all inherent features from the data source to make a better decision. △ Less

Submitted 10 May, 2019; v1 submitted 1 May, 2019; originally announced May 2019.

Comments: This was an undergraduate research. The hypotheses it proposes is based on a small number of samples and thus, can not be declared significant. To declare it significant, a large number of sample testing is needed. After that, it can be put through

From homogeneous to heterogeneous network alignment via colored graphlets

Authors: Shawn Gu, John Johnson, Fazle E. Faisal, Tijana Milenkovic

Abstract: Network alignment (NA) compares networks with the goal of finding a node mapping that uncovers highly similar (conserved) network regions. Existing NA methods are homogeneous, i.e., they can deal only with networks containing nodes and edges of one type. Due to increasing amounts of heterogeneous network data with nodes or edges of different types, we extend three recent state-of-the-art homogeneo… ▽ More Network alignment (NA) compares networks with the goal of finding a node mapping that uncovers highly similar (conserved) network regions. Existing NA methods are homogeneous, i.e., they can deal only with networks containing nodes and edges of one type. Due to increasing amounts of heterogeneous network data with nodes or edges of different types, we extend three recent state-of-the-art homogeneous NA methods, WAVE, MAGNA++, and SANA, to allow for heterogeneous NA for the first time. We introduce several algorithmic novelties. Namely, these existing methods compute homogeneous graphlet-based node similarities and then find high-scoring alignments with respect to these similarities, while simultaneously maximizing the amount of conserved edges. Instead, we extend homogeneous graphlets to their heterogeneous counterparts, which we then use to develop a new measure of heterogeneous node similarity. Also, we extend $S^3$, a state-of-the-art measure of edge conservation for homogeneous NA, to its heterogeneous counterpart. Then, we find high-scoring alignments with respect to our heterogeneous node similarity and edge conservation measures. In evaluations on synthetic and real-world biological networks, our proposed heterogeneous NA methods lead to higher-quality alignments and better robustness to noise in the data than their homogeneous counterparts. The software and data from this work is available upon request. △ Less

Submitted 28 March, 2018; v1 submitted 4 April, 2017; originally announced April 2017.

Strong-Field S-Matrix Theory With Coulomb-Volkov Final State in All Orders

Authors: F. H. M. Faisal

Abstract: Despite its long standing usefulness for the analysis of various processes in intense laser fields, it is well-known that the so-called strong-field KFR or SFA ansatz does not account for the final-state Coulomb interaction. Due to its importance for the ubiquitous ionisation process, numerous heuristic attempts have been made during the last several decades to account for the final state Coulomb… ▽ More Despite its long standing usefulness for the analysis of various processes in intense laser fields, it is well-known that the so-called strong-field KFR or SFA ansatz does not account for the final-state Coulomb interaction. Due to its importance for the ubiquitous ionisation process, numerous heuristic attempts have been made during the last several decades to account for the final state Coulomb interaction with in the SFA. Also to this end an ad hoc model with the so-called Coulomb-Volkov final state was introduced a long time ago. However, till now, no systematic strong-field S-matrix expansion using the Coulomb-Volkov final state could be found. Here we solve this long standing problem by determining the Coulomb-Volkov Hamiltonian, identifying the rest-interaction in the final state, and explicitly constructng the Coulomb-Volkov propagator (or Green's function). We employ them to derive the complete S-matrix series for the ionisation amplitude governed by the Coulomb-Volkov final state in all orders. The results are given in both "velocity" and "length" gauges. We also present a gauge independent version of the Coulomb-Volkov S-matrix series. △ Less

Submitted 7 June, 2016; originally announced June 2016.

Journal ref: Phys. Rev. A 94, 031401 (2016)

Network approach integrates 3D structural and sequence data to improve protein structural comparison

Authors: Fazle E. Faisal, Julie L. Chaney, Khalique Newaz, Jun Li, Scott J. Emrich, Patricia L. Clark, Tijana Milenkovic

Abstract: Initial protein structural comparisons were sequence-based. Since amino acids that are distant in the sequence can be close in the 3-dimensional (3D) structure, 3D contact approaches can complement sequence approaches. Traditional 3D contact approaches study 3D structures directly. Instead, 3D structures can be modeled as protein structure networks (PSNs). Then, network approaches can compare prot… ▽ More Initial protein structural comparisons were sequence-based. Since amino acids that are distant in the sequence can be close in the 3-dimensional (3D) structure, 3D contact approaches can complement sequence approaches. Traditional 3D contact approaches study 3D structures directly. Instead, 3D structures can be modeled as protein structure networks (PSNs). Then, network approaches can compare proteins by comparing their PSNs. Network approaches may improve upon traditional 3D contact approaches. We cannot use existing PSN approaches to test this, because: 1) They rely on naive measures of network topology. 2) They are not robust to PSN size. They cannot integrate 3) multiple PSN measures or 4) PSN data with sequence data, although this could help because the different data types capture complementary biological knowledge. We address these limitations by: 1) exploiting well-established graphlet measures via a new network approach, 2) introducing normalized graphlet measures to remove the bias of PSN size, 3) allowing for integrating multiple PSN measures, and 4) using ordered graphlets to combine the complementary PSN data and sequence data. We compare both synthetic networks and real-world PSNs more accurately and faster than existing network, 3D contact, or sequence approaches. Our approach finds PSN patterns that may be biochemically interesting. △ Less

Submitted 27 February, 2017; v1 submitted 23 May, 2016; originally announced May 2016.

Dynamic networks reveal key players in aging

Authors: Fazle Elahi Faisal, Tijana Milenkovic

Abstract: Motivation: Since susceptibility to diseases increases with age, studying aging gains importance. Analyses of gene expression or sequence data, which have been indispensable for investigating aging, have been limited to studying genes and their protein products in isolation, ignoring their connectivities. However, proteins function by interacting with other proteins, and this is exactly what biolo… ▽ More Motivation: Since susceptibility to diseases increases with age, studying aging gains importance. Analyses of gene expression or sequence data, which have been indispensable for investigating aging, have been limited to studying genes and their protein products in isolation, ignoring their connectivities. However, proteins function by interacting with other proteins, and this is exactly what biological networks (BNs) model. Thus, analyzing the proteins' BN topologies could contribute to understanding of aging. Current methods for analyzing systems-level BNs deal with their static representations, even though cells are dynamic. For this reason, and because different data types can give complementary biological insights, we integrate current static BNs with aging-related gene expression data to construct dynamic, age-specific BNs. Then, we apply sensitive measures of topology to the dynamic BNs to study cellular changes with age. Results: While global BN topologies do not significantly change with age, local topologies of a number of genes do. We predict such genes as aging-related. We demonstrate credibility of our predictions by: 1) observing significant overlap between our predicted aging-related genes and "ground truth" aging-related genes; 2) showing that our aging-related predictions group by functions and diseases that are different than functions and diseases of genes that are not predicted as aging-related; 3) observing significant overlap between functions and diseases that are enriched in our aging-related predictions and those that are enriched in "ground truth" aging-related data; 4) providing evidence that diseases which are enriched in our aging-related predictions are linked to human aging; and 5) validating all of our high-scoring novel predictions via manual literature search. △ Less

Submitted 12 July, 2013; originally announced July 2013.

Adiabatic solution of Dirac equation of "graphinos" in an intense electromagnetic field and emission of high order harmonics near the Dirac points

Authors: F. H. M. Faisal

Abstract: We obtain a class of adiabatic solutions of Dirac equation for the charged massless relativistic quasi-particles that arise from the low-energy excitations \cite{foot-1} in a 2D graphene sheet, interacting with an electromagnetic field. The analytic solutions obtained are useful for {\it non-perturbative} investigation of processes in intense laser fields. As a first example we employ them to pred… ▽ More We obtain a class of adiabatic solutions of Dirac equation for the charged massless relativistic quasi-particles that arise from the low-energy excitations \cite{foot-1} in a 2D graphene sheet, interacting with an electromagnetic field. The analytic solutions obtained are useful for {\it non-perturbative} investigation of processes in intense laser fields. As a first example we employ them to predict copious emissions of high order harmonics by THz lasers interacting with the occupied states of graphinos in the vicinity of the degenerate Dirac points. The relative intensity of the emitted harmonics is seen to decrease by only about two orders of magnitude from the 3rd to the 81st harmonic order, and is characterized by two phenomena of "revival" and "plateau" formation in the middle and the far end of the spectrum calculated. A preliminary comparison is made for harmonic emission from 2D graphene that reveals a qualitatively different spectrum in the latter case showing a sharp cutoff at an order $n_{cutoff} = \frac{ω_B}ω$ where $ω_B=eF_0b/\hbar$ is the so-called Bloch frequency. △ Less

Submitted 1 March, 2011; v1 submitted 8 February, 2011; originally announced February 2011.

Comments: 6 pages, 3 figures, additional Fig. 3 and preliminary comparison with graphene, additional citations

A 4-Component Dirac Theory of Ionization of Hydrogen Molecular Ion in a Super-Intense Laser Field

Authors: F. H. M. Faisal

Abstract: In this paper a 4-component Dirac theory of ionization of hydrogen molecular ion in a super-intense laser field is developed. Simple analytic expressions for the spin specific as well as the total ionization currents emitted from the ground state of the ion are derived. The results are given for all polarization and finite propagation vectors of the field. They apply for inner-shell ionization o… ▽ More In this paper a 4-component Dirac theory of ionization of hydrogen molecular ion in a super-intense laser field is developed. Simple analytic expressions for the spin specific as well as the total ionization currents emitted from the ground state of the ion are derived. The results are given for all polarization and finite propagation vectors of the field. They apply for inner-shell ionization of analogous heavier molecular ions as well. The presence of molecular two-slit interference effect, first found in the non-relativistic case, and the spin-flip ionization current, and an asymmetry of the up- and down-spin currents similar to that predicted in the atomic case, are found also to hold for the present relativistic molecular ionic case. Finally, the possibility of controlling the dominant spin currents by selecting the handedness of a circularly polarized incident laser field is pointed out. △ Less

Submitted 11 July, 2009; v1 submitted 10 July, 2009; originally announced July 2009.

Comments: 7 pages, no figures

Equivalence of the velocity and length gauge perturbation series

Authors: F. H. M. Faisal

Abstract: We derive a "master" perturbation expansion for the quantum transition amplitude in a light field between the field-free initial and final atomic states in the minimal-coupling (MC) "velocity" gauge. The result is used to prove that the traditional "velocity" and "length" gauge perturbation series are equivalent infinite series representations or branches of the same amplitude function, that are… ▽ More We derive a "master" perturbation expansion for the quantum transition amplitude in a light field between the field-free initial and final atomic states in the minimal-coupling (MC) "velocity" gauge. The result is used to prove that the traditional "velocity" and "length" gauge perturbation series are equivalent infinite series representations or branches of the same amplitude function, that are equal but in a common domain of convergence (if it exists). More generally, we show that they constitute only two members of a one-parameter family of infinitely many branches of the given transition amplitude. △ Less

Submitted 4 October, 2008; originally announced October 2008.

Comments: 4 pages, 37 equations, 8 references (with 2 foot notes)

A theory of intense-field dynamic alignment and high harmonic generation from coherently rotating molecules and interpretation of intense-field ultrafast pump-probe experiments

Authors: A. Abdurrouf, F. H. M. Faisal

Abstract: A theory of ultra-fast pump-probe experiments proposed by us earlier [F.H.M. Faisal et al., Phys. Rev. Lett. 98, 143001 (2007) and F.H.M. Faisal and A. Abdurrouf, Phys. Rev. Lett. 100, 123005 (2008)] is developed here fully and applied to investigate the phenomena of dynamic alignment and high harmonic generation (HHG) from coherently rotating linear molecules. The theory provides essentially an… ▽ More A theory of ultra-fast pump-probe experiments proposed by us earlier [F.H.M. Faisal et al., Phys. Rev. Lett. 98, 143001 (2007) and F.H.M. Faisal and A. Abdurrouf, Phys. Rev. Lett. 100, 123005 (2008)] is developed here fully and applied to investigate the phenomena of dynamic alignment and high harmonic generation (HHG) from coherently rotating linear molecules. The theory provides essentially analytical results for the signals that allow us to investigate the simultaneous dependence of the HHG signals on the two externally available control parameters, namely, the relative angle between the polarizations, and the delay-time between the two pulses. It is applied to investigate the characteristics of high harmonic emission from nitrogen and oxygen molecules that have been observed experimentally in a number of laboratories. The results obtained both in the time-domain and in the frequency-domain are compared with the observed characteristics as well as directly with the data and are found to agree remarkably well. In addition we have predicted the existence of a "magic" polarization angle at which all modulations of the harmonic emission from nitrogen molecule changes to a steady emission at the harmonic frequency. Among other things we have also shown a correlation between the existence of the "magic" or critical polarization angles and the symmetry of the active molecular orbitals, that is deemed to be useful in connection with the "inverse problem" of molecular imaging from the HHG data. △ Less

Submitted 8 October, 2008; v1 submitted 26 September, 2008; originally announced September 2008.

Comments: 31 pages, 22 figures, and 140 equations

Interplay of polarization geometry and rotational dynamics in high harmonic generation from coherently rotating linear molecule

Authors: F. H. M. Faisal, A. Abdurrouf

Abstract: Recent reports on intense-field pump-probe experiments for high harmonic generation from coherently rotating linear molecules, have revealed remarkable characteristic effects of the simultaneous variation of the polarization geometry and the time delay on the high harmonic signals. We analyze the effects and give a unified theoretical account of the experimental observations Recent reports on intense-field pump-probe experiments for high harmonic generation from coherently rotating linear molecules, have revealed remarkable characteristic effects of the simultaneous variation of the polarization geometry and the time delay on the high harmonic signals. We analyze the effects and give a unified theoretical account of the experimental observations △ Less

Submitted 15 July, 2007; originally announced July 2007.

Comments: 4 pages, 5 figures

Microwave-induced control of Free Electron Laser radiation

Authors: A. J. Blasco, L. Plaja, L. Roso, F. H. M. Faisal

Abstract: The dynamical response of a relativistic bunch of electrons injected in a planar magnetic undulator and interacting with a counterpropagating electromagnetic wave is studied. We demonstrate a resonance condition for which the free electron laser (FEL) dynamics is strongly influenced by the presence of the external field. It opens up the possibility of control of short wavelength FEL emission cha… ▽ More The dynamical response of a relativistic bunch of electrons injected in a planar magnetic undulator and interacting with a counterpropagating electromagnetic wave is studied. We demonstrate a resonance condition for which the free electron laser (FEL) dynamics is strongly influenced by the presence of the external field. It opens up the possibility of control of short wavelength FEL emission characteristics by changing the parameters of the microwave field without requiring change in the undulator's geometry or configuration. Numerical examples, assuming realistic parameter values analogous to those of the TTF-FEL, currently under development at DESY, are given for possible control of the amplitude or the polarization of the emitted radiation. △ Less

Submitted 28 May, 2001; originally announced May 2001.

Comments: 14 pages, 5 figures, accepted for publication in Phys. Rev. E