Showing 1–50 of 64 results for author: Mahmud, S

SeamPose: Repurposing Seams as Capacitive Sensors in a Shirt for Upper-Body Pose Tracking

Authors: Tianhong Catherine Yu, Manru, Zhang, Peter He, Chi-Jung Lee, Cassidy Cheesman, Saif Mahmud, Ruidong Zhang, François Guimbretière, Cheng Zhang

Abstract: Seams are areas of overlapping fabric formed by stitching two or more pieces of fabric together in the cut-and-sew apparel manufacturing process. In SeamPose, we repurposed seams as capacitive sensors in a shirt for continuous upper-body pose estimation. Compared to previous all-textile motion-capturing garments that place the electrodes on the surface of clothing, our solution leverages existing… ▽ More Seams are areas of overlapping fabric formed by stitching two or more pieces of fabric together in the cut-and-sew apparel manufacturing process. In SeamPose, we repurposed seams as capacitive sensors in a shirt for continuous upper-body pose estimation. Compared to previous all-textile motion-capturing garments that place the electrodes on the surface of clothing, our solution leverages existing seams inside of a shirt by machine-sewing insulated conductive threads over the seams. The unique invisibilities and placements of the seams afford the sensing shirt to look and wear the same as a conventional shirt while providing exciting pose-tracking capabilities. To validate this approach, we implemented a proof-of-concept untethered shirt. With eight capacitive sensing seams, our customized deep-learning pipeline accurately estimates the upper-body 3D joint positions relative to the pelvis. With a 12-participant user study, we demonstrated promising cross-user and cross-session tracking performance. SeamPose represents a step towards unobtrusive integration of smart clothing for everyday pose estimation. △ Less

Submitted 17 June, 2024; originally announced June 2024.

EchoGuide: Active Acoustic Guidance for LLM-Based Eating Event Analysis from Egocentric Videos

Authors: Vineet Parikh, Saif Mahmud, Devansh Agarwal, Ke Li, François Guimbretière, Cheng Zhang

Abstract: Self-recording eating behaviors is a step towards a healthy lifestyle recommended by many health professionals. However, the current practice of manually recording eating activities using paper records or smartphone apps is often unsustainable and inaccurate. Smart glasses have emerged as a promising wearable form factor for tracking eating behaviors, but existing systems primarily identify when e… ▽ More Self-recording eating behaviors is a step towards a healthy lifestyle recommended by many health professionals. However, the current practice of manually recording eating activities using paper records or smartphone apps is often unsustainable and inaccurate. Smart glasses have emerged as a promising wearable form factor for tracking eating behaviors, but existing systems primarily identify when eating occurs without capturing details of the eating activities (E.g., what is being eaten). In this paper, we present EchoGuide, an application and system pipeline that leverages low-power active acoustic sensing to guide head-mounted cameras to capture egocentric videos, enabling efficient and detailed analysis of eating activities. By combining active acoustic sensing for eating detection with video captioning models and large-scale language models for retrieval augmentation, EchoGuide intelligently clips and analyzes videos to create concise, relevant activity records on eating. We evaluated EchoGuide with 9 participants in naturalistic settings involving eating activities, demonstrating high-quality summarization and significant reductions in video data needed, paving the way for practical, scalable eating activity tracking. △ Less

Submitted 15 June, 2024; originally announced June 2024.

Blind Image Deblurring using FFT-ReLU with Deep Learning Pipeline Integration

Authors: Abdul Mohaimen Al Radi, Prothito Shovon Majumder, Syed Mumtahin Mahmud, Mahdi Mohd Hossain Noki, Md. Haider Ali, Md. Mosaddek Khan

Abstract: Blind image deblurring is the process of deriving a sharp image and a blur kernel from a blurred image. Blurry images are typically modeled as the convolution of a sharp image with a blur kernel, necessitating the estimation of the unknown blur kernel to perform blind image deblurring effectively. Existing approaches primarily focus on domain-specific features of images, such as salient edges, dar… ▽ More Blind image deblurring is the process of deriving a sharp image and a blur kernel from a blurred image. Blurry images are typically modeled as the convolution of a sharp image with a blur kernel, necessitating the estimation of the unknown blur kernel to perform blind image deblurring effectively. Existing approaches primarily focus on domain-specific features of images, such as salient edges, dark channels, and light streaks. These features serve as probabilistic priors to enhance the estimation of the blur kernel. For improved generality, we propose a novel prior (ReLU sparsity prior) that estimates blur kernel effectively across all distributions of images (natural, facial, text, low-light, saturated etc). Our approach demonstrates superior efficiency, with inference times up to three times faster, while maintaining high accuracy in PSNR, SSIM, and error ratio metrics. We also observe noticeable improvement in the performance of the state-of-the-art architectures (in terms of aforementioned metrics) in deep learning based approaches when our method is used as a post-processing unit. △ Less

Submitted 12 June, 2024; originally announced June 2024.

Comments: 20 pages, 13 figures

SonicID: User Identification on Smart Glasses with Acoustic Sensing

Authors: Ke Li, Devansh Agarwal, Ruidong Zhang, Vipin Gunda, Tianjun Mo, Saif Mahmud, Boao Chen, François Guimbretière, Cheng Zhang

Abstract: Smart glasses have become more prevalent as they provide an increasing number of applications for users. They store various types of private information or can access it via connections established with other devices. Therefore, there is a growing need for user identification on smart glasses. In this paper, we introduce a low-power and minimally-obtrusive system called SonicID, designed to authen… ▽ More Smart glasses have become more prevalent as they provide an increasing number of applications for users. They store various types of private information or can access it via connections established with other devices. Therefore, there is a growing need for user identification on smart glasses. In this paper, we introduce a low-power and minimally-obtrusive system called SonicID, designed to authenticate users on glasses. SonicID extracts unique biometric information from users by scanning their faces with ultrasonic waves and utilizes this information to distinguish between different users, powered by a customized binary classifier with the ResNet-18 architecture. SonicID can authenticate users within 0.12 seconds, with an energy consumption of 19.8 mAs per trial. A user study involving 24 participants confirms that SonicID achieves a true positive rate of 96.5%, a false positive rate of 4.1%, and a balanced accuracy of 96.2% using just 4 minutes of training data collected for each new user. This performance is relatively consistent across different remounting sessions and days. Given this promising performance, we further discuss the potential applications of SonicID and methods to improve its performance in the future. △ Less

Submitted 12 June, 2024; originally announced June 2024.

Comments: 20 pages, 2 tables, 6 figures

Energy Growth in $V_LV_L\to V_LV_L,\ V_LV_Lh$ Scattering to Probe Higgs Cubic and HEFT Interactions

Authors: Shameran Mahmud, Kohsaku Tobioka

Abstract: We compute the energy scales of perturbative unitarity violation in $V_L V_L \to V_L V_L h$ processes and compare them to $V_L V_L \to hhh$ process. Using these energy scales, we determine which process is more sensitive to potential modifications in the Higgs sector at high-energy colliders. Within the Higgs Effective Field Theory (HEFT), we consider the Higgs cubic coupling and other interaction… ▽ More We compute the energy scales of perturbative unitarity violation in $V_L V_L \to V_L V_L h$ processes and compare them to $V_L V_L \to hhh$ process. Using these energy scales, we determine which process is more sensitive to potential modifications in the Higgs sector at high-energy colliders. Within the Higgs Effective Field Theory (HEFT), we consider the Higgs cubic coupling and other interactions with and without derivatives. Any HEFT interactions predict the perturbative unitarity violation at a finite scale, and in a generic case, the minimalistic process is $2\to 3$ scattering. Our analysis reveals that the energy scales for unitarity violation in $V_L V_L \to V_L V_L h$ and $V_L V_L \to hhh$ processes are similar across all scenarios considered. If the backgrounds are similar, $V_L V_L h$ final states are more feasible because $V_L V_L h$ has higher branching ratios in cleaner decay modes than $hhh$. We also investigate HEFT derivative interactions derived from various UV models. In these cases, both $V_L V_L \to V_L V_L$ and $V_L V_L \to hh$ processes exhibit unitarity violating behavior. We demonstrate that the energy scales for unitarity violation in $V_L V_L$ final states are comparable to or even lower than those in the $hh$ final state. △ Less

Submitted 5 June, 2024; originally announced June 2024.

Comments: 28 pages, 3 tables, 7 figures, 5 appendices

Report number: KEK-TH-2626

MunchSonic: Tracking Fine-grained Dietary Actions through Active Acoustic Sensing on Eyeglasses

Authors: Saif Mahmud, Devansh Agarwal, Ashwin Ajit, Qikang Liang, Thalia Viranda, Francois Guimbretiere, Cheng Zhang

Abstract: We introduce MunchSonic, an AI-powered active acoustic sensing system integrated into eyeglasses, designed to track fine-grained dietary actions like hand-to-mouth movements for food intake, chewing, and drinking. MunchSonic emits inaudible ultrasonic waves from a commodity eyeglass frame. The reflected signals contain rich information about the position and movements of various body parts, includ… ▽ More We introduce MunchSonic, an AI-powered active acoustic sensing system integrated into eyeglasses, designed to track fine-grained dietary actions like hand-to-mouth movements for food intake, chewing, and drinking. MunchSonic emits inaudible ultrasonic waves from a commodity eyeglass frame. The reflected signals contain rich information about the position and movements of various body parts, including the mouth, jaw, arms, and hands, all of which are involved in eating activities. These signals are then processed by a custom deep-learning pipeline to classify six actions: food intake, chewing, drinking, talking, face-hand touching, and other activities (null). In an unconstrained user study with 12 participants, MunchSonic achieves a 93.5% macro F1-score in a user-independent evaluation with a 2-second time resolution, demonstrating its effectiveness. Additionally, MunchSonic accurately tracks eating episodes and the frequency of food intake within those episodes. △ Less

Submitted 31 May, 2024; originally announced May 2024.

Comments: 8 pages, 7 figures

DFT mediated X2AuYZ6 (X= Cs, Rb; Z= Cl, Br, I) double Perovskites for photovoltaic and wasted heat management device applications

Authors: S. Mahmud, M. A. Ali, M. M. Hossain, M. M. Uddin

Abstract: This paper presents the phase stability, opto-electronic and thermo-electric behavior of X2AuYZ6 (X = Cs, Rb; Z = Cl/Br/I) double perovskite halides by using the DFT method. The compounds belong to the cubic arrangement and are verified by the tolerance and octahedral factor. Formation enthalpy and binding energy meet the requirements of structural stability. The ductility behavior was also confir… ▽ More This paper presents the phase stability, opto-electronic and thermo-electric behavior of X2AuYZ6 (X = Cs, Rb; Z = Cl/Br/I) double perovskite halides by using the DFT method. The compounds belong to the cubic arrangement and are verified by the tolerance and octahedral factor. Formation enthalpy and binding energy meet the requirements of structural stability. The ductility behavior was also confirmed by the Cauchy pressure, Pugh's ratio, and Poisson's ratio. The positive frequency of phonon dispersion except Rb2AuYI6 compound shows the dynamical stability and the negative formation energy of each identified competing phase confirms the thermo-dynamic equilibrium of all compounds. The band gap values of 2.85(2.91), 2.35(2.40), and 1.74(1.78) eV of Cs2AuYZ6 (Rb2AuYZ6) [Z = Cl, Br, I) double perovskites has been explored in the context of optoelectronic properties, and the results show that these materials might be useful in such devices. The spectral optical response covers the visible-to-UV area, which governs the solar cell and thermo-electric device applications. A comprehensive study of thermo-electric properties such as the thermal conductivity (electrical and electronic part), carrier concentration, thermo-power, and figure of merit was also observed. The investigated compounds [Cs (Rb)-based] exhibit ZT values of 0.51(0.55), 0.53(0.62), and 0.58(0.75) at room temperature with Cl, Br, and I respectively. Additional routine work was also done on the thermo-mechanical characteristics. These studies provide in-depth knowledge of these materials in preparation for their future use. △ Less

Submitted 24 April, 2024; originally announced April 2024.

ActSonic: Recognizing Everyday Activities from Inaudible Acoustic Waves Around the Body

Authors: Saif Mahmud, Vineet Parikh, Qikang Liang, Ke Li, Ruidong Zhang, Ashwin Ajit, Vipin Gunda, Devansh Agarwal, François Guimbretière, Cheng Zhang

Abstract: We present ActSonic, an intelligent, low-power active acoustic sensing system integrated into eyeglasses that can recognize 27 different everyday activities (e.g., eating, drinking, toothbrushing) from inaudible acoustic waves around the body with a time resolution of one second. It only needs a pair of miniature speakers and microphones mounted on each hinge of eyeglasses to emit ultrasonic waves… ▽ More We present ActSonic, an intelligent, low-power active acoustic sensing system integrated into eyeglasses that can recognize 27 different everyday activities (e.g., eating, drinking, toothbrushing) from inaudible acoustic waves around the body with a time resolution of one second. It only needs a pair of miniature speakers and microphones mounted on each hinge of eyeglasses to emit ultrasonic waves to create an acoustic aura around the body. Based on the position and motion of various body parts, the acoustic signals are reflected with unique patterns captured by the microphone and analyzed by a customized self-supervised deep learning framework to infer the performed activities. ActSonic was deployed in a user study with 19 participants across 19 households to evaluate its efficacy. Without requiring any training data from a new user (leave-one-participant-out evaluation), ActSonic was able to detect 27 activities, achieving an average F1-score of 86.6% in fully unconstrained scenarios and 93.4% in prompted settings at participants' homes. △ Less

Submitted 8 May, 2024; v1 submitted 22 April, 2024; originally announced April 2024.

Comments: 29 pages, 11 figures

Ring-a-Pose: A Ring for Continuous Hand Pose Tracking

Authors: Tianhong Catherine Yu, Guilin Hu, Ruidong Zhang, Hyunchul Lim, Saif Mahmud, Chi-Jung Lee, Ke Li, Devansh Agarwal, Shuyang Nie, Jinseok Oh, François Guimbretière, Cheng Zhang

Abstract: We present Ring-a-Pose, a single untethered ring that tracks continuous 3D hand poses. Located in the center of the hand, the ring emits an inaudible acoustic signal that each hand pose reflects differently. Ring-a-Pose imposes minimal obtrusions on the hand, unlike multi-ring or glove systems. It is not affected by the choice of clothing that may cover wrist-worn systems. In a series of three use… ▽ More We present Ring-a-Pose, a single untethered ring that tracks continuous 3D hand poses. Located in the center of the hand, the ring emits an inaudible acoustic signal that each hand pose reflects differently. Ring-a-Pose imposes minimal obtrusions on the hand, unlike multi-ring or glove systems. It is not affected by the choice of clothing that may cover wrist-worn systems. In a series of three user studies with a total of 30 participants, we evaluate Ring-a-Pose's performance on pose tracking and micro-finger gesture recognition. Without collecting any training data from a user, Ring-a-Pose tracks continuous hand poses with a joint error of 14.1mm. The joint error decreases to 10.3mm for fine-tuned user-dependent models. Ring-a-Pose recognizes 7-class micro-gestures with a 90.60% and 99.27% accuracy for user-independent and user-dependent models, respectively. Furthermore, the ring exhibits promising performance when worn on any finger. Ring-a-Pose enables the future of smart rings to track and recognize hand poses using relatively low-power acoustic sensing. △ Less

Submitted 19 April, 2024; originally announced April 2024.

The Impact of Machine Learning on Society: An Analysis of Current Trends and Future Implications

Authors: Md Kamrul Hossain Siam, Manidipa Bhattacharjee, Shakik Mahmud, Md. Saem Sarkar, Md. Masud Rana

Abstract: The Machine learning (ML) is a rapidly evolving field of technology that has the potential to greatly impact society in a variety of ways. However, there are also concerns about the potential negative effects of ML on society, such as job displacement and privacy issues. This research aimed to conduct a comprehensive analysis of the current and future impact of ML on society. The research included… ▽ More The Machine learning (ML) is a rapidly evolving field of technology that has the potential to greatly impact society in a variety of ways. However, there are also concerns about the potential negative effects of ML on society, such as job displacement and privacy issues. This research aimed to conduct a comprehensive analysis of the current and future impact of ML on society. The research included a thorough literature review, case studies, and surveys to gather data on the economic impact of ML, ethical and privacy implications, and public perceptions of the technology. The survey was conducted on 150 respondents from different areas. The case studies conducted were on the impact of ML on healthcare, finance, transportation, and manufacturing. The findings of this research revealed that the majority of respondents have a moderate level of familiarity with the concept of ML, believe that it has the potential to benefit society, and think that society should prioritize the development and use of ML. Based on these findings, it was recommended that more research is conducted on the impact of ML on society, stronger regulations and laws to protect the privacy and rights of individuals when it comes to ML should be developed, transparency and accountability in ML decision-making processes should be increased, and public education and awareness about ML should be enhanced. △ Less

Submitted 15 April, 2024; originally announced April 2024.

Comments: 12 pages

Revolutionizing Mental Health Care through LangChain: A Journey with a Large Language Model

Authors: Aditi Singh, Abul Ehtesham, Saifuddin Mahmud, Jong-Hoon Kim

Abstract: Mental health challenges are on the rise in our modern society, and the imperative to address mental disorders, especially regarding anxiety, depression, and suicidal thoughts, underscores the need for effective interventions. This paper delves into the application of recent advancements in pretrained contextualized language models to introduce MindGuide, an innovative chatbot serving as a mental… ▽ More Mental health challenges are on the rise in our modern society, and the imperative to address mental disorders, especially regarding anxiety, depression, and suicidal thoughts, underscores the need for effective interventions. This paper delves into the application of recent advancements in pretrained contextualized language models to introduce MindGuide, an innovative chatbot serving as a mental health assistant for individuals seeking guidance and support in these critical areas. MindGuide leverages the capabilities of LangChain and its ChatModels, specifically ChatOpenAI, as the bedrock of its reasoning engine. The system incorporates key features such as LangChain's ChatPrompt Template, HumanMessage Prompt Template, ConversationBufferMemory, and LLMChain, creating an advanced solution for early detection and comprehensive support within the field of mental health. Additionally, the paper discusses the implementation of Streamlit to enhance the user experience and interaction with the chatbot. This novel approach holds great promise for proactive mental health intervention and assistance. △ Less

Submitted 21 February, 2024; originally announced March 2024.

Comments: 2024 IEEE 14th Annual Computing and Communication Workshop and Conference (CCWC)

GazeTrak: Exploring Acoustic-based Eye Tracking on a Glass Frame

Authors: Ke Li, Ruidong Zhang, Boao Chen, Siyuan Chen, Sicheng Yin, Saif Mahmud, Qikang Liang, François Guimbretière, Cheng Zhang

Abstract: In this paper, we present GazeTrak, the first acoustic-based eye tracking system on glasses. Our system only needs one speaker and four microphones attached to each side of the glasses. These acoustic sensors capture the formations of the eyeballs and the surrounding areas by emitting encoded inaudible sound towards eyeballs and receiving the reflected signals. These reflected signals are further… ▽ More In this paper, we present GazeTrak, the first acoustic-based eye tracking system on glasses. Our system only needs one speaker and four microphones attached to each side of the glasses. These acoustic sensors capture the formations of the eyeballs and the surrounding areas by emitting encoded inaudible sound towards eyeballs and receiving the reflected signals. These reflected signals are further processed to calculate the echo profiles, which are fed to a customized deep learning pipeline to continuously infer the gaze position. In a user study with 20 participants, GazeTrak achieves an accuracy of 3.6° within the same remounting session and 4.9° across different sessions with a refreshing rate of 83.3 Hz and a power signature of 287.9 mW. Furthermore, we report the performance of our gaze tracking system fully implemented on an MCU with a low-power CNN accelerator (MAX78002). In this configuration, the system runs at up to 83.3 Hz and has a total power signature of 95.4 mW with a 30 Hz FPS. △ Less

Submitted 23 February, 2024; v1 submitted 22 February, 2024; originally announced February 2024.

Comments: 16 pages, 5 figures, 7 tables, The 30th Annual International Conference on Mobile Computing and Networking (ACM MobiCom 2024)

A Novel 1D Generative Adversarial Network-based Framework for Atrial Fibrillation Detection using Restored Wrist Photoplethysmography Signals

Authors: Faizul Rakib Sayem, Mosabber Uddin Ahmed, Saadia Binte Alam, Sakib Mahmud, Md. Mamun Sheikh, Abdulrahman Alqahtani, Md Ahasan Atick Faisal, Muhammad E. H. Chowdhury

Abstract: Atrial fibrillation (AF) increases the risk of stroke. Electrocardiogram (ECG) is used for AF detection, while photoplethysmography (PPG) is simple to use and appropriate for long-term monitoring. We have developed a novel approach to detect AF from smartwatch-based wrist PPG signals. To the best of our knowledge, this is the first study to employ 1D CycleGAN for the reconstruction of 1D wrist PPG… ▽ More Atrial fibrillation (AF) increases the risk of stroke. Electrocardiogram (ECG) is used for AF detection, while photoplethysmography (PPG) is simple to use and appropriate for long-term monitoring. We have developed a novel approach to detect AF from smartwatch-based wrist PPG signals. To the best of our knowledge, this is the first study to employ 1D CycleGAN for the reconstruction of 1D wrist PPG signals, since the quality of wrist PPG signals is very poor due to motion artifacts and acquisition site limitations. Our proposed approach is validated on a dataset of 21,278 10s long wrist PPG segments. The dataset was divided into two halves and two experiments were conducted. One half was used for training and the other half for testing and vice versa. Our classification model (Self-AFNet) with 1D-CycleGAN for restoration achieves an accuracy of 96.41% and 97.09% for both splits, respectively. There is a noteworthy improvement in accuracy (2.94% and 5.08% for test splits, respectively) for restored signals as compared to unrestored PPG. AF detection task was also performed using ECG signals with the matched PPG signals to assess the validity of employing reconstructed PPG-based AF classification. Self-AFNet managed to achieve an accuracy of 98.07% and 98.97%, respectively using two ECG splits which is comparable to the performance of AF detection utilizing reconstructed PPG segments. This study reflects that reconstructed wrist PPG signals acquired from wearable devices can be used for reliable detection of atrial fibrillation, which can significantly help in the reduction of the risk of stroke. △ Less

Submitted 23 December, 2023; v1 submitted 13 November, 2023; originally announced December 2023.

Hurricane and Storm Surges-Induced Power System Vulnerabilities and their Socioeconomic Impact

Authors: Abodh Poudyal, Shishir Lamichhane, Charlotte Wertz, Sajjad Uddin Mahmud, Anamika Dubey

Abstract: This paper introduces a probabilistic framework to quantify community vulnerability towards power losses due to extreme weather events. To analyze the impact of weather events on the power grid, the wind fields of historical hurricanes from 2000 to 2018 on the Texas coast are modeled using their available parameters, and probabilistic storm surge scenarios are constructed utilizing the hurricane c… ▽ More This paper introduces a probabilistic framework to quantify community vulnerability towards power losses due to extreme weather events. To analyze the impact of weather events on the power grid, the wind fields of historical hurricanes from 2000 to 2018 on the Texas coast are modeled using their available parameters, and probabilistic storm surge scenarios are constructed utilizing the hurricane characteristics. The vulnerability of hurricanes and storm surges is evaluated on a 2000 bus synthetic power grid model on the geographical footprint of Texas. The load losses, obtained via branch and substation outages, are then geographically represented at the county level and integrated with the publicly available Social Vulnerability Index to evaluate the Integrated Community Vulnerability Index (ICVI), which reflects the impacts of these extreme weather events on the socioeconomic and community power systems. The analysis concludes that the compounded impact of power outages due to extreme weather events can amplify the vulnerability of affected communities. Such analysis can help the system planners and operators make an informed decision. △ Less

Submitted 25 November, 2023; originally announced November 2023.

Comments: 5 pages, 6 figures, submitted to 2024 IEEE Power and Energy Society General Meeting for review

Physics-Enhanced TinyML for Real-Time Detection of Ground Magnetic Anomalies

Authors: Talha Siddique, MD Shaad Mahmud

Abstract: Space weather phenomena like geomagnetic disturbances (GMDs) and geomagnetically induced currents (GICs) pose significant risks to critical technological infrastructure. While traditional predictive models, grounded in simulation, hold theoretical robustness, they grapple with challenges, notably the assimilation of imprecise data and extensive computational complexities. In recent years, Tiny Mac… ▽ More Space weather phenomena like geomagnetic disturbances (GMDs) and geomagnetically induced currents (GICs) pose significant risks to critical technological infrastructure. While traditional predictive models, grounded in simulation, hold theoretical robustness, they grapple with challenges, notably the assimilation of imprecise data and extensive computational complexities. In recent years, Tiny Machine Learning (TinyML) has been adopted to develop Machine Learning (ML)-enabled magnetometer systems for predicting real-time terrestrial magnetic perturbations as a proxy measure for GIC. While TinyML offers efficient, real-time data processing, its intrinsic limitations prevent the utilization of robust methods with high computational needs. This paper developed a physics-guided TinyML framework to address the above challenges. This framework integrates physics-based regularization at the stages of model training and compression, thereby augmenting the reliability of predictions. The developed pruning scheme within the framework harnesses the inherent physical characteristics of the domain, striking a balance between model size and robustness. The study presents empirical results, drawing a comprehensive comparison between the accuracy and reliability of the developed framework and its traditional counterpart. Such a comparative analysis underscores the prospective applicability of the developed framework in conceptualizing robust, ML-enabled magnetometer systems for real-time space weather forecasting. △ Less

Submitted 19 November, 2023; originally announced November 2023.

Comments: 13 pages, 7 figures

A Novel Deep Learning Technique for Morphology Preserved Fetal ECG Extraction from Mother ECG using 1D-CycleGAN

Authors: Promit Basak, A. H. M Nazmus Sakib, Muhammad E. H. Chowdhury, Nasser Al-Emadi, Huseyin Cagatay Yalcin, Shona Pedersen, Sakib Mahmud, Serkan Kiranyaz, Somaya Al-Maadeed

Abstract: Monitoring the electrical pulse of fetal heart through a non-invasive fetal electrocardiogram (fECG) can easily detect abnormalities in the developing heart to significantly reduce the infant mortality rate and post-natal complications. Due to the overlapping of maternal and fetal R-peaks, the low amplitude of the fECG, systematic and ambient noises, typical signal extraction methods, such as adap… ▽ More Monitoring the electrical pulse of fetal heart through a non-invasive fetal electrocardiogram (fECG) can easily detect abnormalities in the developing heart to significantly reduce the infant mortality rate and post-natal complications. Due to the overlapping of maternal and fetal R-peaks, the low amplitude of the fECG, systematic and ambient noises, typical signal extraction methods, such as adaptive filters, independent component analysis, empirical mode decomposition, etc., are unable to produce satisfactory fECG. While some techniques can produce accurate QRS waves, they often ignore other important aspects of the ECG. Our approach, which is based on 1D CycleGAN, can reconstruct the fECG signal from the mECG signal while maintaining the morphology due to extensive preprocessing and appropriate framework. The performance of our solution was evaluated by combining two available datasets from Physionet, "Abdominal and Direct Fetal ECG Database" and "Fetal electrocardiograms, direct and abdominal with reference heartbeat annotations", where it achieved an average PCC and Spectral-Correlation score of 88.4% and 89.4%, respectively. It detects the fQRS of the signal with accuracy, precision, recall and F1 score of 92.6%, 97.6%, 94.8% and 96.4%, respectively. It can also accurately produce the estimation of fetal heart rate and R-R interval with an error of 0.25% and 0.27%, respectively. The main contribution of our work is that, unlike similar studies, it can retain the morphology of the ECG signal with high fidelity. The accuracy of our solution for fetal heart rate and R-R interval length is comparable to existing state-of-the-art techniques. This makes it a highly effective tool for early diagnosis of fetal heart diseases and regular health checkups of the fetus. △ Less

Submitted 25 September, 2023; originally announced October 2023.

Comments: 24 pages, 11 figures

Journal ref: Expert Systems with Applications, Volume 235, 2024, 121196, ISSN 0957-4174

DFT aided prediction of phase stability, optoelectronic and thermoelectric properties of A2AuScX6 (A= Cs, Rb; X= Cl, Br, I) double perovskites for energy harvesting technology

Authors: S. Mahmud, M. A. Ali, M. M. Hossain, M. M. Uddin

Abstract: In this work, density functional theory (DFT) is used to find out the ground state structures of A2AuScX6 (A= Cs, Rb; X= Cl, Br, I) double Perovskite (DP) halides for the first time. The DP A2AuScX6 halides were studied for their structural phase stability and optoelectronic properties in order to identify potential materials for energy harvesting systems. The stability criteria were verified by c… ▽ More In this work, density functional theory (DFT) is used to find out the ground state structures of A2AuScX6 (A= Cs, Rb; X= Cl, Br, I) double Perovskite (DP) halides for the first time. The DP A2AuScX6 halides were studied for their structural phase stability and optoelectronic properties in order to identify potential materials for energy harvesting systems. The stability criteria were verified by computing the formation energy, binding energy, phonon dispersion curve, stiffness constants, tolerance, and octahedral factors. The electronic band structure, carrier effective mass, density of states (DOS), and charge density distribution were calculated to reveal the nature of electronic conductivity and the chemical bonding nature present within them. For Cs2AuScX6 (Rb2AuScX6) [X = Cl, Br, I], the corresponding values of band gap [using TB-mBJ] are 1.88 (1.93), 1.68 (1.71), and 1.30 (1.32) eV. The optical constants (dielectric function, absorption coefficient, refractive index, energy loss function, photoconductivity, and reflectivity) were also calculated to get more insights into their electronic nature. For Cs2AuScX6 (Rb2AuScX6) [X = Cl, Br, I], the absorption coefficient in the visible range are 3.33 (3.45) 105 cm-1, 2.70 (2.81) 105 cm-1, and 2.13 (2.18) 105 cm-1, respectively. We also investigated the thermoelectric properties to predict promising applications in thermoelectric devices. Our calculations revealed high ZT values of 0.92, 1.07, and 1.06 for Cs2AuScX6 (X = Cl, Br, I) and 0.97, 0.99, and 1.01 for Rb2AuScX6 (X = Cl, Br, I) at 300 K. To further aid in predicting any novel materials, routine research was also done on the thermo-mechanical characteristics. The results suggest the compounds considered as potential candidates for use in solar cells and/or thermoelectric devices. △ Less

Submitted 1 October, 2023; originally announced October 2023.

Comments: 38

Optical, Thermal, and Electrical Analysis of Perovskite Solar Cell with Grated CdS and Embedded Plasmonic Au Nanoparticles

Authors: Ohidul Islam, M. Hussayeen Khan Anik, Sakib Mahmud, Joyprokash Debnath, Ahsan Habib, Sharnali Islam

Abstract: We propose a novel approach to enhance the performance of perovskite solar cells (PSCs) by incorporating grated Cadmium Sulfide (CdS) and plasmonic gold nanoparticles (Au NPs) into the absorber layer. The CdS grating acts as the electron transport layer and penetrates into the perovskite absorber layer, increasing the absorption of the active layer and reducing the electron-hole recombination rate… ▽ More We propose a novel approach to enhance the performance of perovskite solar cells (PSCs) by incorporating grated Cadmium Sulfide (CdS) and plasmonic gold nanoparticles (Au NPs) into the absorber layer. The CdS grating acts as the electron transport layer and penetrates into the perovskite absorber layer, increasing the absorption of the active layer and reducing the electron-hole recombination rate. The plasmonic Au NPs enhance the absorption in the infrared region by scattering and trapping the incident light. We perform a coupled optical and electrical study that shows a significant improvement in the short circuit current density (JSC) and power conversion efficiency (PCE) of the PSC after introducing the CdS grating and plasmonic Au NPs. Specifically, we observe a 48% increase in average optical absorption from 800 nm to 1400 nm and a 7.42 mA/cm^2 increase in JSC. We also find that the PCE of the PSC is increased by 7.91% when comparing the planar reference structure (without the CdS grating and the plasmonic Au NP). However, metal nanoparticles introduce ohmic losses and temperature rise in the solar cell. We analyze the non-radiative heat profile, electric field distribution, and temperature distribution across the PSC. We observe a temperature increase of approximately 14 K above the ambient temperature for the grated CdS layer with incorporated Au NPs, which is comparable to the temperature increase observed in the planar reference structure. Our results have the potential to pave the way for the development of highly efficient and stable PSCs in the future. △ Less

Submitted 18 September, 2023; originally announced September 2023.

Comments: 15 pages, 14 figures

IoMT-Blockchain based Secured Remote Patient Monitoring Framework for Neuro-Stimulation Device

Authors: Md Sakib Ullah Sourav, Mohammad Sultan Mahmud, Md Simul Hasan Talukder, Rejwan Bin Sulaiman, Abdullah Yasin

Abstract: Biomedical Engineering's Internet of Medical Things (IoMT) is helping to improve the accuracy, dependability, and productivity of electronic equipment in the healthcare business. Real-time sensory data from patients may be delivered and subsequently analyzed through rapid development of wearable IoMT devices, such as neuro-stimulation devices with a range of functions. Data from the Internet of Th… ▽ More Biomedical Engineering's Internet of Medical Things (IoMT) is helping to improve the accuracy, dependability, and productivity of electronic equipment in the healthcare business. Real-time sensory data from patients may be delivered and subsequently analyzed through rapid development of wearable IoMT devices, such as neuro-stimulation devices with a range of functions. Data from the Internet of Things is gathered, analyzed, and stored in a single location. However, single-point failure, data manipulation, privacy difficulties, and other challenges might arise as a result of centralization. Due to its decentralized nature, blockchain (BC) can alleviate these issues. The viability of establishing a non-invasive remote neurostimulation system employing IoMT-based transcranial Direct Current Stimulation is investigated in this work (tDCS). A hardware-based prototype tDCS device has been developed that can be operated over the internet using an android application. Our suggested framework addresses the problems of IoMTBC-based systems, meets the criteria of real-time remote patient monitoring systems, and incorporates literature best practices in the relevant fields. △ Less

Submitted 31 August, 2023; originally announced August 2023.

Comments: 8 Figures and 2 Tables

Large Language Models Based Automatic Synthesis of Software Specifications

Authors: Shantanu Mandal, Adhrik Chethan, Vahid Janfaza, S M Farabi Mahmud, Todd A Anderson, Javier Turek, Jesmin Jahan Tithi, Abdullah Muzahid

Abstract: Software configurations play a crucial role in determining the behavior of software systems. In order to ensure safe and error-free operation, it is necessary to identify the correct configuration, along with their valid bounds and rules, which are commonly referred to as software specifications. As software systems grow in complexity and scale, the number of configurations and associated specific… ▽ More Software configurations play a crucial role in determining the behavior of software systems. In order to ensure safe and error-free operation, it is necessary to identify the correct configuration, along with their valid bounds and rules, which are commonly referred to as software specifications. As software systems grow in complexity and scale, the number of configurations and associated specifications required to ensure the correct operation can become large and prohibitively difficult to manipulate manually. Due to the fast pace of software development, it is often the case that correct software specifications are not thoroughly checked or validated within the software itself. Rather, they are frequently discussed and documented in a variety of external sources, including software manuals, code comments, and online discussion forums. Therefore, it is hard for the system administrator to know the correct specifications of configurations due to the lack of clarity, organization, and a centralized unified source to look at. To address this challenge, we propose SpecSyn a framework that leverages a state-of-the-art large language model to automatically synthesize software specifications from natural language sources. Our approach formulates software specification synthesis as a sequence-to-sequence learning problem and investigates the extraction of specifications from large contextual texts. This is the first work that uses a large language model for end-to-end specification synthesis from natural language texts. Empirical results demonstrate that our system outperforms prior the state-of-the-art specification synthesis tool by 21% in terms of F1 score and can find specifications from single as well as multiple sentences. △ Less

Submitted 17 April, 2023; originally announced April 2023.

Context-Aware Target Classification with Hybrid Gaussian Process prediction for Cooperative Vehicle Safety systems

Authors: Rodolfo Valiente, Arash Raftari, Hossein Nourkhiz Mahjoub, Mahdi Razzaghpour, Syed K. Mahmud, Yaser P. Fallah

Abstract: Vehicle-to-Everything (V2X) communication has been proposed as a potential solution to improve the robustness and safety of autonomous vehicles by improving coordination and removing the barrier of non-line-of-sight sensing. Cooperative Vehicle Safety (CVS) applications are tightly dependent on the reliability of the underneath data system, which can suffer from loss of information due to the inhe… ▽ More Vehicle-to-Everything (V2X) communication has been proposed as a potential solution to improve the robustness and safety of autonomous vehicles by improving coordination and removing the barrier of non-line-of-sight sensing. Cooperative Vehicle Safety (CVS) applications are tightly dependent on the reliability of the underneath data system, which can suffer from loss of information due to the inherent issues of their different components, such as sensors failures or the poor performance of V2X technologies under dense communication channel load. Particularly, information loss affects the target classification module and, subsequently, the safety application performance. To enable reliable and robust CVS systems that mitigate the effect of information loss, we proposed a Context-Aware Target Classification (CA-TC) module coupled with a hybrid learning-based predictive modeling technique for CVS systems. The CA-TC consists of two modules: A Context-Aware Map (CAM), and a Hybrid Gaussian Process (HGP) prediction system. Consequently, the vehicle safety applications use the information from the CA-TC, making them more robust and reliable. The CAM leverages vehicles path history, road geometry, tracking, and prediction; and the HGP is utilized to provide accurate vehicles' trajectory predictions to compensate for data loss (due to communication congestion) or sensor measurements' inaccuracies. Based on offline real-world data, we learn a finite bank of driver models that represent the joint dynamics of the vehicle and the drivers' behavior. We combine offline training and online model updates with on-the-fly forecasting to account for new possible driver behaviors. Finally, our framework is validated using simulation and realistic driving scenarios to confirm its potential in enhancing the robustness and reliability of CVS systems. △ Less

Submitted 24 December, 2022; originally announced December 2022.

Spatiotemporal Impact Analysis of Hurricanes and Storm Surges on Power Systems

Authors: Abodh Poudyal, Charlotte Wertz, Amy Mi Nguyen, Sajjad Uddin Mahmud, Vibha Gunturi, Anamika Dubey

Abstract: This paper develops a spatiotemporal probabilistic impact assessment framework to analyze and quantify the compounding effect of hurricanes and storm surges on the bulk power grid. The probabilistic synthetic hurricane tracks are generated using historical hurricane data, and storm surge scenarios are generated based on observed hurricane parameters. The system losses are modeled using a loss metr… ▽ More This paper develops a spatiotemporal probabilistic impact assessment framework to analyze and quantify the compounding effect of hurricanes and storm surges on the bulk power grid. The probabilistic synthetic hurricane tracks are generated using historical hurricane data, and storm surge scenarios are generated based on observed hurricane parameters. The system losses are modeled using a loss metric that quantifies the total load loss. The overall simulation is performed on the synthetic Texas 2000-bus system mapped on the geographical footprint of Texas. The results show that power substation inundation due to storm surge creates additional load losses as the hurricane traverses inland. △ Less

Submitted 24 November, 2022; originally announced December 2022.

Comments: 5 pages, 9 figures, submitted to 2023 IEEE Power and Energy Society General Meeting for review

STLGRU: Spatio-Temporal Lightweight Graph GRU for Traffic Flow Prediction

Authors: Kishor Kumar Bhaumik, Fahim Faisal Niloy, Saif Mahmud, Simon Woo

Abstract: Reliable forecasting of traffic flow requires efficient modeling of traffic data. Indeed, different correlations and influences arise in a dynamic traffic network, making modeling a complicated task. Existing literature has proposed many different methods to capture traffic networks' complex underlying spatial-temporal relations. However, given the heterogeneity of traffic data, consistently captu… ▽ More Reliable forecasting of traffic flow requires efficient modeling of traffic data. Indeed, different correlations and influences arise in a dynamic traffic network, making modeling a complicated task. Existing literature has proposed many different methods to capture traffic networks' complex underlying spatial-temporal relations. However, given the heterogeneity of traffic data, consistently capturing both spatial and temporal dependencies presents a significant challenge. Also, as more and more sophisticated methods are being proposed, models are increasingly becoming memory-heavy and, thus, unsuitable for low-powered devices. To this end, we propose Spatio-Temporal Lightweight Graph GRU, namely STLGRU, a novel traffic forecasting model for predicting traffic flow accurately. Specifically, our proposed STLGRU can effectively capture dynamic local and global spatial-temporal relations of traffic networks using memory-augmented attention and gating mechanisms in a continuously synchronized manner. Moreover, instead of employing separate temporal and spatial components, we show that our memory module and gated unit can successfully learn the spatial-temporal dependencies with reduced memory usage and fewer parameters. Extensive experimental results on three real-world public traffic datasets demonstrate that our method can not only achieve state-of-the-art performance but also exhibit competitive computational efficiency. Our code is available at https://github.com/Kishor-Bhaumik/STLGRU △ Less

Submitted 19 February, 2024; v1 submitted 8 December, 2022; originally announced December 2022.

Comments: PAKDD 2024 (Oral)

Evaluation of Arterial Signal Coordination with Commercial Connected Vehicle Data: Empirical Traffic Flow Visualization and Performance Measurement

Authors: Shoaib Mahmud, Christopher M. Day

Abstract: Emerging connected vehicle (CV) data sets have recently become commercially available. This paper presents several tools using CV data to evaluate traffic progression quality along a signalized corridor. These include both performance measures for high-level analysis as well as visualizations to examine details of the coordinated operation. With the use of CV data, it is possible to assess not onl… ▽ More Emerging connected vehicle (CV) data sets have recently become commercially available. This paper presents several tools using CV data to evaluate traffic progression quality along a signalized corridor. These include both performance measures for high-level analysis as well as visualizations to examine details of the coordinated operation. With the use of CV data, it is possible to assess not only the movement of traffic on the corridor but also to consider its origin-destination (OD) path through the corridor. Results for the real-world operation of an eight-intersection signalized arterial are presented. A series of high-level performance measures are used to evaluate overall performance by time of day, with differing results by metric. Next, the details of the operation are examined with the use of two visualization tools: a cyclic time-space diagram (TSD) and an empirical platoon progression diagram (PPD). Comparing flow visualizations developed with different included OD paths reveals several features. In addition, speed heat maps are generated, providing both speed performance along the corridor. The proposed visualization tools portray the corridor performance holistically instead of combining individual signal performance metrics. The techniques exhibited in this study are compelling for identifying locations where engineering solutions are required. The recent progress in infrastructure-free sensing technology has significantly increased the scope of CV data-based traffic management systems. The study demonstrates the utility of CV trajectory data for obtaining high-level details of the corridor performance and drilling down into the minute specifics. △ Less

Submitted 19 June, 2023; v1 submitted 2 December, 2022; originally announced December 2022.

Comments: presented at the Transportation Research Board Annual Meeting, Transportation Research Board, 2023, Washington, DC, and then published in the Journal of Transportation Technologies in 2023

Journal ref: Journal of Transportation Technologies 13 (2023) 327-352

Output Feedback Adaptive Optimal Control of Affine Nonlinear systems with a Linear Measurement Model

Authors: Tochukwu Elijah Ogri, S. M. Nahid Mahmud, Zachary I. Bell, Rushikesh Kamalapurkar

Abstract: Real-world control applications in complex and uncertain environments require adaptability to handle model uncertainties and robustness against disturbances. This paper presents an online, output-feedback, critic-only, model-based reinforcement learning architecture that simultaneously learns and implements an optimal controller while maintaining stability during the learning phase. Using multipli… ▽ More Real-world control applications in complex and uncertain environments require adaptability to handle model uncertainties and robustness against disturbances. This paper presents an online, output-feedback, critic-only, model-based reinforcement learning architecture that simultaneously learns and implements an optimal controller while maintaining stability during the learning phase. Using multiplier matrices, a convenient way to search for observer gains is designed along with a controller that learns from simulated experience to ensure stability and convergence of trajectories of the closed-loop system to a neighborhood of the origin. Local uniform ultimate boundedness of the trajectories is established using a Lyapunov-based analysis and demonstrated through simulation results, under mild excitation conditions. △ Less

Submitted 3 April, 2023; v1 submitted 12 October, 2022; originally announced October 2022.

Comments: 16 pages, 5 figures, submitted to 2023 IEEE Conference on Control Technology and Applications

Transformer-based Text Classification on Unified Bangla Multi-class Emotion Corpus

Authors: Md Sakib Ullah Sourav, Huidong Wang, Mohammad Sultan Mahmud, Hua Zheng

Abstract: In this research, we propose a complete set of approaches for identifying and extracting emotions from Bangla texts. We provide a Bangla emotion classifier for six classes: anger, disgust, fear, joy, sadness, and surprise, from Bangla words using transformer-based models, which exhibit phenomenal results in recent days, especially for high-resource languages. The Unified Bangla Multi-class Emotion… ▽ More In this research, we propose a complete set of approaches for identifying and extracting emotions from Bangla texts. We provide a Bangla emotion classifier for six classes: anger, disgust, fear, joy, sadness, and surprise, from Bangla words using transformer-based models, which exhibit phenomenal results in recent days, especially for high-resource languages. The Unified Bangla Multi-class Emotion Corpus (UBMEC) is used to assess the performance of our models. UBMEC is created by combining two previously released manually labeled datasets of Bangla comments on six emotion classes with fresh manually labeled Bangla comments created by us. The corpus dataset and code we used in this work are publicly available. △ Less

Submitted 13 June, 2023; v1 submitted 12 October, 2022; originally announced October 2022.

Comments: https://github.com/Sakibsourav019/UBMEC-Unified-Bangla-Multi-class-Emotion-Corpus-

Real-Time Machine Learning Enabled Low-Cost Magnetometer System

Authors: Talha Siddique, Md. Shaad Mahmud

Abstract: Geomagnetically Induced Currents (GICs) are one of the most hazardous effects of space weather. The rate of change in ground horizontal magnetic component dBH/dt is used as a proxy measure for GIC. In order to monitor and predict dBH/dt, ground-based fluxgate magnetometers are used. However, baseline correction is crucial before such magnetometer data can be utilized. In this paper, a low-cost Mac… ▽ More Geomagnetically Induced Currents (GICs) are one of the most hazardous effects of space weather. The rate of change in ground horizontal magnetic component dBH/dt is used as a proxy measure for GIC. In order to monitor and predict dBH/dt, ground-based fluxgate magnetometers are used. However, baseline correction is crucial before such magnetometer data can be utilized. In this paper, a low-cost Machine Learning (ML) enabled magnetometer system has been implemented to perform realtime baseline correction of magnetometer data. The predicted geomagnetic components are then used to derive a forecast for dBH/dt. Two different ML models were deployed, and their real-time and offline prediction accuracy were examined. The localized peaks of the predicted dBH/dt are further validated using binary event analysis. △ Less

Submitted 16 September, 2022; originally announced September 2022.

Comments: Selected in IEEE Sensors Conference 2022

Design, Implementation, and Performance Evaluation of a Fiber Bragg Gratings(FBG) based Smart Insole to Measure Plantar Pressure and Temperature

Authors: Sakib Mahmud, Amith Khandakar, Muhammad E. H. Chowdhury, Mohammed AbdulMoniem, Mamun Bin Ibne Reaz, Zaid Bin Mahbub, Kishor Kumar Sadasivuni, M Murugappan, Mohammed Alhatou

Abstract: Various foot complications can be easily avoided by continuous monitoring of foot plantar temperature and pressure. In this work, the design, characterization, and implementation of a Fiber Bragg Gratings (FBG) based smart insole capable of simultaneously measuring plantar pressure and temperature has been reported. The instrumented insole was tested and verified during static and gait exercises.… ▽ More Various foot complications can be easily avoided by continuous monitoring of foot plantar temperature and pressure. In this work, the design, characterization, and implementation of a Fiber Bragg Gratings (FBG) based smart insole capable of simultaneously measuring plantar pressure and temperature has been reported. The instrumented insole was tested and verified during static and gait exercises. The paper also provides a comparison of the developed optoelectronic-based solution with a commercially available and widely used plantar pressure measurement and analysis system and a lab-made, electronic sensor-based smart insole that can measure both plantar temperature and pressure. It was shown that even though the commercially available expensive system is very robust and highly precise due to many sensing units on the insole, the developed insole with a smaller number of sensors can provide both plantar temperature and pressure with reasonable precision while displaying both foot pressure and temperature maps, and gait cycle plots in real-time. The FBG-based solution is comfortable and safer than the other systems being compared. Thus, confirming the effectiveness of the proposed solution as an addition to the research area for detecting foot complications non-invasively using foot insoles. △ Less

Submitted 25 August, 2022; originally announced August 2022.

Design and Implementation of a Complete Wearable Smart Insole Solution to Measure Plantar Pressure and Temperature

Authors: Amith Khandakar, Sakib Mahmud, Muhammad E. H. Chowdhury, Mamun Bin Ibne Reaz, Serkan Kiranyaz, Zaid Bin Mahbub, Sawal Hamid Md Ali, Ahmad Ashrif A Bakar, Mohammed Alhatou, Mohammed AbdulMoniem

Abstract: A complete smart insole solution that continuously monitors the foot plantar pressure and temperature can detect foot complications early and that too from the convenience of the user home. Widespread health complications such as Diabetic Mellitus need continuous foot complication monitoring to avoid severe complications. With that motivation, this paper provides a detailed design of a wearable in… ▽ More A complete smart insole solution that continuously monitors the foot plantar pressure and temperature can detect foot complications early and that too from the convenience of the user home. Widespread health complications such as Diabetic Mellitus need continuous foot complication monitoring to avoid severe complications. With that motivation, this paper provides a detailed design of a wearable insole using popular off-the-shelf sensors to monitor foot plantar pressure and temperature. The design provides details of which temperature and pressure to be used, circuit configuration for characterizing the sensors, and the considerations for developing a compact Printed Circuit board design using appropriate microcontrollers and communication protocol. The system also provides details of how the foot pressure and temperature data from the subjects using the sensors can be transferred wirelessly using a low-power consuming communication protocol to a central device where the data will be recorded. The investigation can help in developing a low-cost, feasible and portable foot monitoring system for patients by facilitating real-time, home monitoring of foot condition using Gait Cycle or Foot Pressure patterns and temperature heterogeneity between two feet. The proposed system will work in real-time. △ Less

Submitted 15 June, 2022; originally announced June 2022.

Comments: 29 page, 30 figures

Deep Learning Prediction of Severe Health Risks for Pediatric COVID-19 Patients with a Large Feature Set in 2021 BARDA Data Challenge

Authors: Sajid Mahmud, Elham Soltanikazemi, Frimpong Boadu, Ashwin Dhakal, Jianlin Cheng

Abstract: Most children infected with COVID-19 have no or mild symptoms and can recover automatically by themselves, but some pediatric COVID-19 patients need to be hospitalized or even to receive intensive medical care (e.g., invasive mechanical ventilation or cardiovascular support) to recover from the illnesses. Therefore, it is critical to predict the severe health risk that COVID-19 infection poses to… ▽ More Most children infected with COVID-19 have no or mild symptoms and can recover automatically by themselves, but some pediatric COVID-19 patients need to be hospitalized or even to receive intensive medical care (e.g., invasive mechanical ventilation or cardiovascular support) to recover from the illnesses. Therefore, it is critical to predict the severe health risk that COVID-19 infection poses to children to provide precise and timely medical care for vulnerable pediatric COVID-19 patients. However, predicting the severe health risk for COVID-19 patients including children remains a significant challenge because many underlying medical factors affecting the risk are still largely unknown. In this work, instead of searching for a small number of most useful features to make prediction, we design a novel large-scale bag-of-words like method to represent various medical conditions and measurements of COVID-19 patients. After some simple feature filtering based on logistical regression, the large set of features is used with a deep learning method to predict both the hospitalization risk for COVID-19 infected children and the severe complication risk for the hospitalized pediatric COVID-19 patients. The method was trained and tested the datasets of the Biomedical Advanced Research and Development Authority (BARDA) Pediatric COVID-19 Data Challenge held from Sept. 15 to Dec. 17, 2021. The results show that the approach can rather accurately predict the risk of hospitalization and severe complication for pediatric COVID-19 patients and deep learning is more accurate than other machine learning methods. △ Less

Submitted 6 June, 2022; v1 submitted 3 June, 2022; originally announced June 2022.

Comments: Acknowledgment updated, minor typos fixed

Causal Explanations for Sequential Decision Making Under Uncertainty

Authors: Samer B. Nashed, Saaduddin Mahmud, Claudia V. Goldman, Shlomo Zilberstein

Abstract: We introduce a novel framework for causal explanations of stochastic, sequential decision-making systems built on the well-studied structural causal model paradigm for causal reasoning. This single framework can identify multiple, semantically distinct explanations for agent actions -- something not previously possible. In this paper, we establish exact methods and several approximation techniques… ▽ More We introduce a novel framework for causal explanations of stochastic, sequential decision-making systems built on the well-studied structural causal model paradigm for causal reasoning. This single framework can identify multiple, semantically distinct explanations for agent actions -- something not previously possible. In this paper, we establish exact methods and several approximation techniques for causal inference on Markov decision processes using this framework, followed by results on the applicability of the exact methods and some run time bounds. We discuss several scenarios that illustrate the framework's flexibility and the results of experiments with human subjects that confirm the benefits of this approach. △ Less

Submitted 10 January, 2023; v1 submitted 30 May, 2022; originally announced May 2022.

Comments: 9 pages, 7 figures

Optically induced static magnetic field in ensemble of nitrogen-vacancy centers in diamond

Authors: Farid Kalhor, Noah F. Opondo, Shoaib Mahmud, Leif Bauer, Li-Ping Yang, Sunil A. Bhave, Zubin Jacob

Abstract: Generation of local magnetic field at the nanoscale is desired for many applications such as spin-qubit-based quantum memories. However, this is a challenge due to the slow decay of static magnetic fields. Here, we demonstrate photonic spin density (PSD) induced effective static magnetic field for an ensemble of nitrogen-vacancy (NV) centers in bulk diamond. This locally induced magnetic field is… ▽ More Generation of local magnetic field at the nanoscale is desired for many applications such as spin-qubit-based quantum memories. However, this is a challenge due to the slow decay of static magnetic fields. Here, we demonstrate photonic spin density (PSD) induced effective static magnetic field for an ensemble of nitrogen-vacancy (NV) centers in bulk diamond. This locally induced magnetic field is a result of coherent interaction between the optical excitation and the NV centers. We demonstrate an optically induced spin rotation on the Bloch sphere exceeding 10 degrees which has potential applications in all optical coherent control of spin qubits. △ Less

Submitted 6 May, 2022; originally announced May 2022.

Comments: 6 pages, 5 figures

Safe Controller for Output Feedback Linear Systems using Model-Based Reinforcement Learning

Authors: S M Nahid Mahmud, Moad Abudia, Scott A Nivison, Zachary I. Bell, Rushikesh Kamalapurkar

Abstract: The objective of this research is to enable safety-critical systems to simultaneously learn and execute optimal control policies in a safe manner to achieve complex autonomy. Learning optimal policies via trial and error, i.e., traditional reinforcement learning, is difficult to implement in safety-critical systems, particularly when task restarts are unavailable. Safe model-based reinforcement le… ▽ More The objective of this research is to enable safety-critical systems to simultaneously learn and execute optimal control policies in a safe manner to achieve complex autonomy. Learning optimal policies via trial and error, i.e., traditional reinforcement learning, is difficult to implement in safety-critical systems, particularly when task restarts are unavailable. Safe model-based reinforcement learning techniques based on a barrier transformation have recently been developed to address this problem. However, these methods rely on full state feedback, limiting their usability in a real-world environment. In this work, an output-feedback safe model-based reinforcement learning technique based on a novel barrier-aware dynamic state estimator has been designed to address this issue. The developed approach facilitates simultaneous learning and execution of safe control policies for safety-critical linear systems. Simulation results indicate that barrier transformation is an effective approach to achieve online reinforcement learning in safety-critical systems using output feedback. △ Less

Submitted 4 April, 2022; originally announced April 2022.

Comments: arXiv admin note: substantial text overlap with arXiv:2110.00271

Attack of the Knights: A Non Uniform Cache Side-Channel Attack

Authors: Farabi Mahmud, Sungkeun Kim, Harpreet Singh Chawla, Chia-Che Tsai, Eun Jung Kim, Abdullah Muzahid

Abstract: For a distributed last-level cache (LLC) in a large multicore chip, the access time to one LLC bank can significantly differ from that to another due to the difference in physical distance. In this paper, we successfully demonstrated a new distance-based side-channel attack by timing the AES decryption operation and extracting part of an AES secret key on an Intel Knights Landing CPU. We introduce… ▽ More For a distributed last-level cache (LLC) in a large multicore chip, the access time to one LLC bank can significantly differ from that to another due to the difference in physical distance. In this paper, we successfully demonstrated a new distance-based side-channel attack by timing the AES decryption operation and extracting part of an AES secret key on an Intel Knights Landing CPU. We introduce several techniques to overcome the challenges of the attack, including the use of multiple attack threads to ensure LLC hits, to detect vulnerable memory locations, and to obtain fine-grained timing of the victim operations. While operating as a covert channel, this attack can reach a bandwidth of 205 kbps with an error rate of only 0.02%. We also observed that the side-channel attack can extract 4 bytes of an AES key with 100% accuracy with only 4000 trial rounds of encryption △ Less

Submitted 31 May, 2023; v1 submitted 18 December, 2021; originally announced December 2021.

Journal ref: Annual Computer Security Applications Conference ACSAC 2023

A Shallow U-Net Architecture for Reliably Predicting Blood Pressure (BP) from Photoplethysmogram (PPG) and Electrocardiogram (ECG) Signals

Authors: Sakib Mahmud, Nabil Ibtehaz, Amith Khandakar, Anas Tahir, Tawsifur Rahman, Khandaker Reajul Islam, Md Shafayet Hossain, M. Sohel Rahman, Mohammad Tariqul Islam, Muhammad E. H. Chowdhury

Abstract: Cardiovascular diseases are the most common causes of death around the world. To detect and treat heart-related diseases, continuous Blood Pressure (BP) monitoring along with many other parameters are required. Several invasive and non-invasive methods have been developed for this purpose. Most existing methods used in the hospitals for continuous monitoring of BP are invasive. On the contrary, cu… ▽ More Cardiovascular diseases are the most common causes of death around the world. To detect and treat heart-related diseases, continuous Blood Pressure (BP) monitoring along with many other parameters are required. Several invasive and non-invasive methods have been developed for this purpose. Most existing methods used in the hospitals for continuous monitoring of BP are invasive. On the contrary, cuff-based BP monitoring methods, which can predict Systolic Blood Pressure (SBP) and Diastolic Blood Pressure (DBP), cannot be used for continuous monitoring. Several studies attempted to predict BP from non-invasively collectible signals such as Photoplethysmogram (PPG) and Electrocardiogram (ECG), which can be used for continuous monitoring. In this study, we explored the applicability of autoencoders in predicting BP from PPG and ECG signals. The investigation was carried out on 12,000 instances of 942 patients of the MIMIC-II dataset and it was found that a very shallow, one-dimensional autoencoder can extract the relevant features to predict the SBP and DBP with the state-of-the-art performance on a very large dataset. Independent test set from a portion of the MIMIC-II dataset provides an MAE of 2.333 and 0.713 for SBP and DBP, respectively. On an external dataset of forty subjects, the model trained on the MIMIC-II dataset, provides an MAE of 2.728 and 1.166 for SBP and DBP, respectively. For both the cases, the results met British Hypertension Society (BHS) Grade A and surpassed the studies from the current literature. △ Less

Submitted 12 November, 2021; originally announced November 2021.

Comments: 22 pages, Figure 8, Table 13

Journal ref: Sensors 2022, 22(3), 919

Learning Cooperation and Online Planning Through Simulation and Graph Convolutional Network

Authors: Rafid Ameer Mahmud, Fahim Faisal, Saaduddin Mahmud, Md. Mosaddek Khan

Abstract: Multi-agent Markov Decision Process (MMDP) has been an effective way of modelling sequential decision making algorithms for multi-agent cooperative environments. A number of algorithms based on centralized and decentralized planning have been developed in this domain. However, dynamically changing environment, coupled with exponential size of the state and joint action space, make it difficult for… ▽ More Multi-agent Markov Decision Process (MMDP) has been an effective way of modelling sequential decision making algorithms for multi-agent cooperative environments. A number of algorithms based on centralized and decentralized planning have been developed in this domain. However, dynamically changing environment, coupled with exponential size of the state and joint action space, make it difficult for these algorithms to provide both efficiency and scalability. Recently, Centralized planning algorithm FV-MCTS-MP and decentralized planning algorithm \textit{Alternate maximization with Behavioural Cloning} (ABC) have achieved notable performance in solving MMDPs. However, they are not capable of adapting to dynamically changing environments and accounting for the lack of communication among agents, respectively. Against this background, we introduce a simulation based online planning algorithm, that we call SiCLOP, for multi-agent cooperative environments. Specifically, SiCLOP tailors Monte Carlo Tree Search (MCTS) and uses Coordination Graph (CG) and Graph Neural Network (GCN) to learn cooperation and provides real time solution of a MMDP problem. It also improves scalability through an effective pruning of action space. Additionally, unlike FV-MCTS-MP and ABC, SiCLOP supports transfer learning, which enables learned agents to operate in different environments. We also provide theoretical discussion about the convergence property of our algorithm within the context of multi-agent settings. Finally, our extensive empirical results show that SiCLOP significantly outperforms the state-of-the-art online planning algorithms. △ Less

Submitted 16 October, 2021; originally announced October 2021.

An Artificial Bee Colony Based Algorithm for Continuous Distributed Constraint Optimization Problems

Authors: K. M. Merajul Arefin, Mashrur Rashik, Saaduddin Mahmud, Md. Mosaddek Khan

Abstract: Distributed Constraint Optimization Problems (DCOPs) are a frequently used framework in which a set of independent agents choose values from their respective discrete domains to maximize their utility. Although this formulation is typically appropriate, there are a number of real-world applications in which the decision variables are continuous-valued and the constraints are represented in functio… ▽ More Distributed Constraint Optimization Problems (DCOPs) are a frequently used framework in which a set of independent agents choose values from their respective discrete domains to maximize their utility. Although this formulation is typically appropriate, there are a number of real-world applications in which the decision variables are continuous-valued and the constraints are represented in functional form. To address this, Continuous Distributed Constraint Optimization Problems (C-DCOPs), an extension of the DCOPs paradigm, have recently grown the interest of the multi-agent systems field. To date, among different approaches, population-based algorithms are shown to be most effective for solving C-DCOPs. Considering the potential of population-based approaches, we propose a new C-DCOPs solver inspired by a well-known population-based algorithm Artificial Bee Colony (ABC). Additionally, we provide a new exploration method that aids in the further improvement of the algorithm's solution quality. Finally, We theoretically prove that our approach is an anytime algorithm and empirically show it produces significantly better results than the state-of-the-art C-DCOPs algorithms. △ Less

Submitted 14 October, 2021; originally announced October 2021.

Comments: 7 pages, 7 figures

Safety aware model-based reinforcement learning for optimal control of a class of output-feedback nonlinear systems

Authors: S M Nahid Mahmud, Moad Abudia, Scott A Nivison, Zachary I. Bell, Rushikesh Kamalapurkar

Abstract: The ability to learn and execute optimal control policies safely is critical to realization of complex autonomy, especially where task restarts are not available and/or the systems are safety-critical. Safety requirements are often expressed in terms of state and/or control constraints. Methods such as barrier transformation and control barrier functions have been successfully used, in conjunction… ▽ More The ability to learn and execute optimal control policies safely is critical to realization of complex autonomy, especially where task restarts are not available and/or the systems are safety-critical. Safety requirements are often expressed in terms of state and/or control constraints. Methods such as barrier transformation and control barrier functions have been successfully used, in conjunction with model-based reinforcement learning, for safe learning in systems under state constraints, to learn the optimal control policy. However, existing barrier-based safe learning methods rely on full state feedback. In this paper, an output-feedback safe model-based reinforcement learning technique is developed that utilizes a novel dynamic state estimator to implement simultaneous learning and control for a class of safety-critical systems with partially observable state. △ Less

Submitted 1 October, 2021; originally announced October 2021.

Comments: arXiv admin note: substantial text overlap with arXiv:2007.12666

Vaccine efficacy and SARS CoV 2 control in California and USA during the session 2020 2026: A modeling study

Authors: Md. Shahriar Mahmud, Md. Kamrujjaman, Md. Mashih Ibn Yasin Adan, Md. Alamgir Hossain, Md. Mizanur Rahman, Md. Shahidul Islam, Muhammad Mohebujjaman, Md. Mamun Molla

Abstract: Besides maintaining health precautions, vaccination has been the only prevention from SARS-CoV-2, though no clinically proved 100% effective vaccine has been developed till date. At this stage, to withhold the debris of this pandemic, experts need to know the impact of the vaccine efficacy rate's threshold and how long this pandemic may extent with vaccines that have different efficacy rates. In t… ▽ More Besides maintaining health precautions, vaccination has been the only prevention from SARS-CoV-2, though no clinically proved 100% effective vaccine has been developed till date. At this stage, to withhold the debris of this pandemic, experts need to know the impact of the vaccine efficacy rate's threshold and how long this pandemic may extent with vaccines that have different efficacy rates. In this article, a mathematical model study has been done on the importance of vaccination and vaccine efficiency rate during an ongoing pandemic. We simulated a five compartment mathematical model to analyze the pandemic scenario in both California, and whole U.S. We considered four vaccines, Pfizer, Moderna, AstraZeneca, and Johnson and Johnson, which are being used rigorously to control the COVID-19 pandemic, in addition with two special cases: a vaccine with 100% efficacy rate and no vaccine under use. Both the infection and death rates are very high in California. Our model suggests that the pandemic situation in California will be under control in the last quartile of the year 2023 if frequent vaccination is continued with the Pfizer vaccine. During this time, six waves will happen from the beginning of the immunization where the case fatality and recovery rates will be 1.697% and 98.30%, respectively. However, according to the considered model, this period might be extended to the mid of 2024 when vaccines with lower efficacy rates are used. The more effective a vaccine, the less people suffer from this malign infection. Although specific groups of people get prioritized initially, mass vaccination is needed to control the spread of the disease. △ Less

Submitted 15 September, 2021; originally announced September 2021.

MSC Class: 92D25; 92D30; 97M60; 97M99

Knowledge, beliefs, attitudes and perceived risk about COVID-19 vaccine and determinants of COVID-19 vaccine acceptance in Bangladesh

Authors: Sultan Mahmud, Md. Mohsin, Ijaz Ahmed Khan, Ashraf Uddin Mian, Miah Akib Zaman

Abstract: A total of 605 eligible respondents took part in this survey (population size 1630046161 and required sample size 591) with an age range of 18 to 100. A large proportion of the respondents are aged less than 50 (82%) and male (62.15%). The majority of the respondents live in urban areas (60.83%). A total of 61.16% (370/605) of the respondents were willing to accept/take the COVID-19 vaccine. Among… ▽ More A total of 605 eligible respondents took part in this survey (population size 1630046161 and required sample size 591) with an age range of 18 to 100. A large proportion of the respondents are aged less than 50 (82%) and male (62.15%). The majority of the respondents live in urban areas (60.83%). A total of 61.16% (370/605) of the respondents were willing to accept/take the COVID-19 vaccine. Among the accepted group, only 35.14% showed the willingness to take the COVID-19 vaccine immediately, while 64.86% would delay the vaccination until they are confirmed about the vaccine s efficacy and safety or COVID-19 becomes deadlier in Bangladesh. The regression results showed age, gender, location (urban/rural), level of education, income, perceived risk of being infected with COVID-19 in the future, perceived severity of infection, having previous vaccination experience after age 18, having higher knowledge about COVID-19 and vaccination were significantly associated with the acceptance of COVID-19 vaccines. The research reported a high prevalence of COVID-19 vaccine refusal and hesitancy in Bangladesh. △ Less

Submitted 9 November, 2022; v1 submitted 28 March, 2021; originally announced March 2021.

Comments: Accepted by PLOS ONE: https://doi.org/10.1371/journal.pone.0257096

Journal ref: Plos One 16(9):e0257096 (2021)

QUCoughScope: An Artificially Intelligent Mobile Application to Detect Asymptomatic COVID-19 Patients using Cough and Breathing Sounds

Authors: Muhammad E. H. Chowdhury, Nabil Ibtehaz, Tawsifur Rahman, Yosra Magdi Salih Mekki, Yazan Qibalwey, Sakib Mahmud, Maymouna Ezeddin, Susu Zughaier, Sumaya Ali S A Al-Maadeed

Abstract: In the break of COVID-19 pandemic, mass testing has become essential to reduce the spread of the virus. Several recent studies suggest that a significant number of COVID-19 patients display no physical symptoms whatsoever. Therefore, it is unlikely that these patients will undergo COVID-19 test, which increases their chances of unintentionally spreading the virus. Currently, the primary diagnostic… ▽ More In the break of COVID-19 pandemic, mass testing has become essential to reduce the spread of the virus. Several recent studies suggest that a significant number of COVID-19 patients display no physical symptoms whatsoever. Therefore, it is unlikely that these patients will undergo COVID-19 test, which increases their chances of unintentionally spreading the virus. Currently, the primary diagnostic tool to detect COVID-19 is RT-PCR test on collected respiratory specimens from the suspected case. This requires patients to travel to a laboratory facility to be tested, thereby potentially infecting others along the way.It is evident from recent researches that asymptomatic COVID-19 patients cough and breath in a different way than the healthy people. Several research groups have created mobile and web-platform for crowdsourcing the symptoms, cough and breathing sounds from healthy, COVID-19 and Non-COVID patients. Some of these data repositories were made public. We have received such a repository from Cambridge University team under data-sharing agreement, where we have cough and breathing sound samples for 582 and 141 healthy and COVID-19 patients, respectively. 87 COVID-19 patients were asymptomatic, while rest of them have cough. We have developed an Android application to automatically screen COVID-19 from the comfort of people homes. Test subjects can simply download a mobile application, enter their symptoms, record an audio clip of their cough and breath, and upload the data anonymously to our servers. Our backend server converts the audio clip to spectrogram and then apply our state-of-the-art machine learning model to classify between cough sounds produced by COVID-19 patients, as opposed to healthy subjects or those with other respiratory conditions. The system can detect asymptomatic COVID-19 patients with a sensitivity more than 91%. △ Less

Submitted 20 March, 2021; originally announced March 2021.

Comments: 6 page, Table 4, Figure 2

Journal ref: Diagnostics 2022, 12(4), 920

COVID-19 Infection Localization and Severity Grading from Chest X-ray Images

Authors: Anas M. Tahir, Muhammad E. H. Chowdhury, Amith Khandakar, Tawsifur Rahman, Yazan Qiblawey, Uzair Khurshid, Serkan Kiranyaz, Nabil Ibtehaz, M Shohel Rahman, Somaya Al-Madeed, Khaled Hameed, Tahir Hamid, Sakib Mahmud, Maymouna Ezeddin

Abstract: Coronavirus disease 2019 (COVID-19) has been the main agenda of the whole world, since it came into sight in December 2019 as it has significantly affected the world economy and healthcare system. Given the effects of COVID-19 on pulmonary tissues, chest radiographic imaging has become a necessity for screening and monitoring the disease. Numerous studies have proposed Deep Learning approaches for… ▽ More Coronavirus disease 2019 (COVID-19) has been the main agenda of the whole world, since it came into sight in December 2019 as it has significantly affected the world economy and healthcare system. Given the effects of COVID-19 on pulmonary tissues, chest radiographic imaging has become a necessity for screening and monitoring the disease. Numerous studies have proposed Deep Learning approaches for the automatic diagnosis of COVID-19. Although these methods achieved astonishing performance in detection, they have used limited chest X-ray (CXR) repositories for evaluation, usually with a few hundred COVID-19 CXR images only. Thus, such data scarcity prevents reliable evaluation with the potential of overfitting. In addition, most studies showed no or limited capability in infection localization and severity grading of COVID-19 pneumonia. In this study, we address this urgent need by proposing a systematic and unified approach for lung segmentation and COVID-19 localization with infection quantification from CXR images. To accomplish this, we have constructed the largest benchmark dataset with 33,920 CXR images, including 11,956 COVID-19 samples, where the annotation of ground-truth lung segmentation masks is performed on CXRs by a novel human-machine collaborative approach. An extensive set of experiments was performed using the state-of-the-art segmentation networks, U-Net, U-Net++, and Feature Pyramid Networks (FPN). The developed network, after an extensive iterative process, reached a superior performance for lung region segmentation with Intersection over Union (IoU) of 96.11% and Dice Similarity Coefficient (DSC) of 97.99%. Furthermore, COVID-19 infections of various shapes and types were reliably localized with 83.05% IoU and 88.21% DSC. Finally, the proposed approach has achieved an outstanding COVID-19 detection performance with both sensitivity and specificity values above 99%. △ Less

Submitted 14 March, 2021; originally announced March 2021.

Comments: 30 pages, 5 figures, 4 tables

Hierarchical Self Attention Based Autoencoder for Open-Set Human Activity Recognition

Authors: M Tanjid Hasan Tonmoy, Saif Mahmud, A K M Mahbubur Rahman, M Ashraful Amin, Amin Ahsan Ali

Abstract: Wearable sensor based human activity recognition is a challenging problem due to difficulty in modeling spatial and temporal dependencies of sensor signals. Recognition models in closed-set assumption are forced to yield members of known activity classes as prediction. However, activity recognition models can encounter an unseen activity due to body-worn sensor malfunction or disability of the sub… ▽ More Wearable sensor based human activity recognition is a challenging problem due to difficulty in modeling spatial and temporal dependencies of sensor signals. Recognition models in closed-set assumption are forced to yield members of known activity classes as prediction. However, activity recognition models can encounter an unseen activity due to body-worn sensor malfunction or disability of the subject performing the activities. This problem can be addressed through modeling solution according to the assumption of open-set recognition. Hence, the proposed self attention based approach combines data hierarchically from different sensor placements across time to classify closed-set activities and it obtains notable performance improvement over state-of-the-art models on five publicly available datasets. The decoder in this autoencoder architecture incorporates self-attention based feature representations from encoder to detect unseen activity classes in open-set recognition setting. Furthermore, attention maps generated by the hierarchical model demonstrate explainable selection of features in activity recognition. We conduct extensive leave one subject out validation experiments that indicate significantly improved robustness to noise and subject specific variability in body-worn sensor signals. The source code is available at: github.com/saif-mahmud/hierarchical-attention-HAR △ Less

Submitted 7 March, 2021; originally announced March 2021.

Comments: Accepted for publication in 25th Pacific-Asia Conference on Knowledge Discovery and Data Mining (PAKDD-2021)

Detection and severity classification of COVID-19 in CT images using deep learning

Authors: Yazan Qiblawey, Anas Tahir, Muhammad E. H. Chowdhury, Amith Khandakar, Serkan Kiranyaz, Tawsifur Rahman, Nabil Ibtehaz, Sakib Mahmud, Somaya Al-Madeed, Farayi Musharavati

Abstract: Since the breakout of coronavirus disease (COVID-19), the computer-aided diagnosis has become a necessity to prevent the spread of the virus. Detecting COVID-19 at an early stage is essential to reduce the mortality risk of the patients. In this study, a cascaded system is proposed to segment the lung, detect, localize, and quantify COVID-19 infections from computed tomography (CT) images Furtherm… ▽ More Since the breakout of coronavirus disease (COVID-19), the computer-aided diagnosis has become a necessity to prevent the spread of the virus. Detecting COVID-19 at an early stage is essential to reduce the mortality risk of the patients. In this study, a cascaded system is proposed to segment the lung, detect, localize, and quantify COVID-19 infections from computed tomography (CT) images Furthermore, the system classifies the severity of COVID-19 as mild, moderate, severe, or critical based on the percentage of infected lungs. An extensive set of experiments were performed using state-of-the-art deep Encoder-Decoder Convolutional Neural Networks (ED-CNNs), UNet, and Feature Pyramid Network (FPN), with different backbone (encoder) structures using the variants of DenseNet and ResNet. The conducted experiments showed the best performance for lung region segmentation with Dice Similarity Coefficient (DSC) of 97.19% and Intersection over Union (IoU) of 95.10% using U-Net model with the DenseNet 161 encoder. Furthermore, the proposed system achieved an elegant performance for COVID-19 infection segmentation with a DSC of 94.13% and IoU of 91.85% using the FPN model with the DenseNet201 encoder. The achieved performance is significantly superior to previous methods for COVID-19 lesion localization. Besides, the proposed system can reliably localize infection of various shapes and sizes, especially small infection regions, which are rarely considered in recent studies. Moreover, the proposed system achieved high COVID-19 detection performance with 99.64% sensitivity and 98.72% specificity. Finally, the system was able to discriminate between different severity levels of COVID-19 infection over a dataset of 1,110 subjects with sensitivity values of 98.3%, 71.2%, 77.8%, and 100% for mild, moderate, severe, and critical infections, respectively. △ Less

Submitted 15 February, 2021; originally announced February 2021.

Comments: 9 Figures, 8 Tables

Classification of fNIRS Data Under Uncertainty: A Bayesian Neural Network Approach

Authors: Talha Siddique, Md Shaad Mahmud

Abstract: Functional Near-Infrared Spectroscopy (fNIRS) is a non-invasive form of Brain-Computer Interface (BCI). It is used for the imaging of brain hemodynamics and has gained popularity due to the certain pros it poses over other similar technologies. The overall functionalities encompass the capture, processing and classification of brain signals. Since hemodynamic responses are contaminated by physiolo… ▽ More Functional Near-Infrared Spectroscopy (fNIRS) is a non-invasive form of Brain-Computer Interface (BCI). It is used for the imaging of brain hemodynamics and has gained popularity due to the certain pros it poses over other similar technologies. The overall functionalities encompass the capture, processing and classification of brain signals. Since hemodynamic responses are contaminated by physiological noises, several methods have been implemented in the past literature to classify the responses in focus from the unwanted ones. However, the methods, thus far does not take into consideration the uncertainty in the data or model parameters. In this paper, we use a Bayesian Neural Network (BNN) to carry out a binary classification on an open-access dataset, consisting of unilateral finger tapping (left- and right-hand finger tapping). A BNN uses Bayesian statistics to assign a probability distribution to the network weights instead of a point estimate. In this way, it takes data and model uncertainty into consideration while carrying out the classification. We used Variational Inference (VI) to train our model. Our model produced an overall classification accuracy of 86.44% over 30 volunteers. We illustrated how the evidence lower bound (ELBO) function of the model converges over iterations. We further illustrated the uncertainty that is inherent during the sampling of the posterior distribution of the weights. We also generated a ROC curve for our BNN classifier using test data from a single volunteer and our model has an AUC score of 0.855. △ Less

Submitted 18 January, 2021; originally announced January 2021.

A Ternary Bi-Directional LSTM Classification for Brain Activation Pattern Recognition Using fNIRS

Authors: Sajila D. Wickramaratne, MD Shaad Mahmud

Abstract: Functional near-infrared spectroscopy (fNIRS) is a non-invasive, low-cost method used to study the brain's blood flow pattern. Such patterns can enable us to classify performed by a subject. In recent research, most classification systems use traditional machine learning algorithms for the classification of tasks. These methods, which are easier to implement, usually suffer from low accuracy. Furt… ▽ More Functional near-infrared spectroscopy (fNIRS) is a non-invasive, low-cost method used to study the brain's blood flow pattern. Such patterns can enable us to classify performed by a subject. In recent research, most classification systems use traditional machine learning algorithms for the classification of tasks. These methods, which are easier to implement, usually suffer from low accuracy. Further, a complex pre-processing phase is required for data preparation before implementing traditional machine learning methods. The proposed system uses a Bi-Directional LSTM based deep learning architecture for task classification, including mental arithmetic, motor imagery, and idle state using fNIRS data. Further, this system will require less pre-processing than the traditional approach, saving time and computational resources while obtaining an accuracy of 81.48\%, which is considerably higher than the accuracy obtained using conventional machine learning algorithms for the same data set. △ Less

Submitted 14 January, 2021; originally announced January 2021.

Comments: 6 pages, 7 figures

A Deep Learning Based Ternary Task Classification System Using Gramian Angular Summation Field in fNIRS Neuroimaging Data

Authors: Sajila D. Wickramaratne, Md Shaad Mahmud

Abstract: Functional near-infrared spectroscopy (fNIRS) is a non-invasive, economical method used to study its blood flow pattern. These patterns can be used to classify tasks a subject is performing. Currently, most of the classification systems use simple machine learning solutions for the classification of tasks. These conventional machine learning methods, which are easier to implement and interpret, us… ▽ More Functional near-infrared spectroscopy (fNIRS) is a non-invasive, economical method used to study its blood flow pattern. These patterns can be used to classify tasks a subject is performing. Currently, most of the classification systems use simple machine learning solutions for the classification of tasks. These conventional machine learning methods, which are easier to implement and interpret, usually suffer from low accuracy and undergo a complex preprocessing phase before network training. The proposed method converts the raw fNIRS time series data into an image using Gramian Angular Summation Field. A Deep Convolutional Neural Network (CNN) based architecture is then used for task classification, including mental arithmetic, motor imagery, and idle state. Further, this method can eliminate the feature selection stage, which affects the traditional classifiers' performance. This system obtained 87.14% average classification accuracy higher than any other method for the dataset. △ Less

Submitted 14 January, 2021; originally announced January 2021.

Comments: 4 pages, 4 Figures

A Comparative Study of AHP and Fuzzy AHP Method for Inconsistent Data

Authors: Md. Ashek-Al-Aziz, Sagar Mahmud, Md. Azizul Islam, Jubayer Al Mahmud, Khan Md. Hasib

Abstract: In various cases of decision analysis we use two popular methods: Analytical Hierarchical Process (AHP) and Fuzzy based AHP or Fuzzy AHP. Both the methods deal with stochastic data and can determine decision result through Multi Criteria Decision Making (MCDM) process. Obviously resulting values of the two methods are not same though same set of data is fed into them. In this research work, we hav… ▽ More In various cases of decision analysis we use two popular methods: Analytical Hierarchical Process (AHP) and Fuzzy based AHP or Fuzzy AHP. Both the methods deal with stochastic data and can determine decision result through Multi Criteria Decision Making (MCDM) process. Obviously resulting values of the two methods are not same though same set of data is fed into them. In this research work, we have tried to observe similarities and dissimilarities between two methods outputs. Almost same trend or fluctuations in outputs have been seen for both methods for same set of input data which are not consistent. Both method outputs ups and down fluctuations are same for fifty percent cases. △ Less

Submitted 23 December, 2020; originally announced January 2021.

Comments: 22 Pages, 9 Figures

Journal ref: International Journal of Sciences: Basic and Applied Research (IJSBAR), Volume 54 Issue 4, Year 2020, Page - 16 -37

A Statistical Real-Time Prediction Model for Recommender System

Authors: Md Rifat Arefin, Minhas Kamal, Kishan Kumar Ganguly, Tarek Salah Uddin Mahmud

Abstract: Recommender system has become an inseparable part of online shopping and its usability is increasing with the advancement of these e-commerce sites. An effective and efficient recommender system benefits both the seller and the buyer significantly. We considered user activities and product information for the filtering process in our proposed recommender system. Our model has achieved inspiring re… ▽ More Recommender system has become an inseparable part of online shopping and its usability is increasing with the advancement of these e-commerce sites. An effective and efficient recommender system benefits both the seller and the buyer significantly. We considered user activities and product information for the filtering process in our proposed recommender system. Our model has achieved inspiring result (approximately 58% true-positive and 13% false-positive) for the data set provided by RecSys Challenge 2015. This paper aims to describe a statistical model that will help to predict the buying behavior of a user in real-time during a session. △ Less

Submitted 1 December, 2020; originally announced December 2020.

Virtual Experience to Real World Application: Sidewalk Obstacle Avoidance Using Reinforcement Learning for Visually Impaired

Authors: Faruk Ahmed, Md Sultan Mahmud, Kazi Ashraf Moinuddin, Mohammed Istiaque Hyder, Mohammed Yeasin

Abstract: Finding a path free from obstacles that poses minimal risk is critical for safe navigation. People who are sighted and people who are visually impaired require navigation safety while walking on a sidewalk. In this research we developed an assistive navigation on a sidewalk by integrating sensory inputs using reinforcement learning. We trained a Sidewalk Obstacle Avoidance Agent (SOAA) through rei… ▽ More Finding a path free from obstacles that poses minimal risk is critical for safe navigation. People who are sighted and people who are visually impaired require navigation safety while walking on a sidewalk. In this research we developed an assistive navigation on a sidewalk by integrating sensory inputs using reinforcement learning. We trained a Sidewalk Obstacle Avoidance Agent (SOAA) through reinforcement learning in a simulated robotic environment. A Sidewalk Obstacle Conversational Agent (SOCA) is built by training a natural language conversation agent with real conversation data. The SOAA along with SOCA was integrated in a prototype device called augmented guide (AG). Empirical analysis showed that this prototype improved the obstacle avoidance experience about 5% from a base case of 81.29% △ Less

Submitted 27 September, 2020; originally announced September 2020.

Comments: Journal, to be submitted