-
Physics-Enhanced TinyML for Real-Time Detection of Ground Magnetic Anomalies
Authors:
Talha Siddique,
MD Shaad Mahmud
Abstract:
Space weather phenomena like geomagnetic disturbances (GMDs) and geomagnetically induced currents (GICs) pose significant risks to critical technological infrastructure. While traditional predictive models, grounded in simulation, hold theoretical robustness, they grapple with challenges, notably the assimilation of imprecise data and extensive computational complexities. In recent years, Tiny Mac…
▽ More
Space weather phenomena like geomagnetic disturbances (GMDs) and geomagnetically induced currents (GICs) pose significant risks to critical technological infrastructure. While traditional predictive models, grounded in simulation, hold theoretical robustness, they grapple with challenges, notably the assimilation of imprecise data and extensive computational complexities. In recent years, Tiny Machine Learning (TinyML) has been adopted to develop Machine Learning (ML)-enabled magnetometer systems for predicting real-time terrestrial magnetic perturbations as a proxy measure for GIC. While TinyML offers efficient, real-time data processing, its intrinsic limitations prevent the utilization of robust methods with high computational needs. This paper developed a physics-guided TinyML framework to address the above challenges. This framework integrates physics-based regularization at the stages of model training and compression, thereby augmenting the reliability of predictions. The developed pruning scheme within the framework harnesses the inherent physical characteristics of the domain, striking a balance between model size and robustness. The study presents empirical results, drawing a comprehensive comparison between the accuracy and reliability of the developed framework and its traditional counterpart. Such a comparative analysis underscores the prospective applicability of the developed framework in conceptualizing robust, ML-enabled magnetometer systems for real-time space weather forecasting.
△ Less
Submitted 19 November, 2023;
originally announced November 2023.
-
IoMT-Blockchain based Secured Remote Patient Monitoring Framework for Neuro-Stimulation Device
Authors:
Md Sakib Ullah Sourav,
Mohammad Sultan Mahmud,
Md Simul Hasan Talukder,
Rejwan Bin Sulaiman,
Abdullah Yasin
Abstract:
Biomedical Engineering's Internet of Medical Things (IoMT) is helping to improve the accuracy, dependability, and productivity of electronic equipment in the healthcare business. Real-time sensory data from patients may be delivered and subsequently analyzed through rapid development of wearable IoMT devices, such as neuro-stimulation devices with a range of functions. Data from the Internet of Th…
▽ More
Biomedical Engineering's Internet of Medical Things (IoMT) is helping to improve the accuracy, dependability, and productivity of electronic equipment in the healthcare business. Real-time sensory data from patients may be delivered and subsequently analyzed through rapid development of wearable IoMT devices, such as neuro-stimulation devices with a range of functions. Data from the Internet of Things is gathered, analyzed, and stored in a single location. However, single-point failure, data manipulation, privacy difficulties, and other challenges might arise as a result of centralization. Due to its decentralized nature, blockchain (BC) can alleviate these issues. The viability of establishing a non-invasive remote neurostimulation system employing IoMT-based transcranial Direct Current Stimulation is investigated in this work (tDCS). A hardware-based prototype tDCS device has been developed that can be operated over the internet using an android application. Our suggested framework addresses the problems of IoMTBC-based systems, meets the criteria of real-time remote patient monitoring systems, and incorporates literature best practices in the relevant fields.
△ Less
Submitted 31 August, 2023;
originally announced August 2023.
-
Transformer-based Text Classification on Unified Bangla Multi-class Emotion Corpus
Authors:
Md Sakib Ullah Sourav,
Huidong Wang,
Mohammad Sultan Mahmud,
Hua Zheng
Abstract:
In this research, we propose a complete set of approaches for identifying and extracting emotions from Bangla texts. We provide a Bangla emotion classifier for six classes: anger, disgust, fear, joy, sadness, and surprise, from Bangla words using transformer-based models, which exhibit phenomenal results in recent days, especially for high-resource languages. The Unified Bangla Multi-class Emotion…
▽ More
In this research, we propose a complete set of approaches for identifying and extracting emotions from Bangla texts. We provide a Bangla emotion classifier for six classes: anger, disgust, fear, joy, sadness, and surprise, from Bangla words using transformer-based models, which exhibit phenomenal results in recent days, especially for high-resource languages. The Unified Bangla Multi-class Emotion Corpus (UBMEC) is used to assess the performance of our models. UBMEC is created by combining two previously released manually labeled datasets of Bangla comments on six emotion classes with fresh manually labeled Bangla comments created by us. The corpus dataset and code we used in this work are publicly available.
△ Less
Submitted 13 June, 2023; v1 submitted 12 October, 2022;
originally announced October 2022.
-
Real-Time Machine Learning Enabled Low-Cost Magnetometer System
Authors:
Talha Siddique,
Md. Shaad Mahmud
Abstract:
Geomagnetically Induced Currents (GICs) are one of the most hazardous effects of space weather. The rate of change in ground horizontal magnetic component dBH/dt is used as a proxy measure for GIC. In order to monitor and predict dBH/dt, ground-based fluxgate magnetometers are used. However, baseline correction is crucial before such magnetometer data can be utilized. In this paper, a low-cost Mac…
▽ More
Geomagnetically Induced Currents (GICs) are one of the most hazardous effects of space weather. The rate of change in ground horizontal magnetic component dBH/dt is used as a proxy measure for GIC. In order to monitor and predict dBH/dt, ground-based fluxgate magnetometers are used. However, baseline correction is crucial before such magnetometer data can be utilized. In this paper, a low-cost Machine Learning (ML) enabled magnetometer system has been implemented to perform realtime baseline correction of magnetometer data. The predicted geomagnetic components are then used to derive a forecast for dBH/dt. Two different ML models were deployed, and their real-time and offline prediction accuracy were examined. The localized peaks of the predicted dBH/dt are further validated using binary event analysis.
△ Less
Submitted 16 September, 2022;
originally announced September 2022.
-
Vaccine efficacy and SARS CoV 2 control in California and USA during the session 2020 2026: A modeling study
Authors:
Md. Shahriar Mahmud,
Md. Kamrujjaman,
Md. Mashih Ibn Yasin Adan,
Md. Alamgir Hossain,
Md. Mizanur Rahman,
Md. Shahidul Islam,
Muhammad Mohebujjaman,
Md. Mamun Molla
Abstract:
Besides maintaining health precautions, vaccination has been the only prevention from SARS-CoV-2, though no clinically proved 100% effective vaccine has been developed till date. At this stage, to withhold the debris of this pandemic, experts need to know the impact of the vaccine efficacy rate's threshold and how long this pandemic may extent with vaccines that have different efficacy rates. In t…
▽ More
Besides maintaining health precautions, vaccination has been the only prevention from SARS-CoV-2, though no clinically proved 100% effective vaccine has been developed till date. At this stage, to withhold the debris of this pandemic, experts need to know the impact of the vaccine efficacy rate's threshold and how long this pandemic may extent with vaccines that have different efficacy rates. In this article, a mathematical model study has been done on the importance of vaccination and vaccine efficiency rate during an ongoing pandemic. We simulated a five compartment mathematical model to analyze the pandemic scenario in both California, and whole U.S. We considered four vaccines, Pfizer, Moderna, AstraZeneca, and Johnson and Johnson, which are being used rigorously to control the COVID-19 pandemic, in addition with two special cases: a vaccine with 100% efficacy rate and no vaccine under use. Both the infection and death rates are very high in California. Our model suggests that the pandemic situation in California will be under control in the last quartile of the year 2023 if frequent vaccination is continued with the Pfizer vaccine. During this time, six waves will happen from the beginning of the immunization where the case fatality and recovery rates will be 1.697% and 98.30%, respectively. However, according to the considered model, this period might be extended to the mid of 2024 when vaccines with lower efficacy rates are used. The more effective a vaccine, the less people suffer from this malign infection. Although specific groups of people get prioritized initially, mass vaccination is needed to control the spread of the disease.
△ Less
Submitted 15 September, 2021;
originally announced September 2021.
-
Classification of fNIRS Data Under Uncertainty: A Bayesian Neural Network Approach
Authors:
Talha Siddique,
Md Shaad Mahmud
Abstract:
Functional Near-Infrared Spectroscopy (fNIRS) is a non-invasive form of Brain-Computer Interface (BCI). It is used for the imaging of brain hemodynamics and has gained popularity due to the certain pros it poses over other similar technologies. The overall functionalities encompass the capture, processing and classification of brain signals. Since hemodynamic responses are contaminated by physiolo…
▽ More
Functional Near-Infrared Spectroscopy (fNIRS) is a non-invasive form of Brain-Computer Interface (BCI). It is used for the imaging of brain hemodynamics and has gained popularity due to the certain pros it poses over other similar technologies. The overall functionalities encompass the capture, processing and classification of brain signals. Since hemodynamic responses are contaminated by physiological noises, several methods have been implemented in the past literature to classify the responses in focus from the unwanted ones. However, the methods, thus far does not take into consideration the uncertainty in the data or model parameters. In this paper, we use a Bayesian Neural Network (BNN) to carry out a binary classification on an open-access dataset, consisting of unilateral finger tapping (left- and right-hand finger tapping). A BNN uses Bayesian statistics to assign a probability distribution to the network weights instead of a point estimate. In this way, it takes data and model uncertainty into consideration while carrying out the classification. We used Variational Inference (VI) to train our model. Our model produced an overall classification accuracy of 86.44% over 30 volunteers. We illustrated how the evidence lower bound (ELBO) function of the model converges over iterations. We further illustrated the uncertainty that is inherent during the sampling of the posterior distribution of the weights. We also generated a ROC curve for our BNN classifier using test data from a single volunteer and our model has an AUC score of 0.855.
△ Less
Submitted 18 January, 2021;
originally announced January 2021.
-
A Ternary Bi-Directional LSTM Classification for Brain Activation Pattern Recognition Using fNIRS
Authors:
Sajila D. Wickramaratne,
MD Shaad Mahmud
Abstract:
Functional near-infrared spectroscopy (fNIRS) is a non-invasive, low-cost method used to study the brain's blood flow pattern. Such patterns can enable us to classify performed by a subject. In recent research, most classification systems use traditional machine learning algorithms for the classification of tasks. These methods, which are easier to implement, usually suffer from low accuracy. Furt…
▽ More
Functional near-infrared spectroscopy (fNIRS) is a non-invasive, low-cost method used to study the brain's blood flow pattern. Such patterns can enable us to classify performed by a subject. In recent research, most classification systems use traditional machine learning algorithms for the classification of tasks. These methods, which are easier to implement, usually suffer from low accuracy. Further, a complex pre-processing phase is required for data preparation before implementing traditional machine learning methods. The proposed system uses a Bi-Directional LSTM based deep learning architecture for task classification, including mental arithmetic, motor imagery, and idle state using fNIRS data. Further, this system will require less pre-processing than the traditional approach, saving time and computational resources while obtaining an accuracy of 81.48\%, which is considerably higher than the accuracy obtained using conventional machine learning algorithms for the same data set.
△ Less
Submitted 14 January, 2021;
originally announced January 2021.
-
A Deep Learning Based Ternary Task Classification System Using Gramian Angular Summation Field in fNIRS Neuroimaging Data
Authors:
Sajila D. Wickramaratne,
Md Shaad Mahmud
Abstract:
Functional near-infrared spectroscopy (fNIRS) is a non-invasive, economical method used to study its blood flow pattern. These patterns can be used to classify tasks a subject is performing. Currently, most of the classification systems use simple machine learning solutions for the classification of tasks. These conventional machine learning methods, which are easier to implement and interpret, us…
▽ More
Functional near-infrared spectroscopy (fNIRS) is a non-invasive, economical method used to study its blood flow pattern. These patterns can be used to classify tasks a subject is performing. Currently, most of the classification systems use simple machine learning solutions for the classification of tasks. These conventional machine learning methods, which are easier to implement and interpret, usually suffer from low accuracy and undergo a complex preprocessing phase before network training. The proposed method converts the raw fNIRS time series data into an image using Gramian Angular Summation Field. A Deep Convolutional Neural Network (CNN) based architecture is then used for task classification, including mental arithmetic, motor imagery, and idle state. Further, this method can eliminate the feature selection stage, which affects the traditional classifiers' performance. This system obtained 87.14% average classification accuracy higher than any other method for the dataset.
△ Less
Submitted 14 January, 2021;
originally announced January 2021.
-
Virtual Experience to Real World Application: Sidewalk Obstacle Avoidance Using Reinforcement Learning for Visually Impaired
Authors:
Faruk Ahmed,
Md Sultan Mahmud,
Kazi Ashraf Moinuddin,
Mohammed Istiaque Hyder,
Mohammed Yeasin
Abstract:
Finding a path free from obstacles that poses minimal risk is critical for safe navigation. People who are sighted and people who are visually impaired require navigation safety while walking on a sidewalk. In this research we developed an assistive navigation on a sidewalk by integrating sensory inputs using reinforcement learning. We trained a Sidewalk Obstacle Avoidance Agent (SOAA) through rei…
▽ More
Finding a path free from obstacles that poses minimal risk is critical for safe navigation. People who are sighted and people who are visually impaired require navigation safety while walking on a sidewalk. In this research we developed an assistive navigation on a sidewalk by integrating sensory inputs using reinforcement learning. We trained a Sidewalk Obstacle Avoidance Agent (SOAA) through reinforcement learning in a simulated robotic environment. A Sidewalk Obstacle Conversational Agent (SOCA) is built by training a natural language conversation agent with real conversation data. The SOAA along with SOCA was integrated in a prototype device called augmented guide (AG). Empirical analysis showed that this prototype improved the obstacle avoidance experience about 5% from a base case of 81.29%
△ Less
Submitted 27 September, 2020;
originally announced September 2020.
-
Toward Building Safer Smart Homes for the People with Disabilities
Authors:
Shahinur Alam,
Md Sultan Mahmud,
Mohammed Yeasin
Abstract:
Situational awareness is a critical foundation for the protection of human life/properties and is challenging to maintain for people with disabilities (i.e., visual impairments and limited mobility). In this paper, we present a dialog enabled end-to-end assistive solution called "SafeAccess" to build a safer smart home by providing situational awareness. The key functions of SafeAccess are: - 1) m…
▽ More
Situational awareness is a critical foundation for the protection of human life/properties and is challenging to maintain for people with disabilities (i.e., visual impairments and limited mobility). In this paper, we present a dialog enabled end-to-end assistive solution called "SafeAccess" to build a safer smart home by providing situational awareness. The key functions of SafeAccess are: - 1) monitoring homes and identifying incoming persons; 2) helping users in assessing incoming threats (e.g., burglary, robbery, gun violence); and, 3) allowing users to grant safe access to homes for friends/families. In this work, we focus on building a robust model for detecting and recognizing person, generating image descriptions, and designing a prototype for the smart door. To interact with the system, we implemented a dialog enabled smartphone app, especially for creating a personalized profile from face images or videos of friends/families. A Raspberry pi connected to the home monitoring cameras captures the video frames and performs change detection to identify frames with activities. Then, we detect human presence using Faster r-cnn and extract faces using Multi-task Cascaded Convolutional Networks (MTCNN). Subsequently, we match the detected faces using FaceNet/support vector machine (SVM) classifiers. The system notifies users with an MMS containing the name of incoming persons or as "unknown", scene image, facial description, and contextual information. The users can grant access or call emergency services using the SafeAccess app based on the received notification. Our system identifies persons with an F-score 0.97 and recognizes items to generate image description with an average F-score 0.97.
△ Less
Submitted 10 June, 2020;
originally announced June 2020.
-
SafeNet: An Assistive Solution to Assess Incoming Threats for Premises
Authors:
Shahinur Alam,
Md Sultan Mahmud,
Mohammed Yeasin
Abstract:
An assistive solution to assess incoming threats (e.g., robbery, burglary, gun violence) for homes will enhance the safety of the people with or without disabilities. This paper presents "SafeNet"- an integrated assistive system to generate context-oriented image descriptions to assess incoming threats. The key functionality of the system includes the detection and identification of human and gene…
▽ More
An assistive solution to assess incoming threats (e.g., robbery, burglary, gun violence) for homes will enhance the safety of the people with or without disabilities. This paper presents "SafeNet"- an integrated assistive system to generate context-oriented image descriptions to assess incoming threats. The key functionality of the system includes the detection and identification of human and generating image descriptions from the real-time video streams obtained from the cameras placed in strategic locations around the house. In this paper, we focus on developing a robust model called "SafeNet" to generate image descriptions. To interact with the system, we implemented a dialog enabled interface for creating a personalized profile from face images or videos of friends/families. To improve computational efficiency, we apply change detection to filter out frames that do not have any activity and use Faster-RCNN to detect the human presence and extract faces using Multitask Cascaded Convolutional Networks (MTCNN). Subsequently, we apply LBP/FaceNet to identify a person. SafeNet sends image descriptions to the users with an MMS containing a person's name if any match found or as "Unknown", scene image, facial description, and contextual information. SafeNet identifies friends/families/caregiver versus intruders/unknown with an average F-score 0.97 and generates image descriptions from 10 classes with an average F-measure 0.97.
△ Less
Submitted 26 January, 2020;
originally announced February 2020.
