-
Evaluation of cinematic volume rendering open-source and commercial solutions for the exploration of congenital heart data
Authors:
Irum Baseer,
Israel Valverde,
Abdel H. Moustafa,
Josep Blat,
Oscar Camara
Abstract:
Detailed anatomical information is essential to optimize medical decisions for surgical and pre-operative planning in patients with congenital heart disease. The visualization techniques commonly used in clinical routine for the exploration of complex cardiac data are based on multi-planar reformations, maximum intensity projection, and volume rendering, which rely on basic lighting models prone t…
▽ More
Detailed anatomical information is essential to optimize medical decisions for surgical and pre-operative planning in patients with congenital heart disease. The visualization techniques commonly used in clinical routine for the exploration of complex cardiac data are based on multi-planar reformations, maximum intensity projection, and volume rendering, which rely on basic lighting models prone to image distortion. On the other hand, cinematic rendering (CR), a three-dimensional visualization technique based on physically-based rendering methods, can create volumetric images with high fidelity. However, there are a lot of parameters involved in CR that affect the visualization results, thus being dependent on the user's experience and requiring detailed evaluation protocols to compare available solutions. In this study, we have analyzed the impact of the most relevant parameters in a CR pipeline developed in the open-source version of the MeVisLab framework for the visualization of the heart anatomy of three congenital patients and two adults from CT images. The resulting visualizations were compared to a commercial tool used in the clinics with a questionnaire filled in by clinical users, providing similar definitions of structures, depth perception, texture appearance, realism, and diagnostic ability.
△ Less
Submitted 12 August, 2023;
originally announced August 2023.
-
Deformable registration with intensity correction for CESM monitoring response to Neoadjuvant Chemotherapy
Authors:
Clément Jailin,
Pablo Milioni De Carvalho,
Sara Mohamed,
Laurence Vancamberg,
Amr Farouk Ibrahim Moustafa,
Mohammed Gomaa,
Rasha Mohammed Kamal,
Serge Muller
Abstract:
This paper proposes a robust longitudinal registration method for Contrast Enhanced Spectral Mammography in monitoring neoadjuvant chemotherapy. Because breast texture intensity changes with the treatment, a non-rigid registration procedure with local intensity compensations is developed. The approach allows registering the low energy images of the exams acquired before and after the chemotherapy.…
▽ More
This paper proposes a robust longitudinal registration method for Contrast Enhanced Spectral Mammography in monitoring neoadjuvant chemotherapy. Because breast texture intensity changes with the treatment, a non-rigid registration procedure with local intensity compensations is developed. The approach allows registering the low energy images of the exams acquired before and after the chemotherapy. The measured motion is then applied to the corresponding recombined images. The difference of registered images, called residual, makes vanishing the breast texture that did not changed between the two exams. Consequently, this registered residual allows identifying local density and iodine changes, especially in the lesion area. The method is validated with a synthetic NAC case where ground truths are available. Then the procedure is applied to 51 patients with 208 CESM image pairs acquired before and after the chemotherapy treatment. The proposed registration converged in all 208 cases. The intensity-compensated registration approach is evaluated with different mathematical metrics and through the repositioning of clinical landmarks (RMSE: 5.9 mm) and outperforms state-of-the-art registration techniques.
△ Less
Submitted 22 February, 2023;
originally announced February 2023.
-
Best-Answer Prediction in Q&A Sites Using User Information
Authors:
Rafik Hadfi,
Ahmed Moustafa,
Kai Yoshino,
Takayuki Ito
Abstract:
Community Question Answering (CQA) sites have spread and multiplied significantly in recent years. Sites like Reddit, Quora, and Stack Exchange are becoming popular amongst people interested in finding answers to diverse questions. One practical way of finding such answers is automatically predicting the best candidate given existing answers and comments. Many studies were conducted on answer pred…
▽ More
Community Question Answering (CQA) sites have spread and multiplied significantly in recent years. Sites like Reddit, Quora, and Stack Exchange are becoming popular amongst people interested in finding answers to diverse questions. One practical way of finding such answers is automatically predicting the best candidate given existing answers and comments. Many studies were conducted on answer prediction in CQA but with limited focus on using the background information of the questionnaires. We address this limitation using a novel method for predicting the best answers using the questioner's background information and other features, such as the textual content or the relationships with other participants. Our answer classification model was trained using the Stack Exchange dataset and validated using the Area Under the Curve (AUC) metric. The experimental results show that the proposed method complements previous methods by pointing out the importance of the relationships between users, particularly throughout the level of involvement in different communities on Stack Exchange. Furthermore, we point out that there is little overlap between user-relation information and the information represented by the shallow text features and the meta-features, such as time differences.
△ Less
Submitted 14 December, 2022;
originally announced December 2022.
-
CONDA: Continual Unsupervised Domain Adaptation Learning in Visual Perception for Self-Driving Cars
Authors:
Thanh-Dat Truong,
Pierce Helton,
Ahmed Moustafa,
Jackson David Cothren,
Khoa Luu
Abstract:
Although unsupervised domain adaptation methods have achieved remarkable performance in semantic scene segmentation in visual perception for self-driving cars, these approaches remain impractical in real-world use cases. In practice, the segmentation models may encounter new data that have not been seen yet. Also, the previous data training of segmentation models may be inaccessible due to privacy…
▽ More
Although unsupervised domain adaptation methods have achieved remarkable performance in semantic scene segmentation in visual perception for self-driving cars, these approaches remain impractical in real-world use cases. In practice, the segmentation models may encounter new data that have not been seen yet. Also, the previous data training of segmentation models may be inaccessible due to privacy problems. Therefore, to address these problems, in this work, we propose a Continual Unsupervised Domain Adaptation (CONDA) approach that allows the model to continuously learn and adapt with respect to the presence of the new data. Moreover, our proposed approach is designed without the requirement of accessing previous training data. To avoid the catastrophic forgetting problem and maintain the performance of the segmentation models, we present a novel Bijective Maximum Likelihood loss to impose the constraint of predicted segmentation distribution shifts. The experimental results on the benchmark of continual unsupervised domain adaptation have shown the advanced performance of the proposed CONDA method.
△ Less
Submitted 15 April, 2024; v1 submitted 1 December, 2022;
originally announced December 2022.
-
SPARCS: Structuring Physically Assistive Robotics for Caregiving with Stakeholders-in-the-loop
Authors:
Rishabh Madan,
Rajat Kumar Jenamani,
Vy Thuy Nguyen,
Ahmed Moustafa,
Xuefeng Hu,
Katherine Dimitropoulou,
Tapomayukh Bhattacharjee
Abstract:
Existing work in physical robot caregiving is limited in its ability to provide long-term assistance. This is majorly due to (i) lack of well-defined problems, (ii) diversity of tasks, and (iii) limited access to stakeholders from the caregiving community. We propose Structuring Physically Assistive Robotics for Caregiving with Stakeholders-in-the-loop (SPARCS) to address these challenges. SPARCS…
▽ More
Existing work in physical robot caregiving is limited in its ability to provide long-term assistance. This is majorly due to (i) lack of well-defined problems, (ii) diversity of tasks, and (iii) limited access to stakeholders from the caregiving community. We propose Structuring Physically Assistive Robotics for Caregiving with Stakeholders-in-the-loop (SPARCS) to address these challenges. SPARCS is a framework for physical robot caregiving comprising (i) Building Blocks, models that define physical robot caregiving scenarios, (ii) Structured Workflows, hierarchical workflows that enable us to answer the Whats and Hows of physical robot caregiving, and (iii) SPARCS-Box, a web-based platform to facilitate dialogue between all stakeholders. We collect clinical data for six care recipients with varying disabilities and demonstrate the use of SPARCS in designing well-defined caregiving scenarios and identifying their care requirements. All the data and workflows are available on SPARCS-Box. We demonstrate the utility of SPARCS in building a robot-assisted feeding system for one of the care recipients. We also perform experiments to show the adaptability of this system to different caregiving scenarios. Finally, we identify open challenges in physical robot caregiving by consulting care recipients and caregivers. Supplementary material can be found at https://emprise.cs.cornell.edu/sparcs/.
△ Less
Submitted 20 October, 2022;
originally announced October 2022.
-
Cross-correlation effects in the solution NMR spectra of near-equivalent spin-1/2 pairs
Authors:
James W. Whipham,
Gamal A. I. Moustafa,
Mohamed Sabba,
Weidong Gong,
Christian Bengs,
Malcolm H. Levitt
Abstract:
The NMR spectra of spin-1/2 pairs contains four peaks, with two inner peaks much stronger than the outer peaks in the near-equivalence regime. We have observed that the strong inner peaks have significantly different linewidths, when measurements were performed on a 13C2-labelled triyne derivative. This linewidth difference may be attributed to strong cross-correlation effects. We develop the theo…
▽ More
The NMR spectra of spin-1/2 pairs contains four peaks, with two inner peaks much stronger than the outer peaks in the near-equivalence regime. We have observed that the strong inner peaks have significantly different linewidths, when measurements were performed on a 13C2-labelled triyne derivative. This linewidth difference may be attributed to strong cross-correlation effects. We develop the theory of cross-correlated relaxation in the case of near-equivalent homonuclear spin-1/2 pairs, in the case of a molecule exhibiting strongly anisotropic rotational diffusion. Good agreement is found with the experimental NMR lineshapes.
△ Less
Submitted 19 August, 2022;
originally announced August 2022.
-
Towards an Efficient Voice Identification Using Wav2Vec2.0 and HuBERT Based on the Quran Reciters Dataset
Authors:
Aly Moustafa,
Salah A. Aly
Abstract:
Current authentication and trusted systems depend on classical and biometric methods to recognize or authorize users. Such methods include audio speech recognitions, eye, and finger signatures. Recent tools utilize deep learning and transformers to achieve better results. In this paper, we develop a deep learning constructed model for Arabic speakers identification by using Wav2Vec2.0 and HuBERT a…
▽ More
Current authentication and trusted systems depend on classical and biometric methods to recognize or authorize users. Such methods include audio speech recognitions, eye, and finger signatures. Recent tools utilize deep learning and transformers to achieve better results. In this paper, we develop a deep learning constructed model for Arabic speakers identification by using Wav2Vec2.0 and HuBERT audio representation learning tools. The end-to-end Wav2Vec2.0 paradigm acquires contextualized speech representations learnings by randomly masking a set of feature vectors, and then applies a transformer neural network. We employ an MLP classifier that is able to differentiate between invariant labeled classes. We show several experimental results that safeguard the high accuracy of the proposed model. The experiments ensure that an arbitrary wave signal for a certain speaker can be identified with 98% and 97.1% accuracies in the cases of Wav2Vec2.0 and HuBERT, respectively.
△ Less
Submitted 11 November, 2021;
originally announced November 2021.
-
Fairness based Multi-Preference Resource Allocation in Decentralised Open Markets
Authors:
Pankaj Mishra,
Ahmed Moustafa,
Takayuki Ito
Abstract:
In this work, we focus on resource allocation in a decentralised open market. In decentralised open markets consists of multiple vendors and multiple dynamically-arriving buyers, thus makes the market complex and dynamic. Because, in these markets, negotiations among vendors and buyers take place over multiple conflicting issues such as price, scalability, robustness, delay, etc. As a result, opti…
▽ More
In this work, we focus on resource allocation in a decentralised open market. In decentralised open markets consists of multiple vendors and multiple dynamically-arriving buyers, thus makes the market complex and dynamic. Because, in these markets, negotiations among vendors and buyers take place over multiple conflicting issues such as price, scalability, robustness, delay, etc. As a result, optimising the resource allocation in such open markets becomes directly dependent on two key decisions, which are; incorporating a different kind of buyers' preferences, and fairness based vendor elicitation strategy. Towards this end, in this work, we propose a three-step resource allocation approach that employs a reverse-auction paradigm. At the first step, priority label is attached to each bidding vendor based on the proposed priority mechanism. Then, at the second step, the preference score is calculated for all the different kinds of preferences of the buyers. Finally, at the third step, based on the priority label of the vendor and the preference score winner is determined. Finally, we compare the proposed approach with two state-of-the-art resource pricing and allocation strategies. The experimental results show that the proposed approach outperforms the other two resource allocation approaches in terms of the independent utilities of buyers and the overall utility of the open market.
△ Less
Submitted 1 September, 2021;
originally announced September 2021.
-
Federated Learning Versus Classical Machine Learning: A Convergence Comparison
Authors:
Muhammad Asad,
Ahmed Moustafa,
Takayuki Ito
Abstract:
In the past few decades, machine learning has revolutionized data processing for large scale applications. Simultaneously, increasing privacy threats in trending applications led to the redesign of classical data training models. In particular, classical machine learning involves centralized data training, where the data is gathered, and the entire training process executes at the central server.…
▽ More
In the past few decades, machine learning has revolutionized data processing for large scale applications. Simultaneously, increasing privacy threats in trending applications led to the redesign of classical data training models. In particular, classical machine learning involves centralized data training, where the data is gathered, and the entire training process executes at the central server. Despite significant convergence, this training involves several privacy threats on participants' data when shared with the central cloud server. To this end, federated learning has achieved significant importance over distributed data training. In particular, the federated learning allows participants to collaboratively train the local models on local data without revealing their sensitive information to the central cloud server. In this paper, we perform a convergence comparison between classical machine learning and federated learning on two publicly available datasets, namely, logistic-regression-MNIST dataset and image-classification-CIFAR-10 dataset. The simulation results demonstrate that federated learning achieves higher convergence within limited communication rounds while maintaining participants' anonymity. We hope that this research will show the benefits and help federated learning to be implemented widely.
△ Less
Submitted 22 July, 2021;
originally announced July 2021.
-
Privacy Information Classification: A Hybrid Approach
Authors:
Jiaqi Wu,
Weihua Li,
Quan Bai,
Takayuki Ito,
Ahmed Moustafa
Abstract:
A large amount of information has been published to online social networks every day. Individual privacy-related information is also possibly disclosed unconsciously by the end-users. Identifying privacy-related data and protecting the online social network users from privacy leakage turn out to be significant. Under such a motivation, this study aims to propose and develop a hybrid privacy classi…
▽ More
A large amount of information has been published to online social networks every day. Individual privacy-related information is also possibly disclosed unconsciously by the end-users. Identifying privacy-related data and protecting the online social network users from privacy leakage turn out to be significant. Under such a motivation, this study aims to propose and develop a hybrid privacy classification approach to detect and classify privacy information from OSNs. The proposed hybrid approach employs both deep learning models and ontology-based models for privacy-related information extraction. Extensive experiments are conducted to validate the proposed hybrid approach, and the empirical results demonstrate its superiority in assisting online social network users against privacy leakage.
△ Less
Submitted 27 January, 2021;
originally announced January 2021.
-
Architectured Chain Lattices with Tailorable Energy Absorption in Tension
Authors:
Spencer V Taylor,
Abdel R Moustafa,
Zachary C Cordero
Abstract:
This paper introduces the chain lattice, a hierarchical truss structure comprising two interpenetrating lattices. One lattice toughens the material and prevents catastrophic localized failure while the other lattice serves as a porous matrix that densifies to absorb energy during tensile loading. Chain lattices are amenable to additive manufacturing and can transform 3D-printable materials that ar…
▽ More
This paper introduces the chain lattice, a hierarchical truss structure comprising two interpenetrating lattices. One lattice toughens the material and prevents catastrophic localized failure while the other lattice serves as a porous matrix that densifies to absorb energy during tensile loading. Chain lattices are amenable to additive manufacturing and can transform 3D-printable materials that are normally brittle and flaw-sensitive into damage-tolerant materials. Calculations predict ceramic chain lattices can have a specific energy absorption several orders of magnitude greater than that of their fully dense counterparts.
△ Less
Submitted 17 August, 2020;
originally announced August 2020.
-
Predicting Nonlinear Seismic Response of Structural Braces Using Machine Learning
Authors:
Elif Ecem Bas,
Denis Aslangil,
Mohamed A. Moustafa
Abstract:
Numerical modeling of different structural materials that have highly nonlinear behaviors has always been a challenging problem in engineering disciplines. Experimental data is commonly used to characterize this behavior. This study aims to improve the modeling capabilities by using state of the art Machine Learning techniques, and attempts to answer several scientific questions: (i) Which ML algo…
▽ More
Numerical modeling of different structural materials that have highly nonlinear behaviors has always been a challenging problem in engineering disciplines. Experimental data is commonly used to characterize this behavior. This study aims to improve the modeling capabilities by using state of the art Machine Learning techniques, and attempts to answer several scientific questions: (i) Which ML algorithm is capable and is more efficient to learn such a complex and nonlinear problem? (ii) Is it possible to artificially reproduce structural brace seismic behavior that can represent real physics? (iii) How can our findings be extended to the different engineering problems that are driven by similar nonlinear dynamics? To answer these questions, the presented methods are validated by using experimental brace data. The paper shows that after proper data preparation, the long-short term memory (LSTM) method is highly capable of capturing the nonlinear behavior of braces. Additionally, the effects of tuning the hyperparameters on the models, such as layer numbers, neuron numbers, and the activation functions, are presented. Finally, the ability to learn nonlinear dynamics by using deep neural network algorithms and their advantages are briefly discussed.
△ Less
Submitted 27 July, 2020;
originally announced July 2020.
-
Evaluating the Communication Efficiency in Federated Learning Algorithms
Authors:
Muhammad Asad,
Ahmed Moustafa,
Takayuki Ito,
Muhammad Aslam
Abstract:
In the era of advanced technologies, mobile devices are equipped with computing and sensing capabilities that gather excessive amounts of data. These amounts of data are suitable for training different learning models. Cooperated with advancements in Deep Learning (DL), these learning models empower numerous useful applications, e.g., image processing, speech recognition, healthcare, vehicular net…
▽ More
In the era of advanced technologies, mobile devices are equipped with computing and sensing capabilities that gather excessive amounts of data. These amounts of data are suitable for training different learning models. Cooperated with advancements in Deep Learning (DL), these learning models empower numerous useful applications, e.g., image processing, speech recognition, healthcare, vehicular network and many more. Traditionally, Machine Learning (ML) approaches require data to be centralised in cloud-based data-centres. However, this data is often large in quantity and privacy-sensitive which prevents logging into these data-centres for training the learning models. In turn, this results in critical issues of high latency and communication inefficiency. Recently, in light of new privacy legislations in many countries, the concept of Federated Learning (FL) has been introduced. In FL, mobile users are empowered to learn a global model by aggregating their local models, without sharing the privacy-sensitive data. Usually, these mobile users have slow network connections to the data-centre where the global model is maintained. Moreover, in a complex and large scale network, heterogeneous devices that have various energy constraints are involved. This raises the challenge of communication cost when implementing FL at large scale. To this end, in this research, we begin with the fundamentals of FL, and then, we highlight the recent FL algorithms and evaluate their communication efficiency with detailed comparisons. Furthermore, we propose a set of solutions to alleviate the existing FL problems both from communication perspective and privacy perspective.
△ Less
Submitted 6 April, 2020;
originally announced April 2020.
-
Using Machine Learning Approach for Computational Substructure in Real-Time Hybrid Simulation
Authors:
Elif Ecem Bas,
Mohamed A. Moustafa,
David Feil-Seifer,
Janelle Blankenburg
Abstract:
Hybrid simulation (HS) is a widely used structural testing method that combines a computational substructure with a numerical model for well-understood components and an experimental substructure for other parts of the structure that are physically tested. One challenge for fast HS or real-time HS (RTHS) is associated with the analytical substructures of relatively complex structures, which could…
▽ More
Hybrid simulation (HS) is a widely used structural testing method that combines a computational substructure with a numerical model for well-understood components and an experimental substructure for other parts of the structure that are physically tested. One challenge for fast HS or real-time HS (RTHS) is associated with the analytical substructures of relatively complex structures, which could have large number of degrees of freedoms (DOFs), for instance. These large DOFs computations could be hard to perform in real-time, even with the all current hardware capacities. In this study, a metamodeling technique is proposed to represent the structural dynamic behavior of the analytical substructure. A preliminary study is conducted where a one-bay one-story concentrically braced frame (CBF) is tested under earthquake loading by using a compact HS setup at the University of Nevada, Reno. The experimental setup allows for using a small-scale brace as the experimental substructure combined with a steel frame at the prototype full-scale for the analytical substructure. Two different machine learning algorithms are evaluated to provide a valid and useful metamodeling solution for analytical substructure. The metamodels are trained with the available data that is obtained from the pure analytical solution of the prototype steel frame. The two algorithms used for developing the metamodels are: (1) linear regression (LR) model, and (2) basic recurrent neural network (RNN). The metamodels are first validated against the pure analytical response of the structure. Next, RTHS experiments are conducted by using metamodels. RTHS test results using both LR and RNN models are evaluated, and the advantages and disadvantages of these models are discussed.
△ Less
Submitted 4 April, 2020;
originally announced April 2020.
-
Pattern Separation in a Spiking Neural Network of Hippocampus Robust to Imbalanced Excitation/Inhibition
Authors:
Faramarz Faghihi,
Homa Samani,
Ahmed A. Moustafa
Abstract:
Efficient pattern separation in dentate gyrus plays an important role in storing information in the hippocampus. Current knowledge of the structure and function of the hippocampus, entorhinal cortex and dentate gyrus, in pattern separation are incorporated in our model. A three-layer feedforward spiking neural network inspired by the rodent hippocampus an equipped with simplified synaptic and mole…
▽ More
Efficient pattern separation in dentate gyrus plays an important role in storing information in the hippocampus. Current knowledge of the structure and function of the hippocampus, entorhinal cortex and dentate gyrus, in pattern separation are incorporated in our model. A three-layer feedforward spiking neural network inspired by the rodent hippocampus an equipped with simplified synaptic and molecular mechanisms is developed. The aim of the study is to make an spiking neural network capable of pattern separation in imbalanced excitation/inhibition ratios caused by different levels of stimulations or network damage. This work present a novel theory on the cellular mechanisms of robustness to damges to synapses and connectivity of neurons in dentate gyrus that results in imbalanced excitation-inhibition activity of neurons. This spiking neural network uses simplified molecular and cellular hypothetical mechanisms and demonstrates efficient storing of information in different levels of stimulation and can be implemented in cognitive robotics.
△ Less
Submitted 1 August, 2018;
originally announced August 2018.
-
Benchmarking neural networks for quantum computation
Authors:
N. H. Nguyen,
E. C. Behrman,
M. A. Moustafa,
J. E. Steck
Abstract:
The power of quantum computers is still somewhat speculative. While they are certainly faster than classical ones at some tasks, the class of problems they can efficiently solve has not been mapped definitively onto known classical complexity theory. This means that we do not know for which calculations there will be a "quantum advantage," once an algorithm is found. One way to answer the question…
▽ More
The power of quantum computers is still somewhat speculative. While they are certainly faster than classical ones at some tasks, the class of problems they can efficiently solve has not been mapped definitively onto known classical complexity theory. This means that we do not know for which calculations there will be a "quantum advantage," once an algorithm is found. One way to answer the question is to find those algorithms, but finding truly quantum algorithms turns out to be very difficult. In previous work over the past three decades we have pursued the idea of using techniques of machine learning to develop algorithms for quantum computing. Here we compare the performance of standard real- and complex-valued classical neural networks with that of one of our models for a quantum neural network, on both classical problems and on an archetypal quantum problem: the computation of an entanglement witness. The quantum network is shown to need far fewer epochs and a much smaller network to achieve comparable or better results.
△ Less
Submitted 6 December, 2018; v1 submitted 9 July, 2018;
originally announced July 2018.
-
Learning quantum annealing
Authors:
E. C. Behrman,
J. E. Steck,
M. A. Moustafa
Abstract:
We propose and develop a new procedure, whereby a quantum system can learn to anneal to a desired ground state. We demonstrate successful learning to produce an entangled state for a two-qubit system, then demonstrate generalizability to larger systems. The amount of additional learning necessary decreases as the size of the system increases. Because current technologies limit measurement of the s…
▽ More
We propose and develop a new procedure, whereby a quantum system can learn to anneal to a desired ground state. We demonstrate successful learning to produce an entangled state for a two-qubit system, then demonstrate generalizability to larger systems. The amount of additional learning necessary decreases as the size of the system increases. Because current technologies limit measurement of the states of quantum annealing machines to determination of the average spin at each site, we then construct a "broken pathway" between the initial and desired states, at each step of which the average spins are nonzero, and show successful learning of that pathway. Using this technique we show we can direct annealing to multiqubit GHZ and W states, and verify that we have done so. Because quantum neural networks are robust to noise and decoherence we expect our method to be readily implemented experimentally; we show some preliminary results which support this.
△ Less
Submitted 31 January, 2017; v1 submitted 5 March, 2016;
originally announced March 2016.
