Driven by the importance of early detection for improving patient outcomes, this study investigates the effectiveness of various machine learning algorithms in predicting lung cancer based on clinical data. Lung cancer remains a significant global health concern, and this research seeks to contribute to advancements in early diagnosis through the application of machine learning techniques. The dataset consists of 385 training and 97 test samples, with a k-fold cross-validation approach (k=5) utilized to mitigate overfitting. Additionally, the ADASYN oversampling technique is employed to address class imbalance. Our analysis includes traditional algorithms such as Logistic Regression and Decision Trees, as well as ensemble methods like XGBoost, LGBM, and AdaBoost. Furthermore, we explore the effectiveness of deep learning models, particularly Deep Neural Networks (DNN). Results demonstrate promising accuracy rates across all models, with some outperforming others in terms of precision, recall, and F1-score. Our findings reveal that LGBM achieves the highest accuracy among all models, with an accuracy rate of 96.91%. It also exhibits superior performance in terms of precision, recall, and F1-score, particularly in classifying both positive and negative instances of lung cancer.

Every year, the Montreal police are confronted with countless crimes committed by criminals. These crimes affect the quality of life of city residents and impose a socio-economic burden on the city. In this study, we conduct a comparative analysis based on several machine learning algorithms to develop a model to predict the crime category in Montreal. The performance of algorithms such as eXtreme Gradient Boosting (XGBoost), Decision Trees (DT) and Random Forest (RF) were analyzed. The performance analysis takes into account the performance metrics such as precision, accuracy, recall and F1-score. This analysis was based on crime data in Montreal from 2015 to 2023. This data is characterized by a strong imbalance between crime categories. To address the data imbalance problem, a data balancing approach based on the SMOTE-ENN algorithm was adopted. In the exploratory data analysis phase, temporal trends by crime category were highlighted. The results of the analysis showed that the XGBoost algorithm outperformed the other two. Specifically, the XGBoost algorithm achieves an accuracy of 92%, while DT and RF achieve an accuracy of 86% and 84%, respectively. As a result, XGBoost was deployed via a web application using the Flask and Swagger UI Python frameworks. This study provides the Montreal police with an effective tool to better utilize their resources in fighting crime. In addition, policymakers in the city of Montreal can use this tool to identify high-risk areas and give them more attention.

Predicting heart disease is crucial for early diagnosis and intervention, significantly improving patient outcomes and reducing mortality rates. This study compares various machine learning models, including Logistic Regression, Random Forest, Gradient Boosting, XGBoost, and Long Short-Term Memory (LSTM) networks, using the Cleveland Heart Disease dataset. Comprehensive preprocessing steps were undertaken, such as handling missing values, converting categorical variables to numeric forms, and binarizing the target variable for binary classification. Each model was rigorously evaluated using performance metrics, including accuracy, precision, recall, F1-score, and the area under the receiver operating characteristic curve (AUC-ROC). SHapley Additive exPlanations (SHAP) values were employed to provide insights into feature importance, ensuring model transparency and interpretability. The results indicate that XGBoost outperformed all other models, achieving an accuracy of 90% and an AUC-ROC of 0.94, demonstrating its superior ability to capture complex patterns in the data through advanced optimization techniques and regularization. This study highlights the significant potential of advanced machine learning techniques, particularly ensemble methods like Gradient Boosting and XGBoost, in enhancing heart disease prediction. These models offer higher accuracy and valuable interpretability, making them practical tools for early diagnosis in clinical settings. Future research should focus on integrating these models into healthcare systems and exploring hybrid approaches to further improve predictive performance and clinical applicability.

Psychological momentum dynamics in tennis have triggered interest for a long time, but measuring their impact presents substantial obstacles. In this paper, we present an approach to quantify momentum that combines real-time winning probabilities, leverage, and an exponentially weighted moving average (EWMA). We test the method on a high-profile match between Carlos Alcaraz and Novak Djokovic, demonstrating how changes in leverage affect momentum. Furthermore, we use feature extraction methods from time series analysis to derive momentum-related characteristics, which are critical inputs for creating an eXtreme Gradient Boosting (XGBoost) binary classification model to predict game winners. The algorithm has an average accuracy of 84% and provides real-time predictions of each player’s chances of winning the match. Our findings indicate that momentum is a somewhat relevant element in forecasting match outcomes, highlighting its potential value in improving match prediction systems.

We tested selecting data randomly or proportionally in class imbalanced sample. Collecting data into the training and test set according to the initial ratio of QSOs, galaxies and stars were rec-ommended. We experimented using the original imbalanced data or introducing the class balance technologies: SMOTE, SMOTEENN, SMOTETomek, ADASYN, BorderlineSMOTE1, Border-lineSMOTE2, and RandomUndersampling. The SMOTEENN performed the best in the Sample 1. The LightGBM, CatBoost, XGBoost, and RF were compared when adopting the SMOTEENN using the petroMag_u, petroMag_g, petroMag_r, petroMag_i, petroMag_z, J, H, Ks, W1, W2, W3, W4 magnitudes as features. All of the precisions or recalls exceeded 0.94. The RF cost a little more time than the other three algorithms, but resulted in the best evaluating indicators. Utilizing the SMOTEENN +RF technology, the precision, recall and f1-score for QSOs (galaxies, stars) could achieve 0.98 (0.99, 0.98), 0.99 (0.96, 1.00), 0.98 (0.97, 0.99) respectively in Sample 1. Utilizing the SMOTEENN +RF technology, the precision, recall and f1-score for QSOs (galaxies, stars) could achieve 0.94 (0.96, 0.96), 0.98 (0.90, 0.97), 0.96 (0.93, 0.97) using the petroMag_u, petroMag_g, petroMag_r, petroMag_i, petroMag_z, W1, W2, W3, W4 magnitudes as features.

While numerous studies have explored the correlation between the built environment and ride-hailing demand, few have assessed their nonlinear interplay. Utilizing ride-hailing order data and multi-source built environment data from Nanjing, China, this paper uses the machine learning method, eXtreme Gradient Boosting (XGBoost), combined with SHapley Additive exPlanations (SHAP) and Partial Dependence Plots (PDP) to investigate the impact of built environment factors on ride-hailing travel demand, including their non-linear and threshold effects. The findings reveal that dining facilities have the most significant impact, with a contribution rate of 30.75%, on predicting ride-hailing travel demand. Additionally, financial, corporate, and medical facilities also exert considerable influence. The built environment factors need to reach a certain threshold or within a certain range to maximize the impact of ride-hailing travel demand. population density, land use mix and distance to the subway station collectively influence ride-hailing demand. The results are helpful for TNCs to allocate network ride-hailing resources reasonably and effectively.

Defect recognition in ballastless track structures, based on distributed acoustic sensors (DASs), was researched in order to improve detection efficiency and ensure the safe operation of trains on high-speed railways. A line in southern China was selected, and equipment was installed and debugged to collect the signals of trains and events along it. Track vibration signals were extracted by identifying a train track, denoising, framing and labeling to build a defect dataset. Time–frequency-domain statistical features, wavelet packet energy spectra and the MFCCs of vibration signals were extracted to form a multi-dimensional vector. An XGBoost model was trained and its accuracy reached 89.34%. A time-domain residual network (ResNet) that would expand the receptive field and test the accuracies obtained from convolution kernels of different sizes was proposed, and its accuracy reached 94.82%. In conclusion, both methods showed good performance with the built dataset. Additionally, the ResNet delivered more effective detection of DAS signals compared to conventional feature engineering methods.

In Kenya, Rift Valley Fever (RVF) outbreaks pose significant challenges, being one of the most severe climate-sensitive zoonoses. While Machine Learning (ML) techniques have shown superior performance in time series forecasting, their application in predicting disease outbreaks in Africa remains under explored. Leveraging data from the International Livestock Research Institute (ILRI) in Kenya, this study pioneers the use of ML techniques to forecast RVF outbreaks by analysing climate data spanning from 1981 to 2010, including machine learning models. Through a comprehensive analysis of ML model performance and the influence of environmental factors on RVF outbreaks, this study provides valuable insights into the intricate dynamics of disease transmission. The XGB Classifier emerged as the top-performing model, exhibiting remarkable accuracy in identifying RVF outbreak cases, with an accuracy score of 0.997310. Additionally, positive correlations were observed between various environmental variables, including rainfall, humidity, and claypatterns, and RVFcases, underscoring the critical role of climatic conditions in disease spread. These findings have significant implications for public health strategies, particularly in RVF-endemic regions, where targeted surveillance and control measures are imperative. However, the study also acknowledges the limitations in model accuracy, especially in scenarios involving concurrent infections with multiple diseases, highlighting the need for ongoing research and development to address these challenges. Overall, this study contributes valuable insights to the field of disease prediction and management, paving the way for innovative solutions and improved public health outcomes in RVF-endemic areas and beyond.

Employee turnover is a significant issue for financial institutions, impacting productivity, increasing recruitment costs, and disrupting critical operations. In this project, this study aimed to predict employee turnover using a dataset containing attributes such as employee satisfaction, performance, and tenure. By framing the task as a binary classification problem, this study employed CatBoost and XGBoost, two advanced regression-based algorithms, to develop predictive models. This paper's analysis demonstrated that CatBoost outperformed XGBoost across all evaluation metrics, including MAE, MSE, RMSE, and R², making it the more effective model for predicting turnover in the financial sector. The study highlights key factors contributing to employee attrition, such as job satisfaction, tenure, and promotion opportunities, offering actionable insights for retention strategies. Additionally, by predicting probabilities rather than binary outcomes, this study aims to make more detailed decisions about employee retention. This research provides valuable tools for financial institutions to mitigate the risk of turnover, retain critical talent, and ensure operational continuity.

The potential of generalized machine learning models developed for crop water estimation was examined in the current study. Extreme Gradient Boosting (XGBoost), Gradient Boosting Machine (GBM), and Random Forest (RF) are three ensembled machine learning models that were developed using all of the data from a single location from 1976 to 2017 and then immediately applied at eleven different locations without the need for any local calibration. For the test period of January 2018 to June 2020, the model's capacity to estimate the numerical values of crop water requirement (Pen-man-Monteith (PM) ETo values) was assessed. In comparison to the GBM and RF models, the XGBoost model outperformed them both marginally and significantly. The estimate's weighted standard error was smaller than 0.85 mm/day, and the model's effectiveness varied from 96% to 99% across various locations. The model's strong performance was indicated by the decreased noise-to-signal ratio. A real-time water management system at the regional level can be seamlessly linked with this type of model due to its accuracy in estimating crop water requirements and its capacity to generalize.

The Ca Mau Peninsula situated in the Mekong Delta of Vietnam, features a low-lying terrain. Over recent years, the region has encountered the adverse impacts of climate change, leading to both land subsidence and rising sea levels. In this study, we assessed the land subsidence susceptibility in the Ca Mau peninsula utilizing three Boosting machine learning models: AdaBoost, Gradient Boosting, and Extremely Gradient Boosting (XGB). Eight key factors were identified as the most influential in land subsidence within Ca Mau: land cover (LULC), Groundwater levels, distance to roads, Digital Terrain Model (DTM), normalized vegetation index (NDVI), geology, soil composition, and proximity to rivers and streams. A dataset comprising 1950 subsidence sample points was employed for the model, with 1910 points obtained from the PSInSAR Radar method, and the remaining points derived from leveling measurements. The sample points were split, with 70% allocated to the training set and 30% to the testing set. Following computation and execution, the three models underwent evaluation for accuracy using statistical metrics such as the ROC curve, Area under the curve (AUC), Specificity, Sensitivity, and Overall Accuracy. The research findings revealed that the XGB model exhibited the highest accuracy, achieving an AUC above 0.9 for both the training and test sets. Consequently, XGB was chosen to construct a land subsidence susceptibility map for the Ca Mau peninsula.

Magnesium matrix composites have attracted significant attention due to their lightweight nature and impressive mechanical properties. However, the fabrication process for these alloy compo-sites is often time-consuming, expensive, and labor-intensive. To overcome these challenges, this study employed machine learning (ML) techniques to predict the mechanical properties of magnesium matrix composites. Regression models were utilized to forecast the yield strength of magnesium alloy composites reinforced with various materials. The study incorporated previous research on matrix type, reinforcement type, heat treatment, and mechanical working. The re-gression models employed in this study included decision tree regression, random forest re-gression, extra tree regression, and XGBoost regression. Model performance was assessed using metrics such as RMSE and R2. The XGBoost Regression model out-performed others, exhibiting an R2 value of 0.94 and the lowest error rate. Feature importance analysis indicated that the rein-forcement particle form had the greatest influence on the mechanical properties. The study iden-tified the optimized parameters for achieving the highest yield strength, which was 186.99 MPa. Overall, this study successfully demonstrates the effectiveness of ML as a valuable tool for opti-mizing the production parameters of magnesium matrix composites.

Abstract. The volatility of global energy markets, particularly electricity prices, plays a crucial role in influencing international economic activities. In the era of big data, machine learning has revolutionized the field of cancer research, particularly in analyzing gene expression data. This study explores the application of machine learning models to the GSE45827 dataset, which contains breast cancer gene expression profiles. With over 54,000 genes and 151 samples categorized into six classes, the dataset presents a high-dimensional challenge that is addressed using dimensionality reduction techniques such as Principal Component Analysis (PCA) and t-distributed Stochastic Neighbor Embedding (t-SNE). The PCA method proved most effective in retaining the critical features of the data in lower dimensions, allowing for clearer visualization and enhanced model performance.The reduced dataset was then classified using the eXtreme Gradient Boosting (XGBoost) model, achieving promising multi-class classification results. The model demonstrated high precision, recall, and F1-scores across several classes, particularly excelling in classes 1, 2, and 5. However, certain classes, such as 0 and 4, exhibited lower recall, highlighting areas for further refinement. The integration of PCA and XGBoost not only improved the interpretability and computational efficiency of the model but also contributed to the accurate identification of breast cancer subtypes, emphasizing the importance of machine learning in cancer diagnosis and treatment.

With the rapid development of electric vehicles, the infrastructure for charging stations is also expanding quickly, and the failure rate of charging piles is increasing. To address the effective operation and maintenance of charging stations, a method based on the XGBoost algorithm for electric vehicle DC charging stations is proposed. An operation and maintenance system is con-structed based on state analysis, considering the operation status of the charging station and users' charging habits. Factors such as driving and charging habits, road traffic, and charging station equipment are taken into account. The training sample data is established using historical data, online monitoring data, and external environmental data, and the charging station status evaluation model is trained using the XGBoost algorithm. Based on the condition assessment results, a risk assessment model is established in combination with fault parameters. Risk tracking of the charging station is conducted using the lack of power supply (ENC), evaluating the risk level of each station, and determining the operation and maintenance order. The optimal opera-tion and maintenance model for DC charging stations, aimed at achieving both economic and reliable goals, is constructed to determine the operation and maintenance schedule for each sta-tion. The results of the case study demonstrate that the state evaluation and operation and maintenance strategy can significantly improve the reliability of the system and the overall ben-efits of operation and maintenance while meeting the required standards.

To scientifically and effectively evaluate the service capacity of expressway service areas (ESAs) and improve the management level of ESAs, we propose a method for the recognition of vehicles entering ESAs (VeESAs) and estimation of vehicle dwell times using ETC data. First, the ETC data and their advantages are described in detail, and then the cleaning rules are designed according to the characteristics of the ETC data. Second, we established feature engineering according to the characteristics of VeESA, and proposed the XGBoost-based VeESA recognition (VR-XGBoost) model. Studied the driving rules in depth, we constructed a kinematics-based vehicle dwell time estimation (K-VDTE) model. The field validation in Part A/B of Yangli ESA using real ETC transaction data demonstrates that the effectiveness of our proposal outperforms the current state of the art. Specifically, in Part A and Part B, the recognition accuracies of VR-XGBoost are 95.9% and 97.4%, respectively, the mean absolute errors (MAEs) of dwell time are 52 s and 14 s, respectively, and the root mean square errors (RMSEs) are 69 s and 22 s, respectively. In addition, the confidence level of controlling the MAE of dwell time within 2 minutes is more than 97%. This work can effectively identify the VeESA, and accurately estimate the dwell time, which can provide a reference idea and theoretical basis for the service capacity evaluation and layout optimization of the ESA.

Despite extensively investigating the impact of social media on fashion products’ marketing, little evidence is available on how the platforms influence sales prediction. Focusing on Lolita fashion, this study investigates the impact of social media marketing on the sales volume prediction of fashion products. Essentially, we analyzed marketing data, including comments, likes, and shares from the Weibo social platform, to forecast future sales, examine how to enhance profit performance, and make production decisions. Using a quantitative approach, we tested three different prediction models, including multiple regression, decision tree, and XGBoost. The results revealed that increasing comments and decreasing the number of likes could significantly improve the sales volumes of Lolita products. In contrast, shares exerted a less significant impact on sales. Regarding prediction models, XGBoost was found to be the best method. In the fashion industry, social media is a useful tool for forecasting market trend. A limitation of this study is that only one social media platform was used to extract data, which might limit the generalization of the findings.

This paper discusses an improved XGBoost model based on four-vector optimization algorithm to improve the accuracy of loan approval prediction. Through the analysis of correlation heat maps, we found that there were significant positive and negative correlations among some variables, which laid the foundation for subsequent machine learning analysis. Based on this, we compare the traditional machine learning algorithm with the improved model to evaluate its performance in loan approval forecasting. In the confusion matrix analysis of the training set, the improved XGBoost model demonstrated excellent performance, with all loan approval predictions being correct with 100% accuracy. However, the performance in the test set was slightly different, with 1,182 projects receiving correct loan approval predictions and 99 projects forecasting errors. Of these, 26 projects that should have been predicted to be "unapproved" were incorrectly labeled as "approved," while 73 projects that should have been predicted to be "approved" were incorrectly labeled as "unapproved." These results suggest that we still need to pay attention to the misjudgment of the model in practical application. By synthesizing all model evaluation indicators, we found that the improved XGBoost model based on the four-vector optimization algorithm has a higher accuracy in loan approval prediction than the traditional XGBoost model, with an increase of 1.5%. In addition, the other evaluation indicators also show a trend of significantly better than the traditional model. This study shows that the four-vector optimization algorithm can effectively improve the application effect of XGBoost model in the field of loan approval, and provide more accurate data support and decision-making basis for the financial industry. In the future, we will continue to explore the potential and application prospects of this algorithm in other fields.

In Kenya, reports of Rift Valley fever (RVF), one of the worst climate-sensitive zoonosis, have been common. Despite the fact that several empirical studies have demonstrated that Machine learning techniques perform better than time series models in forecasting time series data, there is little evidence of their use in predicting disease outbreaks in Africa. Recently, the literature has mentioned a number of other uses of machine learning to support intelligent decision-making in the healthcare industry and public health but there is limited knowledge on the use of the XGBoost model in the prediction of disease outbreaks. Among the Kenyan provinces, Rift valley fever cases were more pronounced in Rift valley (26.80%) and Eastern (20.60%) regions. The study explored the relationship be-tween RVF incidence and various climatic factors, such as humidity, clay content, elevation, slope, and rainfall. The strongest correlation, a meager 0.02903 for rainfall, was found in the correlation matrix, which showed weak linear relationships between various climatic factors and RVF cases. These climate variables were used to train the XGBoost model, which showed remark-able performance with an AUC of 0.8908, accuracy of 99.74%, precision of 99.75%, and recall of 99.99%. Rainfall was found to be the most important predictor in the feature importance analysis. These findings are consistent with other research showing how important weather conditions are to RVF outbreaks. According to the study's findings, the use of sophisticated machine learning models that take a variety of climatic factors into account can greatly improve RVF outbreak prediction and control.

Despite the availability of COVID-19 vaccines, the global pandemic remains a significant health challenge. Timely detection of the virus is crucial for effective containment efforts, prompting the exploration of machine learning (ML) models for COVID-19 detection. highlights the ongoing significance of COVID-19 as a global health crisis despite the availability of vaccines. To address the need for timely virus detection, the study explores the efficacy of machine learning (ML) models, including DNN, Voting, Bagging, SVC_rbf, SVC_linear, SVC_polynomial, and SVC_sigmoid, in predicting COVID-19 infection probability. With a dataset comprising 4000 samples split into 3200 for training and 800 for testing, the analysis reveals that DNN and Voting models demonstrate the highest performance, achieving an impressive accuracy of 89%. These results underscore the potential of ML techniques, particularly DNN and ensemble methods like Voting, in facilitating early COVID-19 detection and contributing to effective pandemic management. The study emphasizes the importance of continued research to further refine and optimize ML-based COVID-19 detection systems.

Cloud-induced atmospheric extinction and occlusion have a major effect on the effectiveness and quality of telescope observations. Real-time cloud cover distribution and long-term statistical data are essential for astronomical siting and telescope operations. At ground-based astronomical telescope sites, cloud cover distribution is currently analyzed using manual observation methods. However, the main disadvantages of manual observation methods are human subjective, heavy workloads and poor real-time performance. Therefore, a real-time automatic cloud images classification method is desperately needed. This paper presents a new cloud identification method, which is named PSO+XGBoost model by combining eXtreme Gradient Boosting (XGBoost) and Particle Swarm Optimization (PSO). The entire cloud image is divided into 37 sub-regions in order to more precisely identify the distribution of the clouds. 19 features are then extracted, including the sky background, star density, lighting conditions, and subregion grayscale values. The experimental results have shown that the overall classification accuracy of 96.91% and our model is able to outperform several state-of-the-art baseline methods. Our approach achieves high accuracy in comparison with the manual observation methods. Moreover, this method meets telescope real-time scheduling requirements.

There is a significant risk of injury in sports and intense competition due to the demanding physical and psychological requirements. Hamstring strain injuries (HSI) are the most prevalent type of injury among professional soccer players and are the leading cause of missed days in the sport. These injuries stem from a combination of factors, making it challenging to pinpoint the most crucial risk factors and their interactions, let alone find effective prevention strategies. Recently, there has been a growing recognition of the potential of tools provided by artificial intelligence (AI). However, current studies primarily concentrate on enhancing the performance of complex machine learning models, often overlooking their explanatory capabilities. Consequently, medical teams encounter difficulty interpreting these models and are hesitant to trust them fully. In light of this, there is an increasing need for advanced injury detection and prediction models that can aid doctors in diagnosing or detecting injuries earlier and with greater accuracy. Accordingly, this study aims to identify biomarkers of muscle injuries in professional soccer players through a biomechanical analysis, employing several ML algorithms, such as Decision tree (DT) methods, Discriminant methods, Logistic regression, Naive Bayes, Support vector machine (SVM), K-nearest neighbor (KNN), Ensemble methods, Boosted and bagged trees, Artificial Neural Networks (ANN), and XGBoost. In particular, XGBoost was also used to obtain the most important features. The findings highlight that the variables that most effectively differentiate the groups and could serve as reliable predictors for injury prevention are the maximum muscle strength of the hamstrings and the stiffness of the same muscle. With regards to the 35 techniques employed, a precision of up to 78% was achieved with XGBoost, indicating that by considering scientific evidence, suggestions based on various data sources, and expert opinions, it is possible to attain good precision, thus enhancing the reliability of the results for doctors and trainers. Furthermore, the obtained results strongly align with the existing literature, although further specific studies about this sport are necessary to draw a definitive conclusion.

Computational Fluid Dynamics (CFD)-based simulation has been the traditional way to model complex industrial systems and processes. One very large and complex industrial system that has benefited from CFD-based simulations is the steel blast furnace. The problem with the CFD-based simulation approach is that it tends to be very slow to generate data. The CFD-only approach may not be fast enough for use in real-time decision-making. To address this issue, in this work, the authors propose the use of machine learning techniques to train and test models based on data generated via CFD simulation. Regression models based on neural networks are compared to tree boosting models. In particular, several areas (tuyere, raceway, and shaft) of the blast furnace are modeled using these approaches. The results of the model training and testing are presented and discussed. The obtained R2 metrics are, in general, very high. The results look promising and may help to improve the efficiency of operator and process engineer decision-making when running a blast furnace.

Background: Acute heart failure (AHF) is a serious medical problem that necessitates hospitalisation and often results in death. Patients hospitalised to the emergency department (ED) should therefore receive an immediate diagnosis and treatment. Unfortunately, there is not yet a fast and accurate laboratory test for identifying AHF. The purpose of this research is to apply the principles of explainable artificial intelligence (XAI) to the analysis of hematological predictors for AHF. Methods: In this retrospective analysis, 425 patients with AHF and 430 healthy individuals served as assessments. Patients' demographic and hematological information was analyzed to determine AHF. Important risk variables for AHF diagnosis were identified using LASSO feature selection. To test the efficacy of the suggested prediction model (XGBoost), a 10-fold cross-validation procedure was implemented. The area under the receiver operating characteristic curve (AUC), F1 score, Brier score, and Positive Predictive Value (PPV) and Negative Predictive Value (NPV) were all computed to evaluate the model's efficacy. Permutation-based analysis and SHAP, were used to assess the importance and influence of the model's incorporated risk factors. Results: White blood cell (WBC), monocytes, neutrophils, neutrophil-lymphocyte ratio (NLR), red cell distribution width-standard deviation (RDW-SD), RDW-coefficient of variation (RDW-CV), and platelet distribution width (PDW) values were significantly higher than the healthy group (p<0.05). On the other hand, erythrocyte, hemoglobin, basophil, lymphocyte, mean platelet volume (MPV), platelet, hematocrit, mean erythrocyte hemoglobin (MCH) and procalcitonin (PCT) values were found to be significantly lower in AHF patients compared to healthy controls (p <0.05). When XGBoost was used in conjunction with LASSO to estimate AHF, the resulting model had an AUC of 87.9%, an F1 score of 87.4%, a Brier score of 0.036, and an F1 score of 87.4%. PDW, age, RDW-SD, and PLT were identified as the most crucial risk factors in differentiating AHF. Conclusions: The XGBoost model demonstrated exceptional performance in accurately estimating Acute Heart Failure, and the application of Explainable Artificial Intelligence effectively provided intuitive explanations for the model's estimations. The suggested interpretable model holds potential for the identification of patients at high risk, thereby facilitating the optimization of treatment and planning for follow-up in cases of AHF.

Accurate measurements of tree height and diameter at breast height (DBH) in forests to evaluate the growth rate of cultivars is still a significant challenge, even when using LiDAR and 3-D modeling. We propose an integrated pipeline methodology to measure the biomass of different tree cultivars in plantation forests with high crown density which that combines unmanned aerial vehicles (UAVs), hyperspectral image sensors, and data processing algorithms using machine learning. Using a planation of Cunninghamia lanceolate, commonly known as Chinese fir, in Fujian, China, images were collected using a hyperspectral camera and orthorectified in HiSpectral Stitcher. Vegetation indices and modeling were processed in Python using decision trees, random forests, support vector machine, and eXtreme Gradient Boosting (XGBoost) third-party libraries. Tree height and DBH of 2880 samples were measured manually and clustering into three groups: “fast growth,” “median,” growth and “normal” growth group, and 19 vegetation indices from 12,000 pixels were abstracted as the input of features for the modeling. After modeling and cross-validation, the classifier generated by random forests had the best prediction accuracy compare to other algorisms (75%). This framework can be applied to other tree species to make management and business decisions.

Customer churn is a critical challenge for subscription-based businesses, especially in telecommunications, where retaining customers is essential to maintaining profitability. This study investigates the efficacy of two ML models, XGBoost and Random Forest, for predicting customer churn using a publicly available telecommunications dataset. The dataset, characterized by imbalanced classes, presents a crucial challenge addressed by incorporating the Gaussian Noise Upsampling (GNUS) sampling technique. The study evaluates and compares the two models using essential performance indicators, including precision, recall, accuracy, F1-score, and ROC-AUC, both with and without GNUS sampling. The results indicate that while XGBoost initially outperforms Random Forest across most metrics, both models show improved recall after the GNUS application, particularly in identifying churn cases. However, this improvement in recall comes with a trade-off in precision and overall accuracy. The findings highlight the relevance of using appropriate sampling techniques to tackle class imbalance in churn prediction and provide valuable insights for developing proactive customer retention strategies.

Accurately predicting drug-drug interactions (DDIs) is crucial for preventing adverse drug events in clinical settings. However, existing methodologies often rely on complex models built from diverse data sources, posing challenges in computational drug discovery. To address the need for precise computational methods in predicting unknown DDIs, this study introduces a novel Deep Neural Network (DNN)-based approach. By leveraging a wide range of drug-related information, including substructure, targets, side effects, pathways, and indications, our method calculates multiple drug similarities. These similarities are then synthesized using a nonlinear fusion method to extract high-level features. Subsequently, a tailored neural network is deployed for interaction prediction. Comparative evaluation against three prominent machine learning classifiers—Extreme Gradient Boosting (XGBoost), Adaptive Gradient Boosting (AdaBoost), and Light Gradient-Boosting Machine (LGBM)—using three benchmark datasets demonstrates the superior performance of DNN. It achieves outstanding accuracy, precision, recall, and F1-score metrics, all reaching 94.6% in cross-validation. Additionally, case studies involving numerous drug pairs confirm the reliability of DNN in accurately predicting unknown DDIs. These findings underscore DNN as a potent and reliable method for DDI prediction, with promising implications for drug discovery and healthcare applications.

In this paper, we introduce a new causal formula to distinguish Gliosarcoma (GSM) from Glioblastoma (GBM). Our formula combines Probabilistic Easy Variational Causal Effect (PEACE) with XGBoost, or eXtreme Gradient Boosting algorithm. Unlike prior research, which often relied on statistical models to reduce dataset dimensions before causal analysis, our approach uses the complete dataset with PEACE and XGBoost algorithm. PEACE provides a comprehensive measurement of direct causal effects, applicable to both continuous and discrete variables. It offers a spectrum of both positive and negative causal effects of the events causal effect values based on the degree ?, reflecting the rarity and frequency of the events. By using PEACE with XGBoost, we achieve a detailed and nuanced understanding of the causal relationships within the dataset features, facilitating accurate differentiation between GSM and GBM.

Cancer metastasis accounts for approximately 90% of cancer deaths, and elucidating markers in metastasis is the first step in its prevention. To characterize metastasis marker genes of breast cancer (MGs), XGBoost models that classify metastasis status were trained with gene expression profiles from TCGA. Then, a metastasis score (MS) was assigned to each gene by calculating the inner product between the feature importance and AUC performance of the models. As a result, the 54, 202, and 357 genes with the highest MS were characterized as MGs by empirical P-value cutoffs of 0.001, 0.005, and 0.01, respectively. The three sets of MGs were compared with those from existing metastasis marker databases, which provided significant results in most comparisons. We noticed that the set of MGs with the median EP cutoff showed better performance than the other two sets, suggesting the importance of the cutoff used in determining MGs. They were also significantly enriched in biological processes associated to breast cancer metastasis. The MGs that could not be identified by statistical analysis (e.g., GOLM1, ELAVL1, UBP1, and AZGP1) as well as the MGs with the highest MS (e.g., ZNF676, FAM163B, LDOC2, IRF1, and STK40) were verified via the literature. Additionally, we checked how close the MGs are located to each other in the protein–protein interaction networks. We expect that the characterized markers will help understand and prevent breast cancer metastasis.

Background: Ensemble tree-based models such as Xgboost are highly prognostic in cardiovascular medicine, as measured by the Clinical Effectiveness Metric (CEM). However, their ability to handle correlated data, such as hospital-level effects, are limited. Objectives: The aim of this work is to develop a binary outcome mixed effects Xgboost (BME) model that integrates random effects at the hospital level. To ascertain how well the model handles correlated data in cardiovascular outcomes, we aims to assess its performance and compare it to fixed effects Xgboost and traditional logistic regression models. Methods: A total of 227,087 patients over 17 years of age, undergoing cardiac surgery from 42 UK hospitals between 1 Jan 2012 and 31 Mar 2019 were included. The dataset was split into two cohorts: Training/Validation (n = 157196; 2012-2016) and Holdout (n = 69891; 2017-2019). The outcome variable was 30 days mortality with hospitals considered as clustering variable. The logistic regression, mixed effects logistic regression, Xgboost and binary outcome mixed effects Xgboost (BME) were fitted to both standardized and unstandardized datasets across a range of sample sizes and the estimated prediction power metrics were compared to identify the best approach. Results: The exploratory study found high variability in hospital-related mortality across datasets, which supported the adoption of mixed effects models. Unstandardized Xgboost BME demonstrated marked improvements in predictor power over the Xgboost model at small sample size ranges, but performance differences decreased as dataset sizes increased. Generalized linear models (glm) and generalized linear mixed-effects models (glmer) models followed similar results, with Xgboost models excelling also at greater sample sizes. Conclusions: These findings suggest that integrating mixed effects into machine learning models can enhance their applicability in clinical settings where sample size is small such as rare conditions.

This paper presents a comprehensive study on applying machine learning (ML) techniques for real-time credit card fraud detection. With the increasing prevalence of credit card fraud, financial institutions face the challenge of detecting fraudulent transactions promptly and accurately. This research evaluates various ML models, including Logistic Regression, Decision Trees, Random Forests, XGBoost, and Deep Convolutional Neural Networks, for their effectiveness in identifying fraudulent activities. Utilizing PySpark for processing large-scale transaction data, the study highlights the importance of real-time analysis, adaptive learning, and handling imbalanced datasets. Key findings reveal that XgBoost, with its balance of accuracy and complexity, emerged as the most promising model, achieving an accuracy rate of 98% in detecting fraudulent transactions. The paper further discusses the potential of ensemble methods, graph-powered systems, and intelligent sampling in enhancing fraud detection capabilities. Challenges such as overfitting, data access, and the need for real-time analysis are addressed. Future research directions include implementing models in live transaction environments, expanding model applicability across financial platforms, and developing advanced anomaly detection methodologies. This study underscores the pivotal role of machine learning in safeguarding financial transactions against fraud, offering significant implications for consumers, financial institutions, and the broader financial ecosystem.

With the increasing use of cloud-based services for training and deploying machine learning models, data privacy has become a major concern. This is particularly important for natural language processing (NLP) models, which often process sensitive information such as personal communications and confidential documents. In this study, we propose a method for training NLP models on encrypted text data to mitigate data privacy concerns while maintaining similar performance to models trained on non-encrypted data. We demonstrate our method using two different architectures, namely Doc2Vec+XGBoost and Doc2Vec+LSTM, and evaluate the models on the 20 Newsgroups dataset. Our results indicate that both encrypted and non-encrypted models achieve comparable performance, suggesting that our encryption method is effective in preserving data privacy without sacrificing model accuracy. In order to replicate our experiments, we have provided a Colab notebook at the following address: https://t.ly/lR-TP

Accurate and efficient traffic incident detection methods can effectively alleviate traffic congestion caused by traffic incidents, prevent secondary accidents and improve the safety of urban road traffic.Aiming at the problems that the traditional machine learning event detection method cannot fully extract the parameter characteristics of traffic flow and is not suitable formulti-dimensional and non-linear massive data, we propose a new traffic event detection method(CNN-XGBoost).This method combines the respective advantages of Convolution Neural Network(CNN) and Extreme Gradation Boosting (XGBoost). Firstly, we preprocessed the original freeway traffic incident detection data set by constructing initial variable set, data normalization, data balance processing and dimension reorganization. Secondly,we use CNN network to automatically extract the deep features of event detection data, and use XGBoost as a classifier to classify the extracted features for expressway traffic event detection.Finally, we use the data set of Hangzhou expressway microwave detector in China to carry out simulation experiments on CNN-XGBoost. The experimental results show that compared with XGBoost, CNN, Support Vector Machine (SVM) and Gradient Boosting Decision Tree (GBDT) and other methods, CNN-XGBoost method can effectively improve the accuracy of expressway traffic event detection and has better generalization ability.

The accurate forecasting of solar power output is essential for ensuring the stable and efficient operation of grid-connected photovoltaic (PV) systems, especially when faced with variable weather patterns. This research focuses on the integration of Machine Learning (ML) methodologies and climatic parameters to predict solar panel energy generation, with a specific emphasis on addressing consumption-production imbalances. Leveraging a dataset sourced from the Kaggle platform, the study is conducted in the context of Estonia, aiming to optimize solar energy utilization in this geographic region. The dataset, obtained from Kaggle, encompasses comprehensive information on climatic variables, including sunlight intensity, temperature, and humidity, alongside corresponding solar panel energy output. Leveraging machine learning algorithms, including XGBoost regression and neural networks, our model aims to identify complex patterns and relationships within the datasets. By tailoring the model to Estonia's climatic nuances, we seek to enhance the accuracy of energy production forecasts and, consequently, better manage the challenges associated with consumption-production imbalances. Furthermore, the research investigates the adaptability of the proposed model to diverse climatic conditions, ensuring its applicability for similar endeavors in other geographical locations. The performance of the forecasting model will be evaluated using error metrics like mean absolute error (MAE) and root mean squared error (RMSE). This study leverages a comprehensive dataset from Kaggle and utilizes advanced machine learning techniques to generate valuable insights. These insights can inform the development of sustainable energy policies and practices, ultimately leading to a more efficient and reliable renewable energy infrastructure.

Nutrient regulation in aquaponic environments has been the topic of research for many years. Most have focused on appropriate control of nutrients in an aquaponic set-up, but very little research has been done on commercial scale applications. In our model, the input data was sourced on a weekly basis from three commercial aquaponic farms in South-East Texas over the course of a year. Due to limited number of data points, dimensionality reduction techniques like pair-wise correlation matrix was used to remove the highly correlated predictors. Feature selection techniques like the XGBoost classifier and Recursive Feature Elimination with ExtraTreesClassifier were used to rank the features in order of their relative importance. Ammonium and calcium were found to be the top two nutrient predictors and based on the months in which lettuce was cultivated, the median of these nutrient values from the historical dataset served as the optimal concentrations to be maintained in the aquaponic solution. To accomplish this, Vernier sensors were used to measure the nutrient values and actuator systems were built to dispense the appropriate nutrient into the ecosystem via a closed loop.

This paper explores the capability of various machine learning algorithms, including Random Forests and advanced gradient boosting techniques such as XGBoost, LightGBM, and CatBoost, to predict customer churn in the telecommunications sector. For this analysis, a dataset available to the public was employed. The performance of these algorithms was assessed using recognized metrics, including Accuracy, Precision, Recall, F1-score, and the Receiver Operating Characteristic Area Under Curve (ROC AUC). These metrics were evaluated at different phases: subsequent to data preprocessing and feature selection; following the application of SMOTE and ADASYN sampling methods; and after conducting hyperparameter tuning on the data that had been adjusted by SMOTE and ADASYN. The outcomes underscore the notable efficiency of upsampling techniques such as SMOTE and ADASYN in addressing the imbalance inherent in customer churn prediction. Notably, the application of random grid search for hyperparameter optimization did not significantly alter the results, which remained comparatively unchanged. The algorithms' performance post- ADASYN application marginally surpassed that observed after SMOTE application. Remarkably, LightGBM achieved an exceptional F1-score of 89% and an ROC AUC of 95% subsequent to the ADASYN sampling technique. This underlines the effectiveness of advanced boosting algorithms and upsampling methods like SMOTE and ADASYN in navigating the complexities of imbalanced datasets and intricate feature interdependencies.

Heart failure is associated with a significant mortality rate, and an elevated prevalence of this condition has been noted among hypertensive patients. The identification of predictive factors for heart failure progression in hypertensive individuals is crucial for early intervention and improved patient outcomes. In this study, we aimed to identify these predictive factors utilizing medical history data for hypertension patients. Specifically, we focused solely on utilizing medical data preceding the diagnosis of hypertension to enable patients to anticipate the onset of potential heart failure at the time of hypertension diagnosis. Age-specific and ICD system-specific predictive factors were identified utilizing the MIMIC-IV database through the application of two analytical approaches: chi-square tests and XGBoost modeling. Our findings reveal 21 overall predictive factors, encompassing conditions such as atrial fibrillation, the use of anticoagulants, kidney failure, obstructive pulmonary disease, and anemia. These factors were assessed through a comprehensive review of the existing literature. We anticipate that the results will offer valuable insights for the risk assessment of heart failure in hypertensive patients.

Software is increasingly vital, with automated systems regulating critical functions. As development demands grow, manual code review becomes more challenging, often making testing more time-consuming than development. A promising approach to improving defect detection at the source code level is the use of artificial intelligence combined with natural language processing (NLP). Source code analysis, leveraging machine-readable instructions, is an effective method for enhancing defect detection and error prevention. This work explores source code analysis through NLP and machine learning, comparing classical and emerging error detection methods. To optimize classifier performance, metaheuristic optimizers are used, and a modified algorithm is introduced to meet the study’s specific needs. The proposed two-tier framework uses a convolutional neural network (CNN) in the first layer to handle large feature spaces, with AdaBoost and XGBoost classifiers in the second layer to improve error identification. Additional experiments using Term Frequency-Inverse Document Frequency (TF-IDF) encoding in the second layer demonstrate the framework’s versatility. Across five experiments with public datasets, the CNN achieved an accuracy of 0.768799. The second layer, using AdaBoost and XGBoost, further improved these results to 0.772166 and 0.771044, respectively. Applying NLP techniques yielded exceptional accuracies of 0.979781 and 0.983893 from the AdaBoost and XGBoost optimizers.

Dengue fever is a persistent public health issue in tropical regions, including Vietnam, where climate variability plays a crucial role in disease transmission dynamics. This study focuses on developing climate-based machine learning models to forecast dengue outbreaks in Ba Ria Vung Tau (BRVT) province, Vietnam, using meteorological data from 2003 to 2022. We utilized four predictive models—Negative Binomial Regression (NBR), Seasonal AutoRegressive Integrated Moving Average with Exogenous Regressors (SARIMAX), Extreme Gradient Boosting (XGBoost), and Long Short-Term Memory (LSTM)—to predict weekly dengue incidence. Key climate variables, including temperature, humidity, precipitation, and wind speed, were integrated into these models, with lagged variables included to capture delayed climatic effects on dengue transmission. The NBR model demonstrated the best performance in terms of predictive accuracy, achieving the lowest Mean Absolute Error (MAE) compared to other models. The inclusion of lagged climate variables significantly enhanced the model’s ability to predict dengue cases. SARIMAX and LSTM models, although effective in capturing seasonal trends, struggled with overfitting and failed to accurately predict short-term outbreaks. XGBoost exhibited moderate predictive power but was sensitive to overfitting, particularly without fine-tuning. Our findings confirm that climate-based machine learning models, particularly the NBR model, offer valuable tools for forecasting dengue outbreaks in BRVT. However, improving the models’ ability to predict short-term peaks remains a challenge. The integration of meteorological data into early warning systems is crucial for public health authorities to plan timely and effective interventions. This research contributes to the growing body of literature on climate-based disease forecasting and underscores the need for further model refinement to address the complexities of dengue transmission in highly endemic regions.

Wearable devices have become ubiquitous, collecting rich temporal data that offers valuable insights into human activities, health monitoring, and behavior analysis. Leveraging this data, researchers have developed innovative approaches to classify and predict time-based patterns and events in human life. Time-based techniques allow the capture of intricate temporal dependencies, which is the nature of the data coming from wearable devices. This paper focuses on predicting well-being factors, such as stress, anxiety, positive and negative affect, on the Tesserae dataset collected from office workers. We examine the performance of different methodologies, including deep learning architectures, LSTM, ensemble techniques, Random Forest (RF) and XGBoost and compare their performances for time-based and non-time-based versions. In time-based versions, we investigate the effect of previous records of well-being factors on the upcoming ones. The overall results show that time-based LSTM performs the best among conventional (non-time-based) RF, XGBoost, and LSTM. The performance even increases when we consider a more extended previous period, in this case, 3 past-days rather than 1 past-day to predict the next day. Furthermore, we explore the corresponding biomarkers for each well-being factor using feature ranking. The obtained rankings are compatible with the psychological literature. In this work, we validated them based on device measurements rather than subjective survey responses.

The aim of this work is to explain the behaviour of the multiresistance percentage of Pseudomona aeruginosa in some countries of Europe through a multivariate statistical analysis and machine learning validation, using data from the European Antimicrobial Resistance Surveillance System, the World Health Organization and the World Bank. First, we will use a descriptive analysis and a principal components analysis. Then, we use a k-means clustering to determine the countries and regions that are most affected by the antibiotic resistance. Second, we expand the database by adding some socioeconomic, governance and antibiotic-consumption variables. We then run a data panel regression analysis to determine some functions that relates the multiresistance percentage with those new variables. Finally, we use machine learning techniques to validate a pooling panel data case, using XGBoost and random forest algorithms. The results of the data panel analysis indicate that the most important variables for the multiresistance percentage are corruption control and the rule of law. Similar results are found with the machine learning validation analysis, where the human development index is an additional important variable for the multiresistance percentage.

In this article, we investigate the applicability of quantum machine learning for classification tasks using two quantum classifiers from the Qiskit Python environment: the Variational Quantum Classifier (VQC) and the Quantum Kernel Estimator (QKE). We evaluate the performance of these classifiers on six widely known and publicly available benchmark datasets and analyze how their performance varies with the number of samples on two artificially generated test classification datasets. As quantum machine learning is based on unitary transformations, this paper explores data structures and application fields that could be particularly suitable for quantum advantages. Hereby, we developed a data set based on concepts from quantum mechanics using the exponential map of a Lie algebra. This dataset will be made publicly available and contributes a novel contribution to the empirical evaluation of quantum supremacy. We further compared the performance of VQC and QKE on six widely applicable datasets to contextualize our results.\\ Our results demonstrate that the VQC and QKE perform better than basic machine learning algorithms such as advanced linear regression models (Ridge and Lasso). They do not match the accuracy and runtime performance of sophisticated modern boosting classifiers like XGBoost, LightGBM, or CatBoost. Therefore, we conclude that while quantum machine learning algorithms have the potential to surpass classical machine learning methods in the future, especially when physical quantum infrastructure becomes widely available, they currently lag behind classical approaches. Our investigations also show that classical machine learning approaches have superior performance classifying datasets based on group structures, compared to quantum approaches that particularly use unitary processes.\\ Furthermore, our findings highlight the significant impact of different quantum simulators, feature maps, and quantum circuits on the performance of the employed quantum estimators. This observation emphasizes the need for researchers to provide detailed explanations of their hyperparameter choices for quantum machine learning algorithms, as this aspect is currently overlooked in many studies within the field.\\ To facilitate further research in this area and ensure the transparency of our study, we have made the complete code available in a linked GitHub repository.

This article compares the predictive capabilities of six models namely the Linear Discriminant Analysis (LDA), Logistic Regression (LR), Support Vector Machine (SVM), XGBoost, Random Forest (RF) and Deep Neural Network (DNN) to predict the default behaviour of credit card holders in Taiwan using data from the UCI machine learning database. Python programming language was used for data analysis. Statistical methods were compared with machine learning algorithms using the confusion matrix measured in metric terms of prediction accuracy, sensitivity, specificity, precision, G-mean, F1 score, ROC and AUC. The dataset contains 30,000 credit card user’s information with 6636 default observations and 23,364 non-default cases. The study results found that modern machine learning methods outperformed traditional statistical methods in terms of predictive performance measured by F1 score, G-mean and AUC. Traditional methods like logistic regression were marginally better than linear discriminant analysis and support vector machines in terms of predictive performance measured by area under the receiver operating characteristic curve. In the modern machine learning methods, deep neural networks were better in most of the predictive performance metrics than XGBoost and Random Forest methods.

This paper presents a comparative analysis of several decision models for detecting Structured Query Language (SQL) injection attacks, which remain one of the most prevalent and serious security threats to web applications. SQL injection enables attackers to exploit databases, gaining unauthorized access, and manipulating data. Traditional detection methods often struggle due to the constantly evolving nature of these attacks, the increasing complexity of modern web applications, and the lack of transparency in the decision-making processes of machine learning models. To address these challenges, we evaluated the performance of various models, including Decision Tree, Random Forest, XGBoost, AdaBoost, Gradient Boosting Decision Tree (GBDT), and Histogram Gradient Boosting Decision Tree (HGBDT), using a comprehensive SQL injection dataset. The primary motivation behind our approach is to leverage the strengths of ensemble learning and boosting techniques to enhance detection accuracy and robustness against SQL injection attacks. By systematically comparing these models, we aim to identify the most effective algorithms for SQL injection detection systems. Our experiments show that Decision Tree, Random Forest, and AdaBoost achieved the highest performance, with an accuracy of 99.50% and an F1 score of 99.33%. Additionally, we applied SHapley Additive exPlanations (SHAP) and Local Interpretable Model-agnostic Explanations (LIME) for local explainability, illustrating how each model classifies normal and attack cases. This transparency enhances the trustworthiness of our approach in detecting SQL injection attacks. These findings highlight the potential of ensemble methods to provide reliable and efficient solutions for detecting SQL injection attacks, thereby improving the security of web applications.

In the dynamic landscape of the telecommunications industry, understanding and mitigating customer churn is paramount for maintaining competitive advantage and sustaining revenue streams. This comprehensive literature review delves into the intricacies of customer churn prediction, a crucial aspect in fortifying the bond between telecom businesses and their customers. The review methodically analyzes 11 articles published between 2000 and March 2024, spotlighting the strategic role of Customer Relationship Management and the prevalence of high churn rates that necessitate a shift from customer acquisition to retention strategies. Furthermore, the review navigates through the challenges inherent in churn prediction, including the complexities of managing large, imbalanced, and noisy datasets and the intricacies involved in model selection and optimization. Despite these challenges, the paper highlights the superior capability of machine learning techniques in handling complex datasets to provide accurate predictions, albeit acknowledging their practical complexities. The main aim of the study is to provide an overview, serving as a knowledge base for researchers interested in machine learning techniques within the realm of telecommunications.

Stroke constitutes a significant public health concern due to its impact on mortality and morbidity. This study investigates the utility of machine learning algorithms in predicting stroke and identifying key risk factors using data from the Suita study, comprising 7,389 participants and 53 variables. Initially, unsupervised K-prototype clustering categorized participants into risk clusters, while five supervised models including Logistic Regression (LR), Random Forest (RF), Support Vector Machine (SVM), eXtreme Gradient Boosting (XGBoost), and Light Gradient Boosted Machine (Light-GBM) were employed to predict stroke outcomes. Stroke incidence disparities among identified risk clusters using the unsupervised K-prototype clustering method are substantial, according to the findings. Supervised learning, particularly RF was a preferable option because of the higher levels of performance metrics. The Shapley Additive Explanations (SHAP) method identified age, systolic blood pressure, hypertension, estimated glomerular filtration rate, metabolic syndrome, and blood glucose level as key predictors of stroke, aligning with findings from the unsupervised clustering approach in high-risk groups. Additionally, previously unidentified risk factors such as elbow joint thickness, fructosamine, hemoglobin, and calcium level demonstrate potential for stroke prediction. In conclusion, machine learning facilitated accurate stroke risk predictions and highlighted potential biomarkers, offering a data-driven framework for risk assessment and biomarker discovery.