Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
research-article

A modified reverse-based analysis logic mining model with Weighted Random 2 Satisfiability logic in Discrete Hopfield Neural Network and multi-objective training of Modified Niched Genetic Algorithm

Published: 08 August 2024 Publication History

Abstract

Over the years, the study on logic mining approach has increased exponentially. However, most logic mining models disregarded any efforts in expanding the search space which led to poor generalizability property of the retrieved induced logic. In light of this gap, this paper initiated the hybridization of logic mining approach with a multi-objective training algorithm namely Modified Niche Genetic Algorithm. The core impetus of this algorithm is to ensure optimal production of multiple superstrings via Wan Abdullah method resulting in multiple units associative memory feature of the Discrete Hopfield Neural Network. Therefore, the storage capacity of DHNN increases which directed towards larger search space of locating optimal induced logic. Additionally, several modifications were imposed to counter other issues such as, rigid logical rule, outdated quality of best logic, and high dependency on the supervised attributes selection method. Experimentation was done on 20 repository datasets from reputable machine learning repositories. Results showed that the proposed model outperformed all baseline methods in terms of accuracy = 0.8727, precision = 0.9845, specificity = 0.9988, and Matthew’s correlation coefficient = 0.5815.

References

[1]
Alzahrani, A., & Sadaoui, S., Clustering and labeling auction fraud data in: Data management, analytics and innovation. 2020. https://doi.org/10.1007/978-981-32-9949-8_20.
[2]
R. Ananth, Room Occupancy Estimation Dataset, Kaggle Machine learning Repository (2021) https://www.kaggle.com/datasets/ananthr1/room-occupancy-estimation-data-set.
[3]
D. Dua, C. Graff, Automobile Data Set, UCI Machine learning Repository 1 (2019) https://archive.ics.uci.edu/ml/datasets/Audiology+%28Original%29.
[4]
D. Dua, C. Graff, Cardiotocography Data Set, UCI Machine learning Repository 1 (2019) https://archive.ics.uci.edu/ml/datasets/cardiotocography.
[5]
D. Dua, C. Graff, Image Segmentation Data Set, UCI Machine learning Repository 1 (2017) https://archive.ics.uci.edu/ml/datasets/image+segmentation.
[6]
D. Dua, C. Graff, MAGIC Gamma Telescope Data Set, UCI Machine learning Repository 1 (2019) https://archive.ics.uci.edu/ml/datasets/magic+gamma+telescope.
[7]
D. Dua, C. Graff, Ozone Level Detection Data Set, UCI Machine learning Repository 1 (2019) https://archive.ics.uci.edu/ml/datasets/ozone+level+detection.
[8]
D. Dua, C. Graff, Solar Flare Data Set, UCI Machine learning Repository 1 (2019) http://archive.ics.uci.edu/ml/datasets/solar+flare.
[9]
Fedesoriano, Stroke Prediction Dataset, Kaggle Machine learning Repository, 2020. https://www.kaggle.com/datasets/fedesoriano/stroke-prediction-dataset.
[10]
T.H. Hsieh, J.J.J. Chen, L.H. Chen, P.T. Chiang, H.Y. Lee, Time-course gait analysis of hemiparkinsonian rats following 6-hydroxydopamine lesion, Behav. Brain Res. (2011) https://doi.org/10.1016/j.bbr.2011.03.031.
[11]
Itssuru, Loan Dataset, Kaggle Machine learning Repository, 2020. https://www.kaggle.com/datasets/itssuru/loan-data.
[12]
A. Martiniano, R.P. Ferreira, R.J. Sassi, C. Affonso, Application of a neuro fuzzy network in prediction of absenteeism at work, in: 7th Iberian Conference on Information Systems and Technologies, CISTI 2012, June 20-June 23, Proceedings, IEEE, 2012, pp. 1–4.
[13]
S. Moro, P. Cortez, P. Rita, A data-driven approach to predict the success of bank telemarketing, Decis. Support Syst. (2014) https://doi.org/10.1016/j.dss.2014.03.001.
[14]
S. Moro, P. Rita, B. Vala, Predicting social media performance metrics and evaluation of the impact on brand building: A data mining approach, J. Bus Res. (2016) https://doi.org/10.1016/j.jbusres.2016.02.010.
[15]
Pavansubhash, IBM HR Analytics Employee Attrition & Performance Dataset, Kaggle Machine learning Repository, 2016. https://www.kaggle.com/datasets/pavansubhasht/ibm-hr-analytics-attrition-dataset.
[16]
S. Renjith, A. Sreekumar, M. Jathavedan, Evaluation of partitioning clustering algorithms for processing social media data in tourism domain, in: 2018 IEEE Recent Advances in Intelligent Computational Systems, RAICS 2018, December 6-December 8, Proceedings, IEEE, 2018, pp. 127–131.
[17]
Sakar, C. O., Polat, S. O., Katircioglu, M., & Kastro, Y., Real-time prediction of online shoppers’ purchasing intention using multilayer perceptron and LSTM recurrent neural networks, Neural. Comput. Appl. 2019. https://link.springer.com/article/10.1007/s00521-018-3523-0.
[18]
I.C. Yeh, C.H. Lien, The comparisons of data mining techniques for the predictive accuracy of probability of default of credit card clients, Expert Syst. Appl (2009) https://doi.org/10.1016/j.eswa.2007.12.020.
[19]
W.A.T.W. Abdullah, Logic programming on a neural network, International Journal of Intelligent Systems 7 (6) (1992) 513–519,.
[20]
A. Alway, N.E. Zamri, M.S. Mohd Kasihmuddin, A. Mansor, S. Sathasivam, Palm Oil Trend Analysis via Logic Mining with Discrete Hopfield Neural Network, Pertanika Journal of Science & Technology 28 (3) (2020) 967–981.
[21]
A.M. Ayalew, A.O. Salau, B.T. Abeje, B. Enyew, Detection and classification of COVID-19 disease from X-ray images using convolutional neural networks and histogram of oriented gradients, Biomedical Signal Processing and Control 74 (2022),.
[22]
Q. Bao, M. Wang, G. Dai, X. Chen, Z. Song, S. Li, An archive-based two-stage evolutionary algorithm for constrained multi-objective optimization problems, Swarm and Evolutionary Computation 75 (2022),.
[23]
M.M. Bazuhair, S.Z.M. Jamaludin, N.E. Zamri, M.S.M. Kasihmuddin, M.A. Mansor, A. Alway, S.A. Karim, Novel Hopfield neural network model with election algorithm for random 3 satisfiability, Processes 9 (8) (2021) 1292,.
[24]
J. Chen, M.S.M. Kasihmuddin, Y. Gao, Y. Guo, M.A. Mansor, N.A. Romli, …., C. Zheng, PRO2SAT: Systematic Probabilistic Satisfiability logic in Discrete Hopfield Neural Network, Advances in Engineering Software 175 (2023),.
[25]
D. Chicco, G. Jurman, The advantages of the Matthews correlation coefficient (MCC) over F1 score and accuracy in binary classification evaluation, BMC genomics 21 (1) (2020) 1–13. https://bmcgenomics.biomedcentral.com/articles/10.1186/s12864-019-6413-7.
[26]
S. Das, M.S. Imtiaz, N.H. Neom, N. Siddique, H. Wang, A hybrid approach for Bangla sign language recognition using deep transfer learning model with random forest classifier, Expert Systems with Applications 213 (2023),.
[27]
R.R. de Souza, M. Toebe, A.C. Mello, K.C. Bittencourt, Sample size and Shapiro-Wilk test: An analysis for soybean grain yield, European Journal of Agronomy 142 (2023),.
[28]
Domingues, I., Amorim, J. P., Abreu, P. H., Duarte, H., & Santos, J. (2018, July). Evaluation of oversampling data balancing techniques in the context of ordinal classification. In  2018 International Joint Conference on Neural Networks (IJCNN)  (pp. 1-8). IEEE.
[29]
J. Dou, Y. Song, G. Wei, Y. Zhang, Fuzzy information decomposition incorporated and weighted Relief-F feature selection: When imbalanced data meet incompletion, Information Sciences 584 (2022) 417–432,.
[30]
H. Emami, F. Derakhshan, Election algorithm: A new socio-politically inspired strategy, AI Communications 28 (3) (2015) 591–603,.
[31]
V. Folli, M. Leonetti, G. Ruocco, On the maximum storage capacity of the Hopfield model, Frontiers in computational neuroscience 10 (2017) 144,.
[32]
S.O. Folorunso, J.B. Awotunde, N.O. Adeboye, O.E. Matiluko, Data classification model for COVID-19 pandemic, in: Advances in Data Science and Intelligent Data Communication Technologies for COVID-19: Innovative Solutions Against COVID-19, Springer International Publishing, Cham, 2021, pp. 93–118.
[33]
Y. Gao, Y. Guo, N.A. Romli, M.S.M. Kasihmuddin, W. Chen, M.A. Mansor, J. Chen, GRAN3SAT: Creating flexible higher-order logic satisfiability in the discrete hopfield neural network, Mathematics 10 (11) (2022) 1899,.
[34]
M. Göçken, M. Özçalıcı, A. Boru, A.T. Dosdoğru, Integrating metaheuristics and artificial neural networks for improved stock price prediction, Expert Systems with Applications 44 (2016) 320–331,.
[35]
J. Gottlieb, E. Marchiori, C. Rossi, Evolutionary algorithms for the satisfiability problem, Evolutionary computation 10 (1) (2002) 35–50,.
[36]
Y. Guo, M.S.M. Kasihmuddin, Y. Gao, M.A. Mansor, H.A. Wahab, N.E. Zamri, J. Chen, YRAN2SAT: A novel flexible random satisfiability logical rule in discrete hopfield neural network, Advances in Engineering Software 171 (2022),.
[37]
M.M. Haque, H.C. Chin, A.K. Debnath, An investigation on multi-vehicle motorcycle crashes using log-linear models, Safety science 50 (2) (2012) 352–362,.
[38]
Y. Hu, J. Wang, J. Liang, Y. Wang, U. Ashraf, C. Yue, K. Yu, A two-archive model based evolutionary algorithm for multimodal multi-objective optimization problems, Applied Soft Computing 119 (2022),.
[39]
I. Hussain, M. Ullah, I. Ullah, A. Bibi, M. Naeem, M. Singh, D. Singh, Optimizing energy consumption in the home energy management system via a bio-inspired dragonfly algorithm and the genetic algorithm, Electronics 9 (3) (2020) 406,.
[40]
C. Iwendi, K. Mahboob, Z. Khalid, A.R. Javed, M. Rizwan, U. Ghosh, Classification of COVID-19 individuals using adaptive neuro-fuzzy inference system, Multimedia Systems (2021) 1–15,.
[41]
S.Z.M. Jamaludin, M.S.M. Kasihmuddin, A.I.M. Ismail, M.A. Mansor, M.F.M. Basir, Energy based logic mining analysis with hopfield neural network for recruitment evaluation, Entropy 23 (1) (2020) 40,.
[42]
S.Z.M. Jamaludin, M.A. Mansor, A. Baharum, M.S.M. Kasihmuddin, H.A. Wahab, M.F. Marsani, Modified 2 satisfiability reverse analysis method via logical permutation operator, Comput. Mater. Contin 74 (2023) 2853–2870,.
[43]
S.Z.M. Jamaludin, N.A. Romli, M.S.M. Kasihmuddin, A. Baharum, M.A. Mansor, M.F. Marsani, Novel logic mining incorporating log linear approach, Journal of King Saud University-Computer and Information Sciences 34 (10) (2022) 9011–9027,.
[44]
J.L. Johnson, A neural network approach to the 3-satisfiability problem, Journal of Parallel and Distributed Computing 6 (2) (1989) 435–449,.
[45]
Kaggle website https://www.kaggle.com/datasets (accessed 25 June 2022).
[46]
S.A. Karim, M.S.M. Kasihmuddin, S. Sathasivam, M.A. Mansor, S.Z.M. Jamaludin, M.R. Amin, A novel multi-objective hybrid election algorithm for higher-order random satisfiability in discrete hopfield neural network, Mathematics 10 (12) (2022) 1963,.
[47]
S.A. Karim, N.E. Zamri, A. Alway, M.S.M. Kasihmuddin, A.I.M. Ismail, M.A. Mansor, N.F.A. Hassan, Random satisfiability: A higher-order logical approach in discrete Hopfield Neural Network, IEEE Access 9 (2021) 50831–50845,.
[48]
H. Karimi, S. Jadid, Optimal energy management for multi-microgrid considering demand response programs: A stochastic multi-objective framework, Energy 195 (2020),.
[49]
M.S.M. Kasihmuddin, S.Z.M. Jamaludin, M.A. Mansor, H.A. Wahab, S.M.S. Ghadzi, Supervised Learning Perspective in Logic Mining, Mathematics 10 (6) (2022) 915,.
[50]
M.S.M. Kasihmuddin, M.A. Mansor, S. Sathasivam, Hybrid Genetic Algorithm in the Hopfield Network for Logic Satisfiability Problem, Pertanika Journal of Science & Technology 25 (1) (2017) 139–152.
[51]
M.S.M. Kasihmuddin, M.A. Mansor, M.F. Md Basir, S. Sathasivam, Discrete mutation Hopfield neural network in propositional satisfiability, Mathematics 7 (11) (2019) 1133,.
[52]
L.C. Kho, M.S.M. Kasihmuddin, M.A. Mansor, S. Sathasivam, Logic Mining in League of Legends, Pertanika Journal of Science & Technology 28 (1) (2020) 211–225.
[53]
H. Kim, C. Wang, H. Byun, W. Hu, S. Kim, Q. Jiao, T.H. Lee, Variable three-term conjugate gradient method for training artificial neural networks, Neural Networks 159 (2023) 125–136,.
[54]
M.F. Leung, J. Wang, Cardinality-constrained portfolio selection based on collaborative neurodynamic optimization, Neural Networks 145 (2022) 68–79,.
[55]
X. Li, Z. Wu, Z. Zhao, F. Ding, D. He, A mixed data clustering algorithm with noise-filtered distribution centroid and iterative weight adjustment strategy, Information Sciences 577 (2021) 697–721,.
[56]
W.C. Lin, C.F. Tsai, J.R. Zhong, Deep learning for missing value imputation of continuous data and the effect of data discretization, Knowledge-Based Systems 239 (2022),.
[57]
Y. Ma, J. Liu, L. Zhu, Q. Li, Y. Guo, H. Liu, D. Yu, Multi-objective performance optimization and control for gas turbine Part-load operation Energy-saving and NOx emission reduction, Applied Energy 320 (2022),.
[58]
T.R. Mahesh, V. Vinoth Kumar, V. Vivek, K.M. Karthick Raghunath, G. Sindhu Madhuri, Early predictive model for breast cancer classification using blended ensemble learning, International Journal of System Assurance Engineering and Management 1–10 (2022),.
[59]
S.S. Muhammad Sidik, N.E. Zamri, M.S. Mohd Kasihmuddin, H.A. Wahab, Y. Guo, M.A. Mansor, Non-systematic weighted satisfiability in discrete hopfield neural network using binary artificial bee colony optimization, Mathematics 10 (7) (2022) 1129,.
[60]
N. Nasir, A. Kansal, O. Alshaltone, F. Barneih, M. Sameer, A. Shanableh, A. Al-Shamma'a, Water quality classification using machine learning algorithms, Journal of Water Process Engineering 48 (2022),.
[61]
M. Noureddin, E. Truong, J.A. Gornbein, R. Saouaf, M. Guindi, T. Todo, …., N. Alkhouri, MRI-based (MAST) score accurately identifies patients with NASH and significant fibrosis, Journal of hepatology 76 (4) (2022) 781–787,.
[62]
P. Ong, Z. Zainuddin, Optimizing wavelet neural networks using modified cuckoo search for multi-step ahead chaotic time series prediction, Applied Soft Computing 80 (2019) 374–386,.
[63]
Y. Qiao, Y. Guo, K. Yu, D. He, C3D-ConvLSTM based cow behaviour classification using video data for precision livestock farming, Computers and Electronics in Agriculture 193 (2022),.
[64]
K. Roster, C. Connaughton, F.A. Rodrigues, Machine-Learning–Based Forecasting of Dengue Fever in Brazilian Cities Using Epidemiologic and Meteorological Variables, American Journal of Epidemiology 191 (10) (2022) 1803–1812,.
[65]
N.A. Rusdi, M.S.M. Kasihmuddin, N.A. Romli, G. Manoharam, M.A. Mansor, Multi-unit Discrete Hopfield Neural Network for higher order supervised learning through logic mining: Optimal performance design and attribute selection, Journal of King Saud University-Computer and Information Sciences 35 (5) (2023),.
[66]
S. Sathasivam, W.A.T.W. Abdullah, Logic mining in neural network: Reverse analysis method, Computing 91 (2011) 119–133,.
[67]
S. Sathasivam, M.A. Mansor, A.I.M. Ismail, S.Z.M. Jamaludin, M.S.M. Kasihmuddin, M. Mamat, Novel random k satisfiability for k≤ 2 in hopfield neural network, Sains Malays 49 (11) (2020) 2847–2857. https://doi.org/10.17576/jsm-2020-4911-23.
[68]
S. Sathasivam, M.A. Mansor, M.S.M. Kasihmuddin, H. Abubakar, Election algorithm for random k satisfiability in the Hopfield neural network, Processes 8 (5) (2020) 568,.
[69]
S. Sen, A.V. Deokar, Toward understanding variations in price and billing in US healthcare services: A predictive analytics approach, Expert Systems with Applications 209 (2022),.
[70]
S.S. Shapiro, M.B. Wilk, An analysis of variance test for normality (complete samples), Biometrika 52 (3/4) (1965) 591–611.
[71]
P. Shi, Y. Yu, H. Gao, C. Hua, A novel multi-source sensing data fusion driven method for detecting rolling mill health states under imbalanced and limited datasets, Mechanical Systems and Signal Processing 171 (2022),.
[72]
T. Sonnekalb, T.S. Heinze, P. Mäder, Deep security analysis of program code: A systematic literature review, Empirical Software Engineering 27 (1) (2022) 2. https://link.springer.com/article/10.1007%2Fs10664-021-10029-x.
[73]
J.E. Steck, S.N. Balakrishnan, Use of Hopfield neural networks in optimal guidance, IEEE transactions on aerospace and electronic systems 30 (1) (1994) 287–293,.
[74]
M.S. Umam, M. Mustafid, S. Suryono, A hybrid genetic algorithm and tabu search for minimizing makespan in flow shop scheduling problem, Journal of King Saud University-Computer and Information Sciences 34 (9) (2022) 7459–7467,.
[75]
V.S. Verykios, A.K. Elmagarmid, E. Bertino, Y. Saygin, E. Dasseni, Association rule hiding, IEEE Transactions on Knowledge and Data Engineering 16 (4) (2004) 434–447,.
[76]
A.X. Wang, S.S. Chukova, B.P. Nguyen, Ensemble k-nearest neighbors based on centroid displacement, Information Sciences 629 (2023) 313–323,.
[77]
Z. Wu, N. Cui, L. Zhao, L. Han, X. Hu, H. Cai, …., Q. Liu, Estimation of maize evapotranspiration in semi-humid regions of northern China using Penman-Monteith model and segmentally optimized Jarvis model, Journal of Hydrology 607 (2022),.
[78]
G.M.T. Xavier, F.G. Castañeda, L.M.F. Nava, J.A.M. Cadenas, Memristive recurrent neural network, Neurocomputing 273 (2018) 281–295,.
[79]
K. Xie, K. Liu, H.A. Alvi, W. Ji, S. Wang, L. Chang, X. Yuan, IhybCNV: An intra-hybrid approach for CNV detection from next-generation sequencing data, Digital Signal Processing 121 (2022),.
[80]
Q. Yu, S.J. Jiang, R.C. Wang, H.Y. Wang, A feature selection approach based on a similarity measure for software defect prediction, Frontiers of Information Technology & Electronic Engineering 18 (11) (2017) 1744–1753,.
[81]
N.E. Zamri, S.A. Azhar, M.A. Mansor, A. Alway, M.S.M. Kasihmuddin, Weighted random k satisfiability for k= 1, 2 (r2SAT) in discrete Hopfield neural network, Applied Soft Computing 126 (2022),.
[82]
N.E. Zamri, S.A. Azhar, S.S.M. Sidik, M.A. Mansor, M.S.M. Kasihmuddin, S.P.A. Pakruddin, …., S.N.M. Nawi, Multi-discrete genetic algorithm in hopfield neural network with weighted random k satisfiability, Neural Computing and Applications 34 (21) (2022) 19283–19311,.
[83]
N.E. Zamri, M.A. Mansor, M.S.M. Kasihmuddin, A. Alway, S.Z.M. Jamaludin, S.A. Alzaeemi, Amazon employees resources access data extraction via clonal selection algorithm and logic mining approach, Entropy 22 (6) (2020) 596,.
[84]
W. Zhou, H. Jiang, Y. Cheng, L. Pei, S. Ding, Predicting seasonal patterns of energy production: A grey seasonal trend least squares support vector machine, Expert Systems with Applications 213 (2023),.

Recommendations

Comments

Information & Contributors

Information

Published In

cover image Expert Systems with Applications: An International Journal
Expert Systems with Applications: An International Journal  Volume 240, Issue C
Apr 2024
1601 pages

Publisher

Pergamon Press, Inc.

United States

Publication History

Published: 08 August 2024

Author Tags

  1. Logic mining
  2. Weighted Satisfiability
  3. Modified Niched Genetic Algorithm
  4. Discrete Hopfield Neural Network
  5. Modified reverse-based analysis

Qualifiers

  • Research-article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • 0
    Total Citations
  • 0
    Total Downloads
  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 14 Oct 2024

Other Metrics

Citations

View Options

View options

Get Access

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media