Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Skip to main content
Springer Nature Link
Log in

Evolutionary competitive swarm exploring optimal support vector machines and feature weighting

  • Methodologies and Application
  • Published:
Soft Computing Aims and scope Submit manuscript

A Correction to this article was published on 05 February 2021

This article has been updated

Abstract

To deal with classification problems, support vector machines (SVMs) are utilized in a wide variety of applications as effective and powerful supervised learning paradigm. However, the efficacy and outcomes of an SVM-based classification model is influenced by the proper selection of SVM parameters in addition to the nature of the datasets. Therefore, the purpose of this work is to enrich the efficacy of the SVMs based on simultaneous optimization of the parameters and feature weighting of these models. In this paper, an improved evolutionary variant of competitive swarm optimizer (CSO) is proposed to evolve the parameters of SVMs and optimize the weights of features. Simulations and experiments are performed based on various datasets from UCI repository to investigate the effectiveness of the proposed hybrid CSO-based SVM model versus genetic algorithm, particle swarm optimizer and the classical grid-based search. Results and analysis reveal that the proposed crossover-based mechanism inside CSO has improved the classification capabilities of the hybrid CSO-SVM technique.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
$34.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

Change history

References

  • Abdel-Basset M, El-Shahat D, El-henawy I, de Albuquerque VHC, Mirjalili S (2020) A new fusion of grey wolf optimizer algorithm with a two-phase mutation for feature selection. Expert Syst Appl 139:112824

    Article  Google Scholar 

  • Al-Zoubi A, Alqatawna J, Faris H, Hassonah MA (2019) Spam profiles detection on social networks using computational intelligence methods: the effect of the lingual context. J Inf Sci. https://doi.org/10.1177/0165551519861599

  • Ala’M AZ, Faris H, Alqatawna J, Hassonah MA (2018) Evolving support vector machines using whale optimization algorithm for spam profiles detection on online social networks in different lingual contexts. Knowl Based Syst 153:91–104

    Article  Google Scholar 

  • Ala’M AZ, Heidari AA, Habib M, Faris H, Aljarah I, Hassonah MA (2020) Salp chain-based optimization of support vector machines and feature weighting for medical diagnostic information systems. In: Mirjalili S, Faris H, Aljarah I (eds) Evolutionary machine learning techniques. Springer, Berlin, pp 11–34

    Google Scholar 

  • Aljarah I, Ala’M AZ, Faris H, Hassonah MA, Mirjalili S, Saadeh H (2018) Simultaneous feature selection and support vector machine optimization using the grasshopper optimization algorithm. Cognit Comput 10(3):478–495

    Article  Google Scholar 

  • Bao Y, Hu Z, Xiong T (2013) A pso and pattern search based memetic algorithm for svms parameters optimization. Neurocomputing 117:98–106

    Article  Google Scholar 

  • Boardman M, Trappenberg T (2006) A heuristic for free parameter optimization with support vector machines. In: International joint conference on neural networks, 2006. IJCNN’06. IEEE, pp 610–617

  • Bouraoui A, Jamoussi S, BenAyed Y (2018) A multi-objective genetic algorithm for simultaneous model and feature selection for support vector machines. Artif Intell Rev 50(2):261–281

    Article  Google Scholar 

  • Chen WN, Zhang J, Lin Y, Chen N, Zhan ZH, Chung HSH, Li Y, Shi YH (2013) Particle swarm optimization with an aging leader and challengers. IEEE Trans Evol Comput 17(2):241–258

    Article  Google Scholar 

  • Cheng R, Jin Y (2015) A competitive swarm optimizer for large scale optimization. IEEE Trans Cybern 45(2):191–204

    Article  Google Scholar 

  • Dadaneh BZ, Markid HY, Zakerolhosseini A (2016) Unsupervised probabilistic feature selection using ant colony optimization. Expert Syst Appl 53:27–42

    Article  Google Scholar 

  • Eshtay M, Faris H, Obeid N (2018) Improving extreme learning machine by competitive swarm optimization and its application for medical diagnosis problems. Expert Syst Appl 104:134–152

    Article  Google Scholar 

  • Faris H, Hassonah MA, Ala’M AZ, Mirjalili S, Aljarah I (2018) A multi-verse optimizer approach for feature selection and optimizing svm parameters based on a robust system architecture. Neural Comput Appl 30(8):2355–2369

    Article  Google Scholar 

  • Friedrichs F, Igel C (2005) Evolutionary tuning of multiple svm parameters. Neurocomputing 64:107–117

    Article  Google Scholar 

  • Guo X, Yang J, Wu C, Wang C, Liang Y (2008) A novel ls-svms hyper-parameter selection based on particle swarm optimization. Neurocomputing 71(16–18):3211–3215

    Article  Google Scholar 

  • Hsu CW, Lin CJ (2002) A simple decomposition method for support vector machines. Mach Learn 46(1):291–314

    Article  MathSciNet  Google Scholar 

  • Hsu CW, Chang CC, Lin CJ (2003) A practical guide to support vector classification. Technical report, Department of Computer Science and Information Engineering, University of National Taiwan, Taipei, pp 1–12

  • Huang CL (2009) Aco-based hybrid classification system with feature subset selection and model parameters optimization. Neurocomputing 73(1–3):438–448

    Article  Google Scholar 

  • Huang CL, Dun JF (2008) A distributed pso-svm hybrid system with feature selection and parameter optimization. Appl Soft Comput 8(4):1381–1391

    Article  Google Scholar 

  • Huang CL, Wang CJ (2006) A ga-based feature selection and parameters optimization for support vector machines. Expert Syst Appl 31(2):231–240

    Article  Google Scholar 

  • LaValle SM, Branicky MS, Lindemann SR (2004) On the relationship between classical grid search and probabilistic roadmaps. Int J Robot Res 23(7–8):673–692

    Article  Google Scholar 

  • Li C, An X, Li R (2015) A chaos embedded gsa-svm hybrid system for classification. Neural Comput Appl 26(3):713–721

    Article  Google Scholar 

  • Lichman M (2013) UCI machine learning repository. http://archive.ics.uci.edu/ml

  • Lin SW, Ying KC, Chen SC, Lee ZJ (2008) Particle swarm optimization for parameter determination and feature selection of support vector machines. Expert Syst Appl 35(4):1817–1824

    Article  Google Scholar 

  • Liu Y, Wang G, Chen H, Dong H, Zhu X, Wang S (2011) An improved particle swarm optimization for feature selection. J Bionic Eng 8(2):191–200

    Article  Google Scholar 

  • Lorena AC, De Carvalho AC (2008) Evolutionary tuning of svm parameter values in multiclass problems. Neurocomputing 71(16–18):3326–3334

    Article  Google Scholar 

  • Moradi P, Rostami M (2015) Integration of graph clustering with ant colony optimization for feature selection. Knowl Based Syst 84:144–161

    Article  Google Scholar 

  • Phan AV, Le Nguyen M, Bui LT (2017) Feature weighting and svm parameters optimization based on genetic algorithms for classification problems. Appl Intell 46(2):455–469

    Article  Google Scholar 

  • Reif M, Shafait F, Dengel A (2012) Meta-learning for evolutionary parameter optimization of classifiers. Mach Learn 87(3):357–380

    Article  MathSciNet  Google Scholar 

  • Sadiq AS, Faris H, Ala’M AZ, Mirjalili S, Ghafoor KZ (2019) Fraud detection model based on multi-verse features extraction approach for smart city applications. In: Rawat DB, Ghafoor KZ (eds) Smart cities cybersecurity and privacy. Elsevier, Berlin, pp 241–251

    Chapter  Google Scholar 

  • Shen L, Chen H, Yu Z, Kang W, Zhang B, Li H, Yang B, Liu D (2016) Evolving support vector machines using fruit fly optimization for medical data classification. Knowl Based Syst 96:61–75. https://doi.org/10.1016/j.knosys.2016.01.002

  • Shin KS, Lee TS, Hj K (2005) An application of support vector machines in bankruptcy prediction model. Expert Syst Appl 28(1):127–135

    Article  Google Scholar 

  • Sun G, Rong X, Zhang A, Huang H, Rong J, Zhang X (2019) Multi-scale mahalanobis kernel-based support vector machine for classification of high-resolution remote sensing images. Cognit Comput. https://doi.org/10.1007/s12559-019-09631-5

  • Tahir MA, Bouridane A, Kurugollu F (2007) Simultaneous feature selection and feature weighting using hybrid tabu search/k-nearest neighbor classifier. Pattern Recogn Lett 28(4):438–446

    Article  Google Scholar 

  • Tanveer M (2015) Robust and sparse linear programming twin support vector machines. Cognit Comput 7(1):137–149

    Article  Google Scholar 

  • Tharwat A, Hassanien AE (2018) Chaotic antlion algorithm for parameter optimization of support vector machine. Appl Intell 48(3):670–686

    Article  Google Scholar 

  • Tharwat A, Hassanien AE (2019) Optimizing support vector machine parameters using bat optimization algorithm. In: Hassanien AE (ed) Machine learning paradigms: theory and application. Springer, Berlin, pp 351–374

    Chapter  Google Scholar 

  • Tu CJ, Chuang LY, Chang JY, Yang CH et al (2007) Feature selection using pso-svm. Int J Comput Sci 33(1):1–3

  • Vapnik VN (1999) An overview of statistical learning theory. IEEE Trans Neural Networks 10(5):988–999

    Article  Google Scholar 

  • Wang M, Chen H (2020) Chaotic multiswarm whale optimizer boosted support vector machine for medical diagnosis. Appl Soft Comput 88:105946. https://doi.org/10.1016/j.asoc.2019.105946

  • Wu Q, Wu S, Liu J (2010) Hybrid model based on svm with gaussian loss function and adaptive Gaussian pso. Eng Appl Artif Intell 23(4):487–494

    Article  Google Scholar 

  • Xiaofang Y, Yaonan W (2008) Parameter selection of support vector machine for function approximation based on chaos optimization. J Syst Eng Electron 19(1):191–197

    Article  Google Scholar 

  • Xu Y, Guo R, Wang L (2013) A twin multi-class classification support vector machine. Cognit Comput 5(4):580–588

    Article  Google Scholar 

  • Yang Y, Pedersen JO (1997) A comparative study on feature selection in text categorization. Icml 97:412–420

    Google Scholar 

  • Yuan SF, Chu FL (2007) Fault diagnostics based on particle swarm optimisation and support vector machines. Mech Syst Signal Process 21(4):1787–1798

    Article  Google Scholar 

  • Zhang X, Chen X, He Z (2010) An aco-based algorithm for parameter optimization of support vector machines. Expert Syst Appl 37(9):6618–6628

    Article  Google Scholar 

  • Zhang X, Fan M, Wang D, Zhou P, Tao D (2020) Top-k feature selection framework using robust 0-1 integer programming. IEEE Trans Neural Networks Learn Syst. https://doi.org/10.1109/TNNLS.2020.3009209

  • Zhao M, Fu C, Ji L, Tang K, Zhou M (2011) Feature selection and parameter optimization for support vector machines: A new approach based on genetic algorithm with feature chromosomes. Expert Syst Appl 38(5):5197–5204

    Article  Google Scholar 

  • Zhao X, Li D, Yang B, Ma C, Zhu Y, Chen H (2014) Feature selection based on improved ant colony optimization for online detection of foreign fiber in cotton. Appl Soft Comput 24:585–596

Download references

Author information

Authors and Affiliations

  1. School of Science, Technology and Engineering, University of Granada, Granada, Spain

    Ala’ M. Al-Zoubi

  2. King Abdullah II School for Information Technology, The University of Jordan, Amman, Jordan

    Ala’ M. Al-Zoubi, Mohammad A. Hassonah, Hossam Faris & Ibrahim Aljarah

  3. School of Surveying and Geospatial Engineering, College of Engineering, University of Tehran, Tehran, Iran

    Ali Asghar Heidari

  4. Department of Computer Science, School of Computing, National University of Singapore, Singapore, Singapore

    Ali Asghar Heidari

  5. Department of Computer Science, Birzeit University, PO Box 14, West Bank, Palestine

    Majdi Mafarja

Authors
  1. Ala’ M. Al-Zoubi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mohammad A. Hassonah
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Ali Asghar Heidari
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Hossam Faris
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Majdi Mafarja
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Ibrahim Aljarah
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ala’ M. Al-Zoubi.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Communicated by V. Loia.

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

The original article has been updated: Due to affiliation update.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Al-Zoubi, A.M., Hassonah, M.A., Heidari, A.A. et al. Evolutionary competitive swarm exploring optimal support vector machines and feature weighting. Soft Comput 25, 3335–3352 (2021). https://doi.org/10.1007/s00500-020-05439-w

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00500-020-05439-w

Keywords

Search

Navigation