Abstract
The parameter values of kernel function affect classification results to a certain extent. In the paper, a multiclass classification model based on improved least squares support vector machine (LSSVM) is presented. In the model, the non-sensitive loss function is replaced by quadratic loss function, and the inequality constraints are replaced by equality constraints. Consequently, quadratic programming problem is simplified as the problem of solving linear equation groups, and the SVM algorithm is realized by least squares method. When the LSSVM is used in multiclass classification, it is presented to choose parameter of kernel function on dynamic, which enhances preciseness rate of classification. The Fibonacci symmetry searching algorithm is simplified and improved. The changing rule of kernel function searching region and best shortening step is studied. The best multiclass classification results are obtained by means of synthesizing kernel function searching region and best shortening step. The simulation results show the validity of the model.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Cortes C, Vapnik V (1995) Support-vector network. Mach Learn 20(3):273–297
Vapnik V, Golowich SE, Smola A (1996) Support vector method for function approximation, regression estimation, and signal processing. Adv Neural Inf Process Syst 9:281–287
Chen S, Samingan AK, Hanzo L (2001) Support vector machine multiuser receiver for DS-CDMA signals in multipath channels. IEEE Trans Neural Netw 12(3):604–611
Sebald DJ, Bucklew JA (2000) Support vector machine techniques for nonlinear equalization. IEEE Trans Signal Process 48(11):3217–3226
Melgani F, Bruzzone L (2004) Classification of hyperspectral remote sensing images with support vector machines. IEEE Trans Geosci Remote Sens 42(8):1778–1790
Suykens JAK, Vandewalle J (1999) Least squares support vector machine classifiers. Neural Process Lett 9(3):293–300
Lukas L, Suykens JAK, Vandewalle J (2001) Least squares support vector machines classifiers: a multi two-spiral benchmark problem. In: Proceeding of the Indonesian Student Scientific Meeting. Manchester, United Kingdom, pp 289-292
Suykens JAK, Lukas L, Vandewalle J (2000) Sparse least squares support vector machine classifiers. In: Proceedings of the European Symposium on Artificial Neural Networks. Bruges, Belgium, pp 37–42
Bistarelli S, Codogent P, Hui HKC (2009) Solving finite domain constraint hierarchies by local consistency and tree search. J Exp Theor Artif Intell 21(4):233–257
Chan KY, Kwong CK, Tsim YC (2010) Modeling and optimization of fluid dispensing for electronic packaging using neural fuzzy and genetic algorithms. Eng Appl Artif Intell 23:18–26
Ge M, Du R, Zhang GC (2004) Fault diagnosis using support vector machine with an application in sheet metal stamping operation. Mech Syst Signal Process 18(1):143–159
Hsu CW, Lin CJ (2002) A comparison of methods for multiclass support vector support vector machines. IEEE Trans Neural Netw 13(2):415–425
Lendasse A, Simon G, Wertz V (2004) Fast bootstrap for least-square support vector machines. In: Proceedings of European Symposium on Artificial Neural Networks. Bruges, Belgium, pp 525–530
Engel Y, Mannor S, Meir R (2004) The kernel recursive least-squares algorithm. IEEE Trans Signal Process 52(8):2275–2285
Qian SD (1990) Operational research. Tsinghua University Press, Beijing
Lin C J (2007) LIBSVM Data: Classification (Multi-class), http://www.csie.ntu.edu.tw/~cjlin/libsvmtools/datasets/multiclass.html
Acknowledgments
This work is supported by China Postdoctoral Science Foundation (2005038515) and the Science Foundation of Hebei University of Science and Technology (XL2006081).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Yang, K.H., Zhao, L.L. A new optimizing parameter approach of LSSVM multiclass classification model. Neural Comput & Applic 21, 945–955 (2012). https://doi.org/10.1007/s00521-011-0673-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-011-0673-8