Abstract
Due to the significant efficiency and simple implementation, extreme learning machine (ELM) algorithms enjoy much attention in regression and classification applications recently. Many efforts have been paid to enhance the performance of ELM from both methodology (ELM training strategies) and structure (incremental or pruned ELMs) perspectives. In this paper, a local coupled extreme learning machine (LC-ELM) algorithm is presented. By assigning an address to each hidden node in the input space, LC-ELM introduces a decoupler framework to ELM in order to reduce the complexity of the weight searching space. The activated degree of a hidden node is measured by the membership degree of the similarity between the associated address and the given input. Experimental results confirm that the proposed approach works effectively and generally outperforms the original ELM in both regression and classification applications.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.References
Huang G-B, Zhu Q-Y, Siew C-K (2006) Extreme learning machine: theory and applications. Neurocomputing 70:489–501
Huang G-B, Wang D, Lan Y (2011) Extreme learning machines: a survey. Int J Mach Learn Cybern 2:107–122
Yang Y, Wang Y, Yuan X (2012) Bidirectional extreme learning machine for regression problem and its learning effectiveness. IEEE Trans Neural Netw Learn Syst 23:1498–1505
Qu Y, Shang C, Wu W, Shen Q (2011) Evolutionary fuzzy extreme learning machine for mammographic risk analysis. Int J Fuzzy Syst 13:282–291
Liang N-Y, Huang G-B, Saratchandran P, Sundararajan N (2006) A fast and accurate online sequential learning algorithm for feedforward networks. IEEE Trans Neural Netw 17:1411–1423
Zhu Q-Y, Qin AK, Suganthan PN, Huang G-B (2005) Evolutionary extreme learning machine. Pattern Recognit 38:1759–1763
Tang X, Han M (2009) Partial lanczos extreme learning machine for single-output regression problems. Neurocomputing 72:3066–3076
Huang G-B, Chen L, Siew C-K (2006) Universal approximation using incremental constructive feedforward networks with random hidden nodes. IEEE Trans Neural Netw 17:879–892
Rong H-J, Ong Y-S, Tan A-H, Zhu Z (2008) A fast pruned-extreme learning machine for classification problem. Neurocomputing 72:359–366
Miche Y, Sorjamaa A, Bas P, Simula O, Jutten C, Lendasse A (2010) OP-ELM: pptimally pruned extreme learning machine. IEEE Trans Neural Netw 21:158–162
Lan Y, Soh YC, Huang G-B (2010) Two-stage extreme learning machine for regression. Neurocomputing 73:3028–3038
Sun J (2010) Local coupled feedforward neural network. Neural Netw 23:108–113
de Jesús Rubio J, Angelov P, Pacheco J (2011) Uniformly stable backpropagation algorithm to train a feedforward neural network. IEEE Trans Neural Netw 22:356–366
Golmohammadi D, Creese R, Valian H, Kolassa J (2009) Supplier selection based on a neural network model using genetic algorithm. IEEE Trans Neural Netw 20:1504–1519
Sun J (2012) Learning algorithm and hidden node selection scheme for local coupled feedforward neural network classifier. Neurocomputing 79:158–163
Qu Y, Shang C, Yang J, Wu W, Shen Q (2013) Modified gradient-based learning for local coupled feedforward neural networks with gaussian basis function. Neural Comput Appl 22:379–394
Radzikowska A, Kerre E (2002) A comparative study of fuzzy rough sets. Fuzzy Sets Syst 126:137–155
Shawe-Taylor J, Christianini N (2004) Kernel method for pattern analysis. Cambridge University Press, Cambridge
Huang G-B, Zhu Q-Y, Siew C-K (2004) Extreme learning machine: a new learning scheme of feedforward neural networks. In: Proceedings of the international joint conference on neural networks (IJCNN2004), vol 2, Budapest, Hungary, pp 985–990
Rao CR, Mitra SK (1971) Generalized inverse of matrices and its applications. Wiley, New York
Serre D (2002) Matrices: theory and applications. Springer, Berlin
Das M, Chakraborty M, Ghoshal T (1998) Fuzzy tolerance relation, fuzzy tolerance space and basis. Fuzzy Sets Syst 97:361–369
Genton M (2001) Classes of kernels for machine learning: a statistics perspective. J Mach Learn Res 2:299–312
Jensen R, Shen Q (2009) New approaches to fuzzy-rough feature selection. IEEE Trans Fuzzy Syst 17:824–838
Chen L, Chen CLP, Pedrycz W (2010) A gradient-descent-based approach for transparent linguistic interface generation in fuzzy models. IEEE Trans Syst Man Cybern Part B Cybern 40:1219–1230
Blake C, Merz C (1998) UCI repository of machine learning databases. University of California, Irvine
Mike M (1989) Statistical datasets. Carnegie Mellon University, Pittsburg
Qu Y, Shang C, Shen Q, Mac Parthálain N, Wu W (2011) Kernel-based fuzzy-rough nearest neighbour classification. In: IEEE international conference on fuzzy systems (FUZZ), pp 1523–1529
Shang C, Barnes D, Shen Q (2011) Facilitating efficient mars terrain image classification with fuzzy-rough feature selection. Int J Hybrid Intell Syst 8:3–13
Acknowledgments
This work is jointly supported by the National Natural Science Foundation of China (61272171), the Fundamental Research Funds for the Central Universities (No. 3132013335) and the China Postdoctoral Science Foundation (2013M541213).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Qu, Y. Local coupled extreme learning machine. Neural Comput & Applic 27, 27–33 (2016). https://doi.org/10.1007/s00521-013-1542-4
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00521-013-1542-4