Abstract
In this paper a new evaluation method for expert combination is presented. It takes into account the correlation among experts, their number and their recognition rate. An extended investigation on Majority Vote, Bayesian, Behaviour Knowledge Space and Dempster-Shafer method for abstract-level classifiers is presented. The two-way analysis of variance test and the Scheffè post-hoc comparison have been used to investigate on the factors that influence the recognition rate of the multi-expert system and to collect useful information for the multi-expert system designing.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
L. Xu, A. Krzyzak, C. Y-Suen, “Methods of Combining Multiple Classifiers and Their Applications to Handwriting Recognition”, IEEE Transaction on Systems, Man and Cybernetics, Vol. 22, N. 3, 1992, pp. 418–435.
F. Kimura, M. Shridhar, “Handwritten Numeral Recognition Based on Multiple Algorithm”, Pattern Recognition, vol. 24 no. 10, 1991, pp. 969–983.
E. Mandler and J. Schuermann, “Combining the Classification Results of independent classifiers based on the Dempster/Shafer theory of evidence”, in Pattern Recognition and Artificial Intelligence, Eds. E.S. Gelsema and L.N. Kanal, North Holland, Amsterdam, 1988, pp. 381–393.
S.B. Cho, J.H. Kim, “Combining Multiple Neural Networks by Fuzzy Integral for Robust Classification”, IEEE Trans. Systems, Man and Cybernetics, vol. 25, no. 2, 1995, pp. 380–384.
Y.S. Huang and C.Y. Suen, “A Method of Combining Multiple Experts for the Recognition of Unconstrained Handwritten Numerals”. IEEE Trans. On Pattern Analysis and Machine Intelligence, vol. 17, no. 1, 1995, pp. 90–94.
H.J. Kang, S.W. Lee, “Combining Classifiers Based on Minimization of a Bayes Error Rate”, Proc. of Fifth International Conference on Document Analysis and Recognition (ICDAR99), Bangalore, India, 20–22 Sept. 1999, pp. 398–401.
J. Kittler, M. Hatef, R. P.W. Duin, J. Matas, “On Combining Classifiers”, IEEE on Pattern Analysis and Machine Intelligence, vol. 20 No. 3, March 1998, pp. 226–239.
N. Srihari et al, “Decision combination in multiple classifier systems”, IEEE on Pattern Analysis and Machine Intelligence, vol. 16 No. 1, Jan. 1994, pp. 66–75.
G. Giacinto, F. Roli, “Methods for Dynamic Classifier Selection”, Proc. of 10th Intern. Conference on Image Analysis and Processing ICIAP’99, Venice, Italy, Sept. 27–29, 1999, pp. 659–664.
J. Kittler, “Improving Recognition rates by classifier combination: A Theoretical Framework”, Progress in Handwriting Recognition, edited by A.C. Downton and S. Impedovo, World Scientific Publishing Co. Pte. Ltd., Singapore, 1997, pp. 231–247.
G. Dimauro, S. Impedovo, G. Pirlo, A. Salzo, “Multiple Experts: a new methodology for the evaluation of the combination processes”, Progress in Handwriting Recognition, edited by A.C. Downton and S. Impedovo, World Scientific Publishing Co. Pte. Ltd., Singapore, pp. 329–335.
S. Impedovo, A. Salzo, “Evaluation of Combination Methods”, Proc. of Fifth International Conference on Document Analysis and Recognition (ICDAR99), Bangalore, India, 20–22 Sept. 1999, pp. 394–397.
C.Y. Suen, C. Nadal, R. Legault, T.A. Mai, L. Lam, “Computer Recognition of unconstrained hand-written Numerals”, Proc. IEEE, Vol. 80, N. 7, 1992, pp. 1162–1180
E. Kreyszig, “Introductory Mathematical Statistics-Principle and Methods-”, John Wiley & Sons Publ., New York, 1970, pp. 262–284.
H. Scheffé, “A method for judging all contrasts in the analysis of variance”, Biometrika, 40, 1953, pp. 87–104.
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Impedovo, S., Salzo, A. (2000). A New Evaluation Method for Expert Combination in Multi-expert System Designing. In: Multiple Classifier Systems. MCS 2000. Lecture Notes in Computer Science, vol 1857. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45014-9_22
Download citation
DOI: https://doi.org/10.1007/3-540-45014-9_22
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-67704-8
Online ISBN: 978-3-540-45014-6
eBook Packages: Springer Book Archive