Abstract
In the past decade, many researchers have employed various methodologies to combine decisions of multiple classifiers in order to order to improve recognition results. In this article, we will examine the main combination methods that have been developed for different levels of classifier outputs - abstract level, ranked list of classes, and measurements. At the same time, various issues, results, and applications of these methods will also be considered, and these will illustrate the diversity and scope of this research area.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
F. M. Alkoot and J. Kittler. Experimental evaluation of expert fusion strategies. Pattern Recognition Letters, 20:1352–1369, 1999.
A. S. Atukorale and P. N. Suganthan. Combining classifiers based on confidence values. In Proc. Fifth Int. Conf. on Document Analysis and Recognition, pages 37–40, Bangalore, India, Sept. 1999.
Y.-C. Chim, A.A. Kassim, and Y. Ibrahim. Dual classifier system for handprinted alphanumeric character recognition. Pattern Analysis and Applications, 1:155–162, 1998.
L.P. Cordella, P. Foggia, C. Sansone, F. Tortorella, and M. Veneto. Reliability parameters to improve combination strategies in multi-expert systems. Pattern Analysis and Applications, 2:205–214, 1999.
J. Franke. Statistical combination of multiple classifier adapted on image parts. In Proc. 1st European Meeting on Postal Technology (JET POSTE), pages 566–572, Nantes, France, 1993.
J. Franke and M. Oberlander. Writing style detection by statistical combination of classifiers in form reader applications. In Proc. 2nd Int. Conf. on Document Analysis and Recognition, pages 581–584, Tsukuba, Japan, Oct. 1993.
P. D. Gader, D. Hepp, B. Forrester, and T. Peurach. Pipelined systems for recognition of handwritten digits in USPS ZIP codes. In Proc. U. S. Postal Service Advanced Technology Conf., pages 539–548, 1990.
N. Gorski. Practical combination of multiple classifiers. In Proc. Fifth Int. Workshop on Frontiers in Handwriting Recognition, pages 115–118, Colchester, UK, Sept. 1996.
D. Guillevic and C.Y. Suen. HMM-KNN word recognition engine for bank cheque processing. In Proc. 14th ICPR, pages II: 1526–1529, Brisbane, Australia, August 1998.
T.K. Ho. The random subspace method for constructing decision forests. IEEE Trans. PAMI, 20(8):832–844, 1998.
T.K. Ho, J.J. Hull, and S.N. Srihari. Decision combination in multiple classifier systems. IEEE Trans. PAMI, 16:66–75, 1994.
T.K. Ho. Adaptive coordination of multiple classifiers. In J.J. Hull and S.L. Taylor, editors, Document Analysis Systems II, pages 371–384. World Scientific, 1998.
G.F. Houle, D.B. Aragon, R.W. Smith, M. Shridhar, and D. Kimura. A multilayered corroboration-based check reader. In J.J. Hull and S.L. Taylor, editors, Document Analysis Systems II, pages 495–546. World Scientific, 1998.
Y.S. Huang and C.Y. Suen. Combination of multiple experts for the recognition of unconstrained handwritten numerals. IEEE Trans. Pattern Anal. Mach. Intell. 17:90–94, 1995.
S. Impedovo and A. Salzo. Evaluation of combination methods. In Proc. Fifth Int. Conf. on Document Analysis and Recognition, pages 394–397, Bangalore, India, Sept. 1999.
A.K. Jain, S. Prabhakar, and S. Chen. Combining multiple matches for a high security fingerprint verification system. Pattern Recognition Letters, 20:1371–1379, 1999.
C. Ji and S. Ma. Combinations of weak classifiers. IEEE Trans. Neural Networks, 8(1):32–42, 1997.
H.-J. Kang, K. Kim, and J.H. Kim. Optimal approximation of discrete probability distribution with kth-order dependency and its application to combining multiple classifiers. Pattern Recognition Letters, 18:515–523, 1997.
H.-J. Kang and S.-W. Lee. Combining classifiers based on minimization of a Bayes error rate. In Proc. Fifth Int. Conf. on Document Analysis and Recognition, pages 398–401, Bangalore, India, Sept. 1999.
H.-J. Kang and S.-W. Lee. A dependency-based framework of combining multiple experts for the recognition of unconstrained handwritten numerals. In Proc. 1999 IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, pages 124–129, Fort Collins, Colorado, USA, June 1999.
J. H. Kim, K.K. Kim, C.P. Nadal, and C.Y. Suen. A methodology of combining HMM and MLP classifiers for cursive word recognition. In Proc. 15th Int. Conf. on Pattern Recognition, Barcelona, Spain, Sept. 2000. To appear.
J. Kittler. Improving recognition rates by classifier combination. In Fifth Int. Workshop on Frontiers in Handwriting Recognition, pages 81–101, Colchester, UK, Sept. 1996.
J. Kittler. Combining classifiers: a theoretical framework. Pattern Analysis and Applications, 1:18–27, 1998.
J. Kittler. On combining classifiers. IEEE Trans. PAMI, 20(3):226–239, 1998.
J. Kittler. Pattern classification: fusion of information. In Proc. Int. Conf. on Advances in Pattern Recognition, pages 13–22, Plymouth, UK, November 1998.
J. Kittler, M. Hatef, and R.P.W. Duin. Combining classifiers. In Proc. 13th Int. Conf. on Pattern Recognition, pages II: 897–901, Vienna, Austria, August 1996.
S. Klink and T. Jager. MergeLayouts-overcoming faulty segmentations by a comprehensive voting of commercial OCR devices. In Proc. Fifth Int. Conf. on Document Analysis and Recognition, pages 386–389, Bangalore, India, Sept. 1999.
S. Knerr, O. Baret, D. Price, J.C. Simon, V. Anisimov, and N. Gorski. The A2iA recognition system for handwritten checks. In Proc. IAPR Workshop on Document Analysis Systems, pages 431–494, Malvern, Penn., USA, October 1996.
L. Lam, J. Ding, and C. Y. Suen. Differentiating between Oriental and European scripts by statistical features. Int. J. Pattern Recogn. and Artificial Intell., 12(1):63–79, 1998.
L. Lam and C. Y. Suen. Application of majority voting to pattern recognition: an analysis of its behavior and performance. IEEE Trans. Systems, Man, and Cybernetics, 27(5):553–568, 1997.
L. Lam and C.Y. Suen. Optimal combinations of pattern classifiers. Pattern Recognition Letters, 16:945–954, 1995.
D.-S. Lee, C.R. Nohl, and H.S. Baird. Language identification in complex, unoriented, and degraded document images. In Proc. IAPR Workshop on Document Analysis Systems, pages 76–98, Malvern, Penn., USA, October 1996.
D.S. Lee and S.N. Srihari. Handprinted digit recognition: A comparison of algorithms. In Pre-Proc. 3rd Int. Workshop on Frontiers in Handwriting Recognition, pages 153–162, Buffalo, USA, May 1993.
E. Mandler and J. Schuermann. Combining the classification results of independent classifiers based on the Dempster/Shafer theory of evidenc. In E.S. Geselma and L.N. Kanal, editors, Pattern Recognition and Artificial Intelligence, pages 381–393. North Holland, Amsterdam, 1988.
R.K. Powalka, N. Sherkat, and R.J. Whitrow. Multiple recognizer combination topologies. In M.L. Simner, C.G. Leedham, and A.J.W.M. Thomasson, editors, Handwriting and Drawing Research: Basic and Applied Issues, pages 329–342. IOS Press, 1996.
A.F.R. Rahman and M.C. Fairhurst. An evaluation of multi-expert configurations for the recognition of handwritten numerals. Pattern Recognition, 31(9):1255–1273, 1998.
F.R. Rahman and M. C. Fairhurst. Serial combination of multiple experts: a unified evaluation. Pattern Analysis and Applications, 2:292–311, 1999.
A.A. Spanjersberg. Combination of different systems for the recognition of handwritten digits. In Proc. 2nd Int. Joint Conf. on Pattern Recognition, pages 208–209, Copenhagen, Aug. 1974.
C.Y. Suen, C. Nadal, T.A. Mai, R. Legault, and L. Lam. Recognition of totally unconstrained handwritten numerals based on the concept of multiple experts. In Proc. Int. Workshop on Frontiers in Handwriting Recognition, pages 131–143, Montréal, Canada, April 1990.
D. Wang, J. M. Keller, C.A. Carson, K.K. McAdoo-Edwards, and C. W. Bailey. Use of fuzzy-logic-inspired features to improve bacterial recognition through classifier fusion. IEEE Trans. SMC, 28B(4):583–591, 1998.
C. Wenzel, S. Baumann, and T. Jager. Advances in document classification by voting of competitive approaches. In Document Analysis Systems II, pages 385–405. World Scientific, 1998.
L. Xu, A. Krzyzak, and C. Y. Suen. Methods of combining multiple classifiers and their application to handwritten numeral recognition. IEEE Trans. Systems, Man and Cybernetics, 22:418–435, 1992.
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Suen, C.Y., Lam, L. (2000). Multiple Classifier Combination Methodologies for Different Output Levels. In: Multiple Classifier Systems. MCS 2000. Lecture Notes in Computer Science, vol 1857. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-45014-9_5
Download citation
DOI: https://doi.org/10.1007/3-540-45014-9_5
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-67704-8
Online ISBN: 978-3-540-45014-6
eBook Packages: Springer Book Archive