Abstract
Classical learning algorithms from the fields of artificial neural networks and machine learning, typically, do not take any costs into account or allow only costs depending on the classes of the examples that are used for learning. As an extension of class dependent costs, we consider costs that are example, i.e. feature and class dependent. We present a natural cost-sensitive extension of the support vector machine (SVM) and discuss its relation to the Bayes rule. We also derive an approach for including example dependent costs into an arbitrary cost-insensitive learning algorithm by sampling according to modified probability distributions.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Bishop, C.M.: Neural Networks for Pattern Recognition. Oxford University Press, Oxford (1995)
Burges, C.J.C.: A Tutorial on Support Vector Machines for Pattern Recognition. Knowledge Discovery and Data Mining 2(2) (1998)
Cristianini, N., Shawe-Taylor, J.: An Introduction to Support Vector Machines (and Other Kernel-Based Learning Methods). Cambridge University Press, Cambridge (2000)
Elkan, C.: The foundations of Cost-Sensitive learning. In: Nebel, B. (ed.) Proceedings of the seventeenth International Conference on Artificial Intelligence (IJCAI 2001), San Francisco, CA, August 4-10, pp. 973–978. Morgan Kaufmann Publishers, Inc., San Francisco (2001)
Kukar, M., Kononenko, I.: Cost-sensitive learning with neural networks. In: Prade, H. (ed.) Proceedings of the 13th European Conference on Artificial Intelligence (ECAI 1998), Chichester, pp. 445–449. John Wiley & Sons, Chichester (1998)
Lenarcik, A., Piasta, Z.: Rough classifiers sensitive to costs varying from object to object. In: Polkowski, L., Skowron, A. (eds.) RSCTC 1998. LNCS (LNAI), vol. 1424, pp. 222–230. Springer, Heidelberg (1998)
Lin, Y.: Support vector machines and the bayes rule in classification. Data Mining and Knowledge Discovery 6(3), 259–275 (2002)
Lin, Y., Lee, Y., Wahba, G.: Support vector machines for classification in nonstandard situations. Machine Learning 46(1-3), 191–202 (2002)
Margineantu, D.D., Dietterich, T.G.: Bootstrap methods for the costsensitive evaluation of classifiers. In: Proc. 17th International Conf. on Machine Learning, pp. 583–590. Morgan Kaufmann, San Francisco (2000)
Saitta, L. (ed.): Machine Learning – A Technological Roadmap. University of Amsterdam (2000) ISBN: 90-5470-096-3
Vapnik, V.N.: The Nature of Statistical Learning Theory. Springer, New York (1995)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Brefeld, U., Geibel, P., Wysotzki, F. (2003). Support Vector Machines with Example Dependent Costs. In: Lavrač, N., Gamberger, D., Blockeel, H., Todorovski, L. (eds) Machine Learning: ECML 2003. ECML 2003. Lecture Notes in Computer Science(), vol 2837. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-39857-8_5
Download citation
DOI: https://doi.org/10.1007/978-3-540-39857-8_5
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-20121-2
Online ISBN: 978-3-540-39857-8
eBook Packages: Springer Book Archive