Abstract
Multi-output Gaussian processes (MOGP) are probability distributions over vector-valued functions, and have been previously used for multi-output regression and for multi-class classification. A less explored facet of the multi-output Gaussian process is that it can be used as a generative model for vector-valued random fields in the context of pattern recognition. As a generative model, the multi-output GP is able to handle vector-valued functions with continuous inputs, as opposed, for example, to hidden Markov models. It also offers the ability to model multivariate random functions with high dimensional inputs. In this paper, we use a discriminative training criteria known as Minimum Classification Error to fit the parameters of a multi-output Gaussian process. We compare the performance of generative training and discriminative training of MOGP in subject recognition, activity recognition, and face recognition. We also compare the proposed methodology against hidden Markov models trained in a generative and in a discriminative way.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Álvarez, M.A., Lawrence, N.D.: Sparse convolved Gaussian processes for multi-output regression. In: Koller, D., Schuurmans, D., Bengio, Y., Bottou, L. (eds.) NIPS, vol. 21, pp. 57–64. MIT Press, Cambridge (2009)
Alvarez, M.A., Lawrence, N.D.: Computationally efficient convolved multiple output Gaussian processes. The Journal of Machine Learning Research 12, 1459–1500 (2011)
Álvarez, M.A., Rosasco, L., Lawrence, N.D.: Kernels for vector-valued functions: a review. Foundations and Trends\(^{\textregistered }\) in Machine Learning 4(3), 195–266 (2012)
Bishop, C.M.: Pattern Recognition And Machine Learning (Information Science And Statistics). Springer (2007). http://www.openisbn.com/isbn/9780387310732/
Bonilla, E.V., Chai, K.M., Williams, C.K.I.: Multi-task Gaussian process prediction. In: Platt, J.C., Koller, D., Singer, Y., Roweis, S. (eds.) NIPS, vol. 20. MIT Press, Cambridge (2008)
Boyle, P., Frean, M.: Dependent Gaussian processes. In: Saul, L., Weiss, Y., Bouttou, L. (eds.) NIPS, vol. 17, pp. 217–224. MIT Press, Cambridge (2005)
Chai, K.M.: Variational multinomial logit Gaussian process. Journal of Machine Learning Research 13, 1745–1808 (2012)
Costa, A., Humpire-Mamani, G., Traina, A.J.M.: An efficient algorithm for fractal analysis of textures. In: 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images (SIBGRAPI), pp. 39–46, August 2012
Goovaerts, P.: Geostatistics For Natural Resources Evaluation. Oxford University Press, USA (1997)
Gopalakrishnan, P., Kanevsky, D., Nádas, A., Nahamoo, D.: An inequality for rational functions with applications to some statistical estimation problems. IEEE Transactions on Information Theory 37, 107–113 (1991)
Higdon, D.M.: Space and space-time modelling using process convolutions. In: Anderson, C., Barnett, V., Chatwin, P., El-Shaarawi, A. (eds.) Quantitative Methods for Current Environmental Issues, pp. 37–56. Springer-Verlag (2002)
Jebara, T.: Machine Learning: Discriminative and Generative. Springer (2004)
Juang, B.H., Hou, W., Lee, C.H.: Minimum classification error rate methods for speech recognition. IEEE Transactions on Speech and Audio Processing 5(3), 257–265 (1997)
Rabiner, L.: A tutorial on hidden Markov models and selected applications in speech recognition. Proceedings of the IEEE 77(2), 257–286 (1989)
Rasmussen, C.E., Williams, C.K.I.: Gaussian Processes for Machine Learning. MIT Press, Cambridge (2006)
Skolidis, G., Sanguinetti, G.: Bayesian multitask classification with Gaussian process priors. IEEE Transactions on Neural Networks 22(12), 2011–2021 (2011)
Teh, Y.W., Seeger, M., Jordan, M.I.: Semiparametric latent factor models. In: Cowell, R.G., Ghahramani, Z. (eds.) AISTATS 10, pp. 333–340. Society for Artificial Intelligence and Statistics, Barbados, 6–8 January 2005
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Gómez-González, S., Álvarez, M.A., García, H.F., Ríos, J.I., Orozco, A.A. (2015). Discriminative Training for Convolved Multiple-Output Gaussian Processes. In: Pardo, A., Kittler, J. (eds) Progress in Pattern Recognition, Image Analysis, Computer Vision, and Applications. CIARP 2015. Lecture Notes in Computer Science(), vol 9423. Springer, Cham. https://doi.org/10.1007/978-3-319-25751-8_71
Download citation
DOI: https://doi.org/10.1007/978-3-319-25751-8_71
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-25750-1
Online ISBN: 978-3-319-25751-8
eBook Packages: Computer ScienceComputer Science (R0)