Abstract
We propose a novel Multi-Level Multiple Output Gaussian Process framework for dealing with multivariate and treed data.We define a two-layer hierarchical tree with parent nodes on the upper layer and children nodes on the lower layer in order to represent the interaction between the multiple outputs.Then we compute the Multiple Output Gaussian Process (MGP) covariance matrix as a linear combination of a global multiple output covariance matrix (using the total number of outputs) and a set of local matrices (only using the outputs belonging to each parent node). With this construction of the covariance matrix and the tree we are capable to do interpolation using the MGP framework. To improve the results, we also test different ways of computing the Intrinsic Model of Coregionalization covariance matrix that uses the input space. Results over synthetic data, Motion Capture data and Wireless data shows that the proposed methodology makes a better representation of treed multiple output data.
Chapter PDF
Similar content being viewed by others
Keywords
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
References
Álvarez, M.A.: Convolved Gaussian Process Priors for Multivariate Regression With Applications to Dynamical Systems. Ph.D. thesis, School of Computer Science, University of Manchester (2011)
Álvarez, M.A., Lawrence, N.D.: Computationally efficient convolved multiple output Gaussian processes. Journal of Machine Learning Research 12, 39 (2011)
Álvarez, M.A., Rosasco, L., Lawrence, N.: Kernels for Vector-Valued Functions: A Review. Now Publishers Incorporated (2012). http://books.google.com.co/books?id=2A5hLwEACAAJ
Álvarez, M.A., Lawrence, N.D.: Sparse convolved multiple output gaussian processes for multi-outptut regression. In: NIPS 2008, pp. 57–64 (2009)
Bilionis, I., Zabaras, N.: Multi-output local gaussian process regression: Applications to uncertainty quantification. J. Comput. Physics 231(17), 5718–5746 (2012). http://dblp.uni-trier.de/db/journals/jcphy/jcphy231.html#BilionisZ12
Bishop, C.M.: Pattern Recognition and Machine Learning (Information Science and Statistics). Springer (2007). http://www.openisbn.com/isbn/9780387310732/
Carl Edwards Rasmussen, C.W.: Gaussian Processes for Machine Learning. The MIT Press (2006)
Fox, E.B., Dunson, D.B.: Multiresolution gaussian processes. In: Bartlett, P.L., Pereira, F.C.N., Burges, C.J.C., Bottou, L., Weinberger, K.Q. (eds.) NIPS, pp. 746–754 (2012). http://dblp.uni-trier.de/db/conf/nips/nips2012.html#FoxD12
Gramacy, R.B., Lee, H.K.H.: Bayesian treed gaussian process models with an application to computer modeling. Journal of the American Statistical Association (2007)
Konomi, B., Karagiannis, G., Sarkar, A., Sun, X., Lin, G.: Bayesian treed multivariate gaussian process with adaptive design: Application to a carbon capture unit. Technometrics, 145–158, May 2014
Lawrence, N.D., Moore, A.J.: Hierarchical gaussian process latent variable models. In: Proceedings of the 24th International Conference on Machine Learning, pp. 481–488 (2007)
Liutkus, G., Badeau, R.: Multi-dimensional signal separation with gaussian processes. In: IEEE Statistical Signal Processing Workshop (SSP), pp. 401–404 (2011)
Murphy, K.P.: Machine Learning: A Probabilistic Perspective (Adaptive Computation and Machine Learning Series). The MIT Press (2012). http://www.openisbn.com/isbn/9780262018029/
Park, S., Choi, S.: Hierarchical gaussian process regression. In: JMLR: Workshop and Conference Proceedings 13, pp. 95–110 (2010)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Cuesta, J.J., Álvarez, M.A., Orozco, Á.Á. (2015). Global and Local Gaussian Process for Multioutput and Treed Data. In: Murino, V., Puppo, E. (eds) Image Analysis and Processing — ICIAP 2015. ICIAP 2015. Lecture Notes in Computer Science(), vol 9279. Springer, Cham. https://doi.org/10.1007/978-3-319-23231-7_15
Download citation
DOI: https://doi.org/10.1007/978-3-319-23231-7_15
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-23230-0
Online ISBN: 978-3-319-23231-7
eBook Packages: Computer ScienceComputer Science (R0)