@inproceedings{Flaxman:2016,
author = {Flaxman, S and Sejdinovic, D and Cunningham, JP and Filippi, S},
title = {Bayesian Learning of Kernel Embeddings},
url = {http://arxiv.org/abs/1603.02160v2},
year = {2016}
}

Download

TY  - CPAPER
AB  - Kernel methods are one of the mainstays of machine learning, but the problemof kernel learning remains challenging, with only a few heuristics and verylittle theory. This is of particular importance in methods based on estimationof kernel mean embeddings of probability measures. For characteristic kernels,which include most commonly used ones, the kernel mean embedding uniquelydetermines its probability measure, so it can be used to design a powerfulstatistical testing framework, which includes nonparametric two-sample andindependence tests. In practice, however, the performance of these tests can bevery sensitive to the choice of kernel and its lengthscale parameters. Toaddress this central issue, we propose a new probabilistic model for kernelmean embeddings, the Bayesian Kernel Embedding model, combining a Gaussianprocess prior over the Reproducing Kernel Hilbert Space containing the meanembedding with a conjugate likelihood function, thus yielding a closed formposterior over the mean embedding. The posterior mean of our model is closelyrelated to recently proposed shrinkage estimators for kernel mean embeddings,while the posterior uncertainty is a new, interesting feature with variouspossible applications. Critically for the purposes of kernel learning, ourmodel gives a simple, closed form marginal pseudolikelihood of the observeddata given the kernel hyperparameters. This marginal pseudolikelihood caneither be optimized to inform the hyperparameter choice or fully Bayesianinference can be used.
AU  - Flaxman,S
AU  - Sejdinovic,D
AU  - Cunningham,JP
AU  - Filippi,S
PY  - 2016///
TI  - Bayesian Learning of Kernel Embeddings
UR  - http://arxiv.org/abs/1603.02160v2
ER  - 

Download