hierarchical dirichlet strongprocessesstrong with random effects.pdfVIP

Hierarchical Dirichlet Processes with Random Effects Seyoung Kim Padhraic Smyth Department of Computer Science Department of Computer Science University of California, Irvine University of California, Irvine Irvine, CA 92697-3425 Irvine, CA 92697-3425 sykim@ics.uci.edu smyth@ics.uci.edu Abstract Data sets involving multiple groups with shared characteristics frequently arise in practice. In this paper we extend hierarchical Dirichlet processes to model such data. Each group is assumed to be generated from a template mixture model with group level variability in both the mixing proportions and the component parameters. Variabilities in mixing proportions across groups are handled using hierarchical Dirichlet processes, also allowing for automatic determination of the number of components. In addition, each group is allowed to have its own compo- nent parameters coming from a prior described by a template mixture model. This group-level variability in the component parameters is handled using a random effects model. We present a Markov Chain Monte Carlo (MCMC) sampling algo- rithm to estimate model parameters and demonstrate the method by applying it to the problem of modeling spatial brain activation patterns across multiple images collected via functional magnetic resonance imaging (fMRI). 1 Introduction Hierarchical Dirichlet processes (DPs) (Teh et al., 2006) provide a flexible framework for probabilis- tic modeling when data are observed in a grouped fashion and each group of data can be thought of as being generated from a mixture model. In the hierarchical DPs