Timeline A Dynamic Hierarchical Dirichlet Process Model for时间线的动态分层Dirichlet过程模型.pptVIP

Timeline: A Dynamic Hierarchical Dirichlet Process Model for Recovering Birth/Death and Evolution of Topics in Text Stream(UAI 2010) Amr Ahmed and Eric P. Xing Outiline 1. Dirichlet process (DP) 2. Temporal Dirichlet process mixture model and the recurrent Chinese restaurant process (RCRP) 3. Hierarchical Dirichlet process (HDP) 3. Dynamic hierarchical Dirichlet process 4. Inference 5. Experimental results 6. Conclusions Dirichlet Process (DP) The Temporal Dirichlet Process Mixture Model Recurrent Chinese Restaurant Process (RCRP) Modeling Higher-Order Dependencies Non-Parametric Dynamic Topic Model Experimental Results Hierarchical Dirichlet Processes (HDP) Recurrent Chinese Restaurant Franchise Process (RCRFP) Recurrent Chinese Restaurant Franchise Process (RCRFP) Building Infinite Dynamic Topic Models (iDTM) Inference via Gibbs Sampling (1) Inference via Gibbs Sampling (2) Simulation Results Timeline of the NIPS Conference (1) Timeline of the NIPS Conference (2) Timeline of the NIPS Conference (2) Timeline of the NIPS Conference (3) Conclusions and Future Works 1. To addressed the problem of modeling time-varying document collections topic model, iDTM, that can adapt the number of topics, the word distributions of topics, and the topics trend over time. 2. Extend the Gibbs sampler to sample all the hyperparameters of the model. 3. Extend the model to evolve an HDP at various levels, for instance, lower levels might correspond to conferences, and the highest level to time. This framework will enable us to understand topic evolution within and across different conferences or disciplines. * Presented by Bo Chen Dynamic Non-Parametric Mixture Models and The Recurrent Chinese Restaurant Process (SDM, 2008) If we integrate out G, The posterior of G Perspectives: Chinese restaurant process or Polya urn model Stick-breaking process A limit of finite mixture models. Normalized Gamma process Intuition: The TDPM seek to model cluster parameters evolution over time us