Lecture 16 cs阅读16 CS.uwaterloo.pptxVIP

Sum-Product Networks CS886 Topics in Natural Language Processing Guest Lecture by Pascal Poupart University of Waterloo July 22, 2015 2 Outline What is a Sum-Product Network? Inference Language modeling 3 What is a Sum-Product Network? Poon and Domingos, UAI 2011 Acyclic directed graphof sums and products Leaves can be indicatorvariables or univariate distributions 4 Two Views Deep architecture with clear semantics Tractable probabilistic graphical model 5 Deep Architecture Specific type of deep neural network Activation function: product Advantage: Clear semantics and well understood theo