Decision theory, reinforcement learning, and the （决策理论,强化学习,）.pdfVIP

Cognitive, Affective, Behavioral Neuroscience 2008, 8 (4), 429-453 doi:10.3758/CABN.8.4.429 ConneCtions Between Computational and neuroBiologiCal perspeCtives on deCision making Decision theory, reinforcement learning, and the brain peter dayan University College London, London, England and nathaniel d. daw New York University, New York, New York Decision making is a core competence for animals and humans acting and surviving in environments they only partially comprehend, gaining rewards and punishments for their troubles. Decision­theoretic concepts permeate experiments and computational models in ethology, psychology, and neuroscience. Here, we review a well­known, coherent Bayesian approach to decision making, showing how it unifies issues in Markovian decision problems, signal detection psychophysics, sequential sampling, and optimal exploration and discuss paradigmatic psychological and neural examples of each problem. We discuss computational issues concern­ ing what subjects know about their task and how ambitious they are in seeking optimal solutions; we address algorithmic topics concerning model­based and model­free methods for making choices; and we highlight key aspects of the neural implementation of decision making. The abilities of animals to make predictions about the af­ by Cue D and then a smaller shock 20% of the time. The fective nature of their environments and to exert control in conv