UCT算法的实现,,,[文].pdfVIP

UCT 算法的实现 在网上，实在很难找到一篇全面一点的介绍 mc 和 uct 的论文，即使是 E 文的东西，也因为专业性实在太强， 导致很难读懂（ only for me），偶尔看到 crazystone 网站上的一点东西，只好免强啃下来， E 文水平实在 太差，感兴趣的朋友只好对照 E 文啃了！ { UCT for Monte Carlo computer go A Monte Carlo (MC) go program plays random games and easily evaluates the terminal position after two passes using Chinese rules. A MC program searches for moves that have high win rates, calculated from playing out at least a few hundred random games. 一个 mc 围棋程序随机地下棋，而且根据中国规则可 以很容易地对双方结束后的态势进行估值。 Mc 程序 经过计算无数个棋局搜索那个取得最高胜率的走法。 A basic MC program would simply collect statistics for all children of the root node, but MC evaluation of these moveswill not convergeto the best move. It is therefore necessary to do a deeper search. 一个最基本的 mc 程序会简单地为第一个根节点统计 数值。但是这些着法的 mc 估值不会趋向于一个最佳 着法，因此需要做更深的搜索。 The UCT-method (which stands for Upper Confidence bounds applied to Trees) is a very natural extension to MC-search, where for each played game the first moves are selected by searching a tree which is grown in memory, and as soon as a terminal node is found a new move/child is added to the tree and the rest of the game is played randomly. The evaluation of the finished random game is then used to update the statistics of all moves in the tree that were part of that game. UCT 算法（树图置信）是对 mc搜索自然的扩展，对 每一盘棋，通过搜索一个在内存中生长的树来确定最 初的着法选择。当一个枝端节点出现时，再生长一个 新的枝节点，余下的棋自由走下去。利用棋局最后的 估值更新对局树中所有走法的统计数据，而这些走法 仅是棋局的一部分。 The UCT-method solves the problem of selecting moves in the tree such that important moves are searched more often than movesthat appears to be bad. One