基于分布式Q学习的Femtocell两层网络功率控制方法.docVIP

Hans Journal of Wireless Communications 无线通信, 2013, 3, 1-6 /10.12677/hjwc.2013.31001 Published Online February 2013 (/journal/hjwc.html) Power Control for Femtocell Two-Tier Networks Based on Distributed Q-Learning Haiqin Ning, Peisheng Pan Nangjing University of Posts and Telecommunications, College of Communication and Information Technology, Nanjing Email: ninghaiqin2010@163.com, panps@ Received: Jan. 8 , 2013; revised: Jan. 11 , 2013; accepted: Jan. 25 , 2013 th th th Abstract: With the development of the next generation wireless communications technology, the concept of Femtocell came into being. Femtocell is a kind of home base station which can expand coverage indoor, improve system performance and decrease macrocell communication overhead. However, the existing co-channel interference of the network between macrocells and femtocells can dramatically degrade the overall performance of the network. For this reason, we did a research and wrote the paper. First we analyze a two-tier network of distributed Q-learning algorithm in Femtocell and Macrocell downlink power control, then simulate and analyze the independent Q-learning algorithm and cooperation Q-learning algorithm based on that. In addition, we optimize the cooperation Q-learning algorithm so that it can ensure that the value of return function is positive in the case of satisfying the base station transmit power and capacity performance, and is negative in other cases. This improvement can indeed increase the efficiency and fairness of the system capacity after the confirmation of matlab simulation. Keywords: Power Control; Femtocell; Interference; Independent Q-Learning; Cooperative Q-Learning 基于分布式 Q学习的 Femtocell两层网络功率控制方法 宁海芹，潘沛生 南京邮电大学通信与信息工程学院，南京 Email: ninghaiqin2010@163.com, panps@ 收稿日期：2013年 1月 8日；修回日期：2013年 1月 11日；录