生产加工站优化控制仿真演示系统 毕业论文.doc

毕业设计 （20 届） 生产加工站优化控制仿真演示系统 摘 要 研究多站点传送带给料生产加工站(Conveyor-serviced production station, CSPS) 系统的最优控制问题, 其优化目标是通过合理选择每个CSPS的Look-ahead控制策略, 实现整个系统的工件处理率最大. 本文首先根据多Agent系统的反应扩散思想, 对每个Agent的原始性能函数进行改进, 引入了具有扩散功能的局域信息交互项(原始项看作具有反应功能);并运用性能势理论, 构建一种适用于平均和折扣两种性能准则的Wolf-PHC多Agent学习算法, 以求解决策时刻不同步的多站点的协作Look-ahead控制策略. 最后, 论文通过仿真实验验证了该算法的有效性, 学习结果表明, 通过性能函数的改进, 各工作站的负载平衡性得到改善, 整个系统的工件处理率也明显提高. 关键词：传送带给料生产加工站, Look-ahead 控制, 多Agent强化学习, 性能函数 The simulation system of conveyor-serviced production station Abstract The optimal control problem of a multiple conveyor-serviced production station (CSPS) system is concerned.The objective is to maximize the part-processing rate of the entire system by choosing a suitable look-ahead control strategy for each CSPS.According to the reaction-diffusion mechanism of multi-agent systems,the original performance function of each agent is first modified by introducing an item with a diffusion function that denotes the interaction of local information (The original item is assumed to have a reaction function).Then,combined with the concept of performance potentials,a multi-agent algorithm,Wolf-PHC algorithm,is proposed to derive the coordinated look-ahead control strategy for systems with either discounted or average performance criteria,where the decision epoch of each agent is asynchronous.Finally,a simulation example is used to illustrate the effectiveness of the algorithm,and the simulation results show that due to the modification of the performance functions,the contributions of all the stations are well balanced,and the part-processing rate of the entire system is increased significantly. Key words ：Conveyor-serviced production station (CSPS), look-ahead control, multi-agent reinforcement learning, per-formance function. 目录 生产加工站优化控制仿真演示系统 2 摘 要 2 图表清单 5 第一章 绪论 1 1.1 相关背景 1 1.2 开发环境 1 第二章 基于多站点CSPS系统的算法的实现 3 2.1 强化学习 3 2.2 Q学习算法 3 2.3 孤立决策Q学习算法 5 2.4 基于性能势的多站点Q学习算法 6 第三章 系统仿真设计实现与分析 9 3.1 Mactom与VC混合编程 9 3.2 模块设计与实现 12 3.2.1系统参数设置模块 1