Qlearning with infinite stat space.pdfVIP

$ % Convergence of Q-learning with linear function approximation Francisco S. Melo and M. Isabel Ribeiro Institute for Systems and Robotics [fmelo,mir]@isr.ist.utl.pt European Control Conference, Kos, Greece, July 2007 July 4th, 2007 Slide 1 $ % Outline of the presentation ? Motivation and problem formulation ? Background ? Related work ? Q-learning with LFA ? Some results ? Concluding remarks July 4th, 2007 Slide 2 $ % Motivation ? Markov decision processes provide useful models to address discrete-time stochastic control problems; ? Many powerful methods are available (e.g., TD(λ), Q-lear