Learning to Interpret Natural Language Instructions学习理解自然语言指令.pptVIP

* * Pilot Study New Instruction, SN : “Go to the green room.” Pr(“push”|R1) Pr(“room”|R1) ... Pr(“push”|R2) Pr(“room”|R2) ... Pilot Study New Instruction, S’N : “Go with the star to green.” Pr(“push”|R1) Pr(“room”|R1) ... Pr(“push”|R2) Pr(“room”|R2) ... Outline What is the problem? Our approach Pilot study Conclusions and future work Conclusions Proposed new approach for training an artificial agent to learn to carry out complex multistep tasks specified in natural language, from pairs of instructions and demonstrations Showed pilot study with a simplified model Current/Future Work SP, TA