autonomous adaptive agent with intrinsic motivation for sustainable hai自治自适应代理可持续海与内在动机.pdfVIP

Journal of Intelligent Learning Systems and Applications, 2010, 2, 167-178 167 doi:10.4236/jilsa.2010.24020 Published Online November 2010 (/journal/jilsa) Autonomous Adaptive Agent with Intrinsic Motivation for Sustainable HAI* Takayuki Nozawa1,#, Toshiyuki Kondo2 1Institute of Development, Aging and Cancer, Tohoku University, Sendai, Japan; 2Institute of Symbiotic Science and Technology, Tokyo University of Agriculture and Technology, Tokyo, Japan; # corresponding author. Email: nozawa@idac.tohoku.ac.jp, t_kondo@cc.tuat.ac.jp Received March 25th, 2010; revised September 8th, 2010; accepted September 13th, 2010. ABSTRACT For most applications of human-agent interaction (HAI) research, maintaining the user’s interest and continuation of interaction are the issues of primary importance. To achieve sustainable HAI, we proposed a new model of intrinsically motivated adaptive agent, which learns about the human partner and behaves to satisfy its intrinsic motivation. Simula- tion of interaction with several types of other agents demonstrated how the model seeks new relationships with the partner and avoids situations which are not learnable. To investigate effectiveness of the model, we conducted a com- parative HAI experiment with a simple interaction setting. The results showed that the model was effective in inducing subjective impressions of higher enjoyability, charm, and sustainability. Information theoretic analysis of the interac- tion suggested that a balanced information transfer between the agent and human partner would be important. The par- ticipants’ brain activity measured by functional near-infrared spectroscopy (fNIRS ) indicated higher variability of ac- tivity at the dorsolateral prefrontal cortex during the interaction with the proposed agent. These results suggest that the intrinsically motivated adaptive agent succe