mlslib - wscg.pdfVIP

MLSLib: A LIP SYNC LIBRARY FOR MULTI AGENTS AND LANGUAGES H. Murakami  H. Baba y T. Noma   Department of Articial Intelligence Kyushu Institute of Technology 680{4 Kawazu, Iizuka, Fukuoka 820{8502, Japan fh mura, noma g@pluto.ai.kyutech.ac.jp http://www.pluto.ai.kyutech.ac.jp/~noma/research/mlslib/ y Kyushu Scho ol of Engineering Kinki University 11{6 Kayanomori, Iizuka, Fukuoka 820{8555, Japan baba@fuk.kindai.ac.jp ABSTRACT This article presents MLSLib, a software library for human gure animation with lip syncing. The library enables us to easily use multiple TTS systems and multiple lip motion generators, and switch them arbitrarily. It also helps use of multiple sp eaking agents, p ossibly with dierent TTS systems and lip motion generators. The MLSLib is comp osed of three mo dules: LSSAgent, TTSManager, and FCP- Manager; The LSSAgent mo dule provides unied simple APIs p er single agent, indep endent of TTS systems and lip motion generators. The TTSManager and FCPManager manage TTS systems and lip motion generators, resp ectively. Both mo dules supp ort standard sets of phonetic alphab ets p er language, and thus users are freed from TTS-dep endent implementation of lip motion generators. Applica- tions to multi-lingual agents and LOD in lip syncing are also presented. Keywords: Lip Sync, human gure animation, TTS, LOD, MLSLib 1 INTR ODUCTION This we call Lip Sync . Lip moti