基于机器学习的语音驱动人脸动画方法-SemanticScholar.PDFVIP

1000-9825/2003/14(02)0215 ©2003 Journal of Software 软 件 学 报 Vol.14, No.2 基于机器学习的语音驱动人脸动画方法 1+ 1 , 2 1 1 陈益强 , 高 文 , 王兆其 , 姜大龙 1( 中国科学院 计算技术研究所,北京 100080) 2(哈尔滨工业大学 计算机科学与工程系, 黑龙江 哈尔滨 150001) A Speech Driven Face Animation System Based on Machine Learning 1 + 1,2 1 1 CHEN Yi-Qiang , GAO Wen , WANG Zhao-Qi , JIANG Da-Long 1(Institute of Computing Technology, The Chinese Academy of Sciences, Beijing 100080, China) 2(Department of Computer Science and Engineering , Harbin Institute of Technology, Harbin 150001, China) + Corresponding author: Phn: 86-10 Fax : 86-10 E-mail: yqchen@ http://www.jdl . Received 2001-06-04; Accepted 2001-08-01 Chen YQ, Gao W, Wang ZQ, Jiang DL. A speech driven face animation system based on machine learning. Journal of Software, 2003,14(2):215~221. Abstract : Lip synchronization is the key issue in speech driven face animation system. In this paper, some clustering and machine learning methods are combined together to estimate face animation parameters from audio sequences and then apply the learning results to MPEG-4 based speech driven face animation system. Based on a large recorded audio-visual database, an unsupervised cluster algorithm is proposed to obtain basic face animation parameter patterns that can describe face motion characteristic. An Artificial Neural Network (ANN) is trained to map the cepstral coefficients of an individual’s natural speech to face animation parameter patterns directly. It avoids the potential limitation of speech recognition. And the output can be used to drive the articulation of the synthetic face straightforward. Two approaches