基于三维模型的Android手机端人脸姿态实时估计系统.docVIP

基于三维模型的Android手机端人脸姿态实时估计系统 　　摘要：针对人脸姿态估计对系统性能要求高、在手机上运行无法满足实时性要求等问题，实现了一种Android手机端的人脸姿态实时估计系统。首先，由摄像头获得一幅正面和一幅偏移一定角度的人脸图像，利用从运动中构建结构（SfM）算法建立简单三维人脸模型；然后，提取实时人脸图像中与三维人脸模型相互对应的特征点，基于缩放正投影位姿估计（POSIT）算法估计人脸姿态角度；最后将三维人脸模型通过开放图形开发库（OpenGL）实时显示在手机屏幕上。实验结果表明，实时视频中检测人脸姿态并显示的速度可以达到20frame/s，接近计算机端的基于仿射对应的三维人脸姿态估计算法，而且针对大量图片序列的检测可以达到50frame/s，能够满足Android手机端的性能和检测人脸姿态的实时性要求。 　　关键词：人脸姿态；从运动中构建结构算法；显示形状回归；基于缩放正投影位姿估计；随机抽样一致算法；Android；增强现实 　　中图分类号： TP391.41 　　文献标志码：A 　　Realtime face pose estimation system based on 3D face model on Android mobile platform 　　WANG Haipeng1， WANG Zhengliang2， XU Weiwei1*， FAN Ran1 　　1.Institute of Service Engineering， Hangzhou Normal University， Hangzhou Zhejiang 311121， China 　　； 　　2.Information Resource Center， Institute of Scientific and Technical Information of Zhejiang Province， Hangzhou Zhejiang 311121， China 　　Abstract： 　　Concerning that the high performance requirement of face pose estimation system which could not run on mobile phone in real time， a realtime face pose estimation system was realized for Android mobile phone terminals. First of all， one positive face image and one face image with a certain offset angle were obtained by the camera for establishing a simple 3D face model by Structure from Motion （SfM） algorithm. 　　Secondly， the system extracted corresponding feature points from the realtime face image to 3D face model. The 3D face pose parameters were got by POSIT （Pose from Orthography and Scaling with ITeration） algorithm. At last， the 3D face model was displayed on Android mobile terminals in realtime using OpenGL （Open Graphics Library）. The experimental results showed that the speed of detecting and displaying the face pose was up to 20frame/s in the realtime video， which is close to 3D face pose estimation algorithm based on the affine correspondance on computer terminals； and the speed of detecting a large number of image sequences reached 50frame/s. The results indicate that the system can satisfy the perfo