a high resolution grammatical strongmodelstrong for face representation.pdfVIP

A High Resolution Grammatical Model for Face Representation and Sketching Zijian Xu, Hong Chen and Song-Chun Zhu Department of Statistics University of California, Los Angeles zjxu, hchen, sczhu@stat.ucla.edu Abstract In this paper we present a generative, high resolution face representation which extends the well- known active appearance model (AAM)[5], [6], [7] with two additional layers. (i) One layer refines the global AAM (PCA) model with a dictionary of learned face components to account for the shape and intensity variabilities of eyes, eyebrows, nose and mouth. (ii) The other layer divides the face skin into 9 zones with a learned dictionary of sketch primitives to represent skin marks and wrinkles. This model is no longer of fixed dimensions and is flexible for it can select the diverse representations in the dictionaries of face components and skin features depending on the complexity of the face. The selection is modulated by the grammatical rules through hidden ”switch” variables. Our comparison experiments demonstrate that this model can achieve nearly lossless coding of face at high resolution ( pixels) with low bits. We also show that the generative model can easily generate cartoon sketches by changing the rendering dictionary. Our face model is aimed at a number of applications including cartoon sketch in non-photorealistic rendering, super-resolution in image processing, and low bit face communication in wireless platforms. 2 I.. INTRODUCTION Human faces have been extensively studied in vision and graphics for a wide ra