Abstract Video Textures.pdf

Video Textures Arno Scho?dl 1,2 Richard Szeliski 2 David H. Salesin 2,3 Irfan Essa 1 1 Georgia Institute of Technology 2 Microsoft Research 3 University of Washington Abstract This paper introduces a new type of medium, called a video texture, which has qualities somewhere between those of a photograph and a video. A video texture provides a continuous infinitely varying stream of images. While the individual frames of a video texture may be repeated from time to time, the video sequence as a whole is never repeated exactly. Video textures can be used in place of digital photos to infuse a static image with dynamic qualities and explicit action. We present techniques for analyzing a video clip to extract its structure, and for synthesizing a new, similar looking video of arbitrary length. We combine video textures with view morphing techniques to obtain 3D video textures. We also introduce video- based animation, in which the synthesis of video textures can be guided by a user through high-level interactive controls. Applica- tions of video textures and their extensions include the display of dynamic scenes on web pages, the creation of dynamic backdrops for special effects and games, and the interactive control of video-based animation. CR Categories and Subject Descriptors: H.5.1 [Information Interfaces]: Multimedia Information Systems—video I.3.3 [Computer Graphics]: Picture/Image Generation—display algorithms I.4.9 [Image Processing and Computer Vision]: Applications Keywords: Animation, image-based rendering, morphing, multimedia, natural phe- nomena, texture synthesis, video-based rendering, video-based animation, video sprites, view morphing. 1 Introduction A picture is worth a thousand words. And yet, there are many phe- nomena, both natural and man-made, that are not adequately cap- tured by a single static photo. A waterfall, a flickering flame, a flag flapping in the breeze—each of these phenomena has an inherently dynamic quality that a single image simp