计算机视觉英文课件.ppt

Computer Vision Spring 2006 15-385,-685 Instructor: S. Narasimhan Wean 5403 T-R 3:00pm – 4:20pm Lecture #16 Announcements Optical Flow and Motion Lecture #16 Optical Flow and Motion We are interested in finding the movement of scene objects from time-varying images (videos). Lots of uses Track object behavior Correct for camera jitter (stabilization) Align images (mosaics) 3D shape reconstruction Special effects Tracking – Rigid Objects Tracking – Non-rigid Objects Face Tracking Applications of Face Tracking User Interfaces: Mouse Replacement: Head Pose and Gaze Estimation Automotive: Windshield Displays, Smart Airbags, Driver Monitoring Face Recognition: Pose Normalization Model-Based Face Recognition Lipreading/Audio-Visual Speech Recognition Expression Recognition and Deception Detection Rendering and Animation: Expression Animations and Transfer Low-Bandwidth Video Conferencing Audio-Visual Speech Synthesis 3D Structure from Motion 3D Structure from Motion Behavior Analysis Motion Field Image velocity of a point moving in the scene Optical Flow Motion of brightness pattern in the image Ideally Optical flow = Motion field Optical Flow Motion Field Problem Definition: Optical Flow How to estimate pixel motion from image H to image I? Optical Flow Constraint Equation Optical Flow Constraint Equation Finding Gradients in X-Y-T Optical Flow Constraint Optical Flow Constraint Aperture Problem Aperture Problem Computing Optical Flow Discrete Optical Flow Algorithm Discrete Optical Flow Algorithm Example Optical Flow Result Low Texture Region - Bad Edges – so,so (aperture problem) High Textured Region - Good Focus of Expansion (FOE) Focus of Expansion (FOE) Focus of Expansion (FOE) - Example Revisiting the Small Motion Assumption Is this motion small enough? Probably not—it’s much larger than one pixel (2nd order terms dominate) How might we solve this problem? Reduce the Resolution! Coarse-to-fine Optical Flow Estimation Coarse-to-fine Optical Flow Estimati