Unwrap Mosaics A new representation for video editing打开马赛克视频编辑的新表示.pptVIP

* * * * * Chi square * * Chi square * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * Exact Transformation to QPBF Move making algorithms E(y) = ∑ fi (yi) + ∑ gij (yi,yj) i,j i y ? Labels L = {l1, l2, … , lk} Min y [Boykov , Veksler and Zabih 2001] [Woodford, Fitzgibbon, Reid, Torr, 2008] [Lempitsky, Rother, Blake, 2008] [Veksler, 2008] [Kohli, Ladicky, Torr 2008] Solution Space Energy Search Neighbourhood Current Solution Optimal Move Solution Space Energy Search Neighbourhood Current Solution Optimal Move xc (t) Key Property Move Space Bigger move space Solution Space Energy Better solutions Finding the optimal move hard Minimizing Pairwise Functions [Boykov Veksler and Zabih, PAMI 2001] Series of locally optimal moves Each move reduces energy Optimal move by minimizing submodular function Space of Solutions (x) : Ln Move Space (t) : 2n Search Neighbourhood Current Solution n Number of Variables L Number of Labels Kohli et al. ‘07, ‘08, ‘09 Extend to minimize Higher order Functions Minimize over move variables t x = t x1 + (1- t) x2 New solution Current Solution Second solution Em(t) = E(t x1 + (1- t) x2) For certain x1 and x2, the move energy is sub-modular QPBF [Boykov , Veksler and Zabih 2001] Variables labeled α, β can swap their labels [Boykov , Veksler and Zabih 2001] Sky House Tree Ground Swap Sky, House Variables labeled α, β can swap their labels [Boykov , Veksler and Zabih 2001] Move energy is submodular if: Unary Potentials: Arbitrary Pairwise potentials: Semi-metric θij (la,lb) ≥ 0 θij (la,lb) = 0 a = b Examples: Potts model, Truncated Convex [Boykov , Veksler and Zabih 2001] Variables labeled α, β can swap their labels [Boykov, Veksler, Zabih] Variables take label a or retain current label [Boykov , Veksler and Zabih 2001] Sky House Tree Ground Initialize with Tree Status: Expand Ground Expand House Expand Sky [Boykov, Veksler,