Combining Randomization and Discrimination for Fine-Grained Image Categorization_Slides.pptx

1 Combining Randomization and Discrimination for Fine-grained Image Categorization (CVPR 2011) Bangpeng Yao*, Aditya Khosla*, and Li Fei-Fei Computer Science Department, Stanford University (* - indicates equal contribution) {bangpeng,aditya86,feifeili}@cs.stanford.edu Hmmm, I wonder if these mushrooms are edible! Species: Red-capped Scaber Species: Amanita Muscaria Hmmm, I wonder if this snake is poisonous… 2 Base-level Categorization Mammals Fine-grained Categorization From Base-level to Fine-grained Categorization 3 [Rosch, 1979] Subordinate Categorization Children learn to identify base-level categories before subordinate categories Flats! [Johnson Eilers, 1998] 4 Stilettos! Pumps! Peep toes! Platforms! Shoes! Mary Janes! Sling backs! Computer vision has followed a similar trajectory! Caltech-4, 1999 Viola-Jones, 2001 Caltech - 101, 2004 Spatial pyramid matching, 2006 Deformable Parts-based Model, 2008 ImageNet, 2009-2011 5 Caltech - 256, 2007 Recently Emerging Fine-Grained Datasets Caltech-4, 1999 Caltech - 101, 2004 ImageNet, 2009-2011 6 Caltech - 256, 2007 ImageNet Winter Release, 2011 CUB-200, 2010 Action Classification, 2010 Action Classification (PASCAL VOC, PPMI, …) Fine-Grained Categorization: Potential Applications We are looking for a red Camry Robots handling tools/cooking Assisting humans in fine-discrimination Fine-grained tracking/surveillance 7 Fine-grained Image Categorization Our Method Dataset Experiments ImageNet Datasets Conclusion Outline 8 Fine-grained Image Categorization Our Method Dataset Experiments ImageNet Datasets Conclusion Outline 9 Fine-grained Categorization is Challenging Different background Different pose Different Viewpoint Different class, very similar appearance Reference image: California gull Can existing approaches adequately address these challenges? 10 11 Existing methods on this Problem [Grauman Darrell, 2005, Lazebnik et al, 2006] High Weights Low weights 12 Existing methods on th