Exploring Visual Perception Through Auditory Sensory Substitution通过听觉感官替代探索视觉感知.pptVIP

Sound Squared?Exploring Visual Perception Through Auditory Sensory Substitution Alex Storer May 3, 2006 CN 730 Your (Near) Future Introduction to Sensory Substitution Using the vOICe Training Paradigm Testing Paradigm Discussion Sensory Substitution Examples Tongue Stimulation Bach-y-Rita, 1970 But Does It Work? Identify Geometric Shapes “See” certain illusions Startle Response Subjective Feeling of Vision Very Limited Resolution Limited Mobility Difficult to Learn Why is this Important for Science? Remove effects of early visual processing Why is this Important for Science? Development of a “new sense” Contingencies for consciousness Role of plasticity Perceptual learning Differential processing in early/late/not blind And more! The vOICe Presents visual information through sound The vOICe From All Angles… Training Training in Real Life Video Training on Shapes Shapes Presented Asked to identify location, shape and orientation Feedback Given Lots and lots of debugging 5 sessions without orientation, 5 with Results M’s Supernatural Powers Recognize and locate simple shapes Navigate the world (with difficulty) Identify objects in the world (with difficulty) Find the walking stick on the ground Weakness: Space/resolution trade off Meta-comment: Incredibly top-down My “Elegant Experiment” A task that translates well to na?ve users Address an interesting question in vision Design a task that is covered by the supernatural powers Solution: A same-or-different task involving illusory contours Further “Elegance” The Na?ve Subject Results Interpretation No reporting of illusory contour perception No significant difference between control and trained subjects Only one subject in each category Everything could be totally random But I don’t think so! Interpretation Recall Natural Image Statistics Further Experiments Perform testing while training takes place Use a control trained on only shapes or only “real world” Similar effects in