人工智能基(Cornell).pptVIP

CS 4700:Foundations of Artificial Intelligence Prof. Carla P. Gomes gomes@cs.cornell.edu Module: Intro Neural Networks (Reading: Chapter 20.5) Neural Networks Rich history, starting in the early forties with McCulloch and Pitts’s model of artificial neurons (McCulloch and Pitts 1943). Two views: Modeling the brain “Just” representation of complex functions (Continuous; contrast decision trees) Much progress on both fronts. Drawn interest from: Neuroscience, Cognitive science, AI, Physics, Statistics, and CS/EE. Computer vs. Brain Increasing Compute Power:Moore’s Law Computer Power / Cost Neural Networks Computational model inspired by the brain based on the interaction of multiple connected processing elements (Connectionism, parallel distributed processing, neural computation) . Biological Neurons The brain is made up of neurons which have A cell body (soma) Dendrites (inputs) An axon (outputs) Synapses (connection between cells) Synapses can be excitatory or inhibitory and may change over time When the inputs reach some threshold an action potential (electric pulse) is sent along the axon to the outputs There are around 1011 neurons, 1014 synapses; a cycle time of 1ms-10 ms. Signals are noisy “spike trains of electrical potential Issue: The Hardware The brain a neuron, or nerve cell, is the basic information processing unit (10^11 ) many more synapses (10^14) connect the neurons cycle time: 10^(-3) seconds (1 millisecond) How complex can we make computers? 10^8 or more transistors per CPU supercomputer: hundreds of CPUs, 10^10 bits of RAM cycle times: order of 10^(-9) seconds (1 nanosecond) Compute Power vs. Brain Power In near future we can have computers with as many processing elements as our brain, but: far fewer interconnections (wires or synapses) much faster updates (1 millisecond, 10-3 vs. 1 nanosecond 10-9) Fundamentally different hardware may require fundamentally different algorithms! Very much an open question. Why