slides (data mining)幻灯片（数据挖掘）.pptVIP

DATA-MINING Artificial Neural Networks Teaching without the tutor: redundancy of data The length of data description: Two ways to reduce the data Main idea: neuron - indicator The requirement: Neurons must interact somehow (if we will train them independently we will receive the same result for all of them) * * Alexey Minin, Jass 2006 ANN forms it’s output itself, according to the information, presented for input. We have to minimize some functional.After we have found this functional we have to minimize it. It is the main task, and according to this functional the input vector will be changed. In practice, adaptive networks code input information in the most compact way, of course according to some predefined requirements. Teaching without the tutor: introduction Reducing the dimension of data with min loss Dimension of data = number of components of input vector Capacity of data = number of bits, defining the possible variety of all values Two ways of coding (reducing) the information Reducing the variety of data by detecting the prototypes finding of independent features Clustering and quantifying Reducing the dimension allows us to describe the data with less components Clustering allows us to reduce the variety of data,reducing the number of bits,we need to describe the data. We can unite both types of algorithms. We can use Kohonen maps, when prototypes regulate in the space of low dimension. For example, input data can be reflected on to 2-dimensional grid of prototypes the way, you can visualize the data you have. NB Neuron has one output and it’s teaching upon a d-dimension data Lets say that the activation function is linear. The output therefore is the linear combination of it’s outputs: The amplitude after the training is finished can be the indicator for the data. Showing rather the data corresponds for training patterns or not. Hebb training algorithm According to Hebb: If we will reformulate the task as the optimization task we will