马尔科夫过程介绍.pptVIP

4.9 APPLICATIONS TO MARKOV CHAINS 1211101 1121100210 应用物理系 王允磊 What is Markov chains? The Markov chains described in this section are used as mathematical models of a wide variety of situations in biology, business, chemistry, engneering, physics, and elsewhere. In each case, the model is used to describe an experiment or measurement that is performed many times in the same way, where the outcome of each trial of the experiment will be one of several specified possible outcomes, and where the outcome of one trial depends only on the immediately preceding trial. For example, if the populati