Media Summary: The normal, Xi-squared, F, and t distributions. Definition and examples of Markov chains. Three properties of Markov chains and three ways to look at Markov chains.
Math414 Stochastic Processes Section 0 - Detailed Analysis & Overview
The normal, Xi-squared, F, and t distributions. Definition and examples of Markov chains. Three properties of Markov chains and three ways to look at Markov chains. Definition of recurrent and transient states. Examples. A formula for the conditional expectation of the number of visits to a state. Period of a state. Examples. All communicating states have the same period. If a state has period 1, then starting from a certainĀ ... The Kolmogorov-Chapman equations and some consequences. Examples of computations of conditional and unconditionalĀ ...
Two exercises on computing extinction probabilities in a Galton-Watson