Markov Chain an Introduction (2014)

A Markov chain, named after Andrey Markov is a mathematical system that experiences transitions from one state to another, between a finite or countable number of possible states. Markov chain is a random process usually characterized as memoryless: the next state depends only on the …

Read Complete Post

Random Walk Probability of Returning to Origin after n steps

Random Walk Probability of Returning to Origin Assume that the walk starts at $x=0$ with steps to the right or left occurring with probabilities $p$ and $q=1-p$. We can write the position $X_n$ after $n$ steps as\[X_n=R_n-L_n \tag{1}\]where $R_n$ is the number of right or …

Read Complete Post