A Markov process is a stochastic process where the probability distribution of the future states depend only on the information that we have about the current time, not on the information we have on the past states. Markov ...