Markov Processes for Stochastic Modeling door