Reference no: EM132409106

A woman is trapped in a mine having two doors. If she takes the left door, then she will wander around and return to the same position after 3 hours. If she takes the right door, the probability that she will be free after 4 hours, is 1/3; the probability that she will return to the same position after 2 hours is 2/3. In the first attempt, she picks a door at random (uniformly). However, if she takes one door and returns, she will try the other door the next time. She restricts attention to just the left and right doors, and never considers go back the way she came. After her first choice, upon returning, she will alternate doors.

(a) Model the process as a Markov Chain, that is draw a diagram of the Markov Chains indicating the states and transition probabilities.