Markov Chain, Applied Statistics

Each weekend, Derek either reads a book (B), goes to the cinema (C), visits
his local museum (M), or plays squash (S). If he reads a book one weekend,
then he will take part in one of the other activities the next weekend, each
with the same probability. After going to the museum or to the cinema, he
always either plays squash or reads a book the next weekend, and he is twice
as likely to play squash as he is to read a book. The weekend after playing
squash, he always goes to the cinema.
(i) Write down the matrix of transition probabilities for the Markov chain
for Derek’s weekend activities.
(ii) One weekend, Derek reads a book.
(1) What is the probability that he goes to the cinema the next
weekend?
(2) Calculate the probability that he plays squash in two weeks’ time.
(3) Calculate the probability that he goes to the cinema next weekend
and plays squash in two weeks’ time.
(iii) In the long run, what proportion of weekends does Derek spend on each
of the activities? Show all the steps in your solution, and give your
answers either as fractions or correct to three decimal places.
(iv) If Derek visits the museum one weekend, what is the expected number
of weeks until he next visits the museum?
Immediately on returning from a holiday, Derek always either visits the
museum or plays squash, each with the same probability.
(v) Calculate the probability that he will play squash:
(1) one weekend later;
(2) two weekends later;
(3) three weekends later.
(vi) Find an approximate value for the probability that he will play squash
Posted Date: 6/25/2012 6:40:18 AM | Location : United States







Related Discussions:- Markov Chain, Assignment Help, Ask Question on Markov Chain, Get Answer, Expert's Help, Markov Chain Discussions

Write discussion on Markov Chain
Your posts are moderated
Related Questions
regression line drawn as Y=C+1075x, when x was 2, and y was 239, given that y intercept was 11. calculate the residual

Cluster Sampling Here the population is divided into clusters or groups and then Random Sampling is done for each cluster. Cluster Sampling differs from Stratified Sampl

1. Suppose you are estimating the imports (from both the U.S. mainland and foreign countries) of fuels and petroleum products in Hawaii (the dependent variable). The values of the

Do people of different age groups differ in their response to e-mail messages? A survey by the Cent of the Digital Future of the University of Southern California reported that 70.

Test the following claim. Identify the null hypothesis, alternative hypothesis, test statistic, critical value(s), conclusion about the null hypothesis, and final conclusion that

Circles or Pie Diagram: Circles or pie diagrams are alternative to squares. These are used  for the same purpose i.e. when  the values are differing  widely in their magnitude


The Elementary Teachers' Federation of Ontario make the following claim on their website as of February 13, 2013: For years, the Elementary Teachers' Federation of Ontario (ETFO

Melissa Bakery is preparing for the coming thanksgiving festival. The bakery plans to bake and sell its favourite cookies; butter cookies, chocolate cookies and almond cookies. A k

The box plot displays the diversity of data for the income; the data ranges from 20 being the minimum value and 1110 being the maximum value. The box plot is positively skewed at 4