Markov Chain, Applied Statistics

Each weekend, Derek either reads a book (B), goes to the cinema (C), visits
his local museum (M), or plays squash (S). If he reads a book one weekend,
then he will take part in one of the other activities the next weekend, each
with the same probability. After going to the museum or to the cinema, he
always either plays squash or reads a book the next weekend, and he is twice
as likely to play squash as he is to read a book. The weekend after playing
squash, he always goes to the cinema.
(i) Write down the matrix of transition probabilities for the Markov chain
for Derek’s weekend activities.
(ii) One weekend, Derek reads a book.
(1) What is the probability that he goes to the cinema the next
weekend?
(2) Calculate the probability that he plays squash in two weeks’ time.
(3) Calculate the probability that he goes to the cinema next weekend
and plays squash in two weeks’ time.
(iii) In the long run, what proportion of weekends does Derek spend on each
of the activities? Show all the steps in your solution, and give your
answers either as fractions or correct to three decimal places.
(iv) If Derek visits the museum one weekend, what is the expected number
of weeks until he next visits the museum?
Immediately on returning from a holiday, Derek always either visits the
museum or plays squash, each with the same probability.
(v) Calculate the probability that he will play squash:
(1) one weekend later;
(2) two weekends later;
(3) three weekends later.
(vi) Find an approximate value for the probability that he will play squash
Posted Date: 6/25/2012 6:40:18 AM | Location : United States







Related Discussions:- Markov Chain, Assignment Help, Ask Question on Markov Chain, Get Answer, Expert's Help, Markov Chain Discussions

Write discussion on Markov Chain
Your posts are moderated
Related Questions
Multivariate analysis of variance (MANOVA) is a technique to assess group differences across multiple metric dependent variables simultaneously, based on a set of categorical (non-

For each of the following situations choose the statistical model that you find to be the most appropriate. Justify your choice. a) We are interested in assessing the effects of

If the data set contains an odd number of items, the middle item of the array is the median. If there is an even number of items, the median is the average of the two items. If the

Exercise: (Binomial and Continuous Model.) Consider a binomial model of a risky asset with the parameters r = 0:06, u = 0:059, d =  0:0562, S0 = 100, T = 1, 4t = 1=12. Note that u

Simple Regression: The Teacher Preparation Research Team conducted a study of college students who took the Praxis II-a teacher certification examination. Some variables from

Consider the following linear regression model:      a) What does y and x 1 , x 2 , . . . . x k represent?      b) What does β o , β 1 , β 2 , . . . . β k represent?

A sample of college students and a separate sample of adults aged 30-59 were surveyed regarding the amount of fruit they eat each day.  The results are shown in the histograms belo

Question: The weights of 60 children born to mothers in a small rural hospital were recorded. 3.63 3.54 3.15 3.90 4.29 4.06 2.91 3.36 3.3

a. How can break-even analysis be used in selecting a new plant site? b. What are potential advantages and disadvantage of locating a production facility in foreign country i

what the purpose we use it