Markov chain by defining the state space

Assignment Help Basic Statistics
Reference no: EM131319316

A person goes to his office everyday. He has a single umbrella. When he is home and the umbrella is home, he can choose to bring it. He will certainly do so if it is raining, but must decide what to do if is not raining, as it may rain in the afternoon. A similar decision must be made in the afternoon when he is heading home. Suppose that if it rained yesterday afternoon (this morning), but not this morning (this afternoon), the probability that rains this afternoon (tomorrow morning) is q. On the other hand, if it did not rain yesterday afternoon (this morning) nor today (this afternoon), the chance it rains this afternoon (tomorrow morning) drops to r. If it is raining on a given afternoon (morning), it will rain the following morning (same evening) with probability p, irrespective of what happened before.

(a) Model the policy bring the umbrella only when it rains" as a Markov chain by defining the state space and transition probabilities.

(b) What percentage of the time is the employee going to be wet?

Reference no: EM131319316

Questions Cloud

Result the market value of the corporation bond : A U.S. Treasury discount bond has a face value of $1,050 and is selling for $1,000 in the bond market today. A corporation issues an identical discount bond with the same face value. The risk premium on the corporation bond is 20 percent. As a result..
Confidence interval for mean serum cholesterol level : Assuming that serum cholesterol levels for women ages to are normally distributed, find a confidence interval for the mean serum cholesterol level of all women in this age group. Then complete the table below.
What is the yield to maturity of bond : May Industries has a bond outstanding that sells for $783. The bond has a coupon rate of 8.20 percent and 16 years until maturity. What is the yield to maturity of the bond?
Coupon bond-assume semiannual compounding : You purchased a zero coupon bond one year ago for $121.36. The market interest rate is now 7 percent. If the bond had 30 years to maturity when you originally purchased it, what was your total return % for the past year? Assume semiannual compounding..
Markov chain by defining the state space : (a) Model the policy bring the umbrella only when it rains" as a Markov chain by defining the state space and transition probabilities. (b) What percentage of the time is the employee going to be wet?
What was mercantilism-what was its relationship to colonial : How did European expansion (imperialism) affect both the conquered and the conqueror? Your answer is to address the affects in multiple areas, such as political, economic, and social development.What was mercantilism and what was its relationship..
How an enterprise management system integrates operations : Identify and discuss how an enterprise management system integrates operations management and financial management within the context of an existing and verifiable multinational company.
Write the null and alternative hypotheses : A) Write the null and alternative hypotheses B) What is the value of the test statistic  C) What is the associated P value
Compute the entropy of the fourth bit of transmission : Let X be an ensemble with PX = {0.1, 0.2, 0.3, 0.4}. The ensemble is encoded using the symbol code C = {0001, 001, 01, 1}.

Reviews

Write a Review

Basic Statistics Questions & Answers

  Finding expected shape of distribution of sample mean

Find out the expected shape of distribution of sample mean?

  Compute 98 confidence interval for the national average

according to a survey by topaz enterprises a travel auditing company the average error by travel agents is 128. suppose

  Control limits using x bar chart

Compute the probability of seven consecutive points falling above the centerline given a stable process. Is this probability associated with type I or type II error?

  Computing probability of range of cholesterol value

Determine the probability that Mexican American male in the 20 -74 age range has serum cholesterol value greater than 240 mg/dl.

  Estimate time required to provide a laboratory procedure

estimate the time required to provide a given laboratory procedure, suppose that we measured the amount of time required when the service was provided on 60 occasions.

  Multiple independent variables and multiple levels

Explain the difference between multiple independent variables and multiple levels of independent variables. Which is better? What is blocking and how does it reduce "noise"?

  Hypothesis testing of giant foods

Identify a business research issue, problem, or opportunity facing your organization that can be examined using Hypothesis Testing. Describe the results of a hypothesis test on your selected research issue, problem, or opportunity.

  Defines the boundary of the reject region

1) The alternative hypothesis is a

  The proportion of successes in a particular population

Let p1 denote the proportion of successes in a particular population. The test statistic value in Chapter 8 for test

  Respondents refuse to participate in the frs

It is one thing to note the number of people who do not respond to a survey, but few then go on the ask for reasons. Many people have speculated on the reasons, but one survey which routinely asks is the Family Resources Survey for the UK conducte..

  Mean time to complete the entire homework assignment

Which of the following Venn diagrams has shaded the event that the contractor wins exactly one of the contracts and evaluate the mean time to complete the entire homework assignment

  Individuals filing federal income tax returns prior to

individuals filing federal income tax returns prior to march 31 received an average refund of 1056. consifer the

Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd