Find these steady-state probabilities for each policy

Assignment Help Operation Management

Reference no: EM132299282

Every Friday night a man plays poker at his home with the same group of friends. If he provides refreshments for the group (at an expected cost of $14) on any given Friday night, the group will begin the following Friday night in a good mood with probability 7/8 and in a bad mood with probability 1/8. However, if he fails to provide refreshments, the group will begin the following Friday night in a good mood with probability 1/8 and in a bad mood with probability 7/8, regardless of their mood this Friday. Furthermore, if the group begins the night in a bad mood and then he fails to provide refreshments, the group will gang up on him so that he incurs expected poker losses of $75. Under other circumstances, he averages no gain or loss on his poker play. The man wishes to find the policy regarding when to provide refreshments that will minimize his (long-run) expected average cost per week.

a) Formulate this problem as a Markov decision process by identifying the states and decisions and then finding the Cik .

b) Identify all the (stationary deterministic) policies. For each one, find the transition matrix and write an expression for the (long-run) expected average cost per period in terms of the unknown steady-state probabilities (π0, π1, . . . , πM)

c) Find these steady-state probabilities for each policy. Then evaluate the expression obtained in part (b) to find the optimal policy by exhaustive enumeration. Describe the optimal policy briefly in “plain English”.

d) Formulate a linear programming model for finding an optimal policy.

e) Use the policy improvement algorithm to find an optimal policy. Describe the optimal policy briefly in “plain English”

Reference no: EM132299282

Questions Cloud

Propose improvements to the user interface : Evaluate an existing system where you would propose improvements to the user interface.

The jit and traditional approach focuses : The JIT and Traditional approach focuses on which of the following

Best understand local personnel and practices : Managers Believe that native country managers are best understand local personnel and practices.

Research necessary to develop quality deliverables : In what instances would Wikipedia be of benefit in conducting research necessary to develop quality deliverables?

Find these steady-state probabilities for each policy : Find these steady-state probabilities for each policy. Then evaluate the expression obtained in part (b) to find the optimal policy by exhaustive enumeration.

What possible outcomes will result from using ngt method : How can the NGT be a valuable tool for group decision making? What possible outcomes will result from using the NGT method?

The chief technology officer evaluates new technologies : The chief technology officer evaluates new technologies and identifies those that are most relevant to the organization.

Website design department in existing consulting firm : Try It, Apply it: Suppose you are hired to start a new website design department in an existing consulting firm.

Why do you suppose the company chose that location : Why do you suppose the company chose that location?

User Account

All Pages