Courseware to find these steady-state probabilities

Reference no: EM131105451

A student is concerned about her car and does not like dents. When she drives to school, she has a choice of parking it on the street in one space, parking it on the street and taking up two spaces, or parking in the lot. If she parks on the street in one space, her car gets dented with probability 1 1 0 . If she parks on the street and takes two spaces, the probability of a dent is 5 1 0 and the probability of a $15 ticket is 1 3 0 . Parking in a lot costs $5, but the car will not get dented. If her car gets dented, she can have it repaired, in which case it is out of commission for 1 day and costs her $50 in fees and cab fares. She can also drive her car dented, but she feels that the resulting loss of value and pride is equivalent to a cost of $9 per school day. She wishes to determine the optimal policy for where to park and whether to repair the car when dented in order to minimize her (long-run) expected average cost per school day.

(a) Formulate this problem as a Markov decision process by identifying the states and decisions and then finding the C_ik.

(b) Identify all the (stationary deterministic) policies. For each one, find the transition matrix and write an expression for the (longrun) expected average cost per period in terms of the unknown steady-state probabilities

(c) Use your OR Courseware to find these steady-state probabilities for each policy. Then evaluate the expression obtained in part (b) to find the optimal policy by exhaustive enumeration.

Reference no: EM131105451

Questions Cloud

What is the effect of mistake of fact in contract law : Can contractual agreements be illegal as formed or performed? What is the effect of mistake of fact in contract law?

Why are financial markets essential for a healthy economy : Why are financial markets essential for a healthy economy and economic growth?

Net income for the year for carrie : Net income for the year for Carrie, Inc. was $750,000, but the statement of cash flows reports that cash provided by operating activities was $860,000. What might account for the difference?

Effects of exchange rate change : On December 31, the exchange rate is $1 = ¥235. What are the likely competitive effects of this exchange rate change on Caterpillar Tractor, the American earth-moving manufacturer, whose toughest competitor is Japan's Komatsu?

Courseware to find these steady-state probabilities : A student is concerned about her car and does not like dents. When she drives to school, she has a choice of parking it on the street in one space, parking it on the street and taking up two spaces, or parking in the lot. If she parks on the stree..

What amount should slide report as the cumulative effect : What amount should Slide report as the cumulative effect on the statement of retained earnings - What amount of cumulative effect of this accounting change in its income statement for the year ended December 31, '10?

Forward contracts to profit : How would you use forward contracts to profit in the above situation?

Calculate the rate of depreciation per year to be applied : Compute the rate of depreciation per year to be applied to the plant assets under the composite method. Prepare the adjusting entry necessary at the end of the year to record depreciation for the year.

Find two designs using open-circuited stubs : Find two designs using open-circuited stubs.

User Account

All Pages