lp-model and markov decision problem, Operation Research

The supply of a certain good is inspected periodically. If an order is placed of size x>0 (integer), the ordering costs are 8+2.x. The delivery time is zero. The demand is stochastic en equals 1 or 2 with probability ½ . Demand in subsequent periods are independent. The size of an order must be such that (a) demand in a period is always satisfied, and (b) the stock at the end of a period never exceeds 2. The holding costs in a period are 2 per unit remaining at the end of a period. Target is to minimize the expected discounted costs over infinite horizon, use discount factor 0.8.

(a)   Give the optimality equations for the Markov decision problem.

(b)   Give an LP-model that allows you to determine the optimal policy.

(c)    Carry out two iterations of the value iteration algorithm

(d)   Choose an odering policy, and investigate using the policy iteration algorithm whether or not this policy is optimal. "

 

Posted Date: 3/5/2013 8:11:19 AM | Location : United States







Related Discussions:- lp-model and markov decision problem, Assignment Help, Ask Question on lp-model and markov decision problem, Get Answer, Expert's Help, lp-model and markov decision problem Discussions

Write discussion on lp-model and markov decision problem
Your posts are moderated
Related Questions
Techniques of Observation Method Observation always involves some interaction between respondent and researcher in which researcher has an opportunity to watch respondent fu

. A paper mill produces two grades of paper viz., X and Y. Because of raw material restrictions, it cannot produce more than 400 tons of grade X paper and 300 tons of grade Y pape

NON PARAMETRIC TESTS All  practical  data follow normal distribution under  such situations can estimate the  parameters such  as mean  variance etc ,,, and use the  standard

LCD Projectors  LCD projectors  are several  steps  ahead of conventional OHPs. These  projectors  are more  compact  and more  powerful  and can  be directly  linked to a

The scientific methods is thus based on certain basic postulate which can be stated as under: a. It relies on empirical evidence: b. It utilizes relevant concepts;

Normal 0 false false false EN-IN X-NONE X-NONE

Small Sample The central limit  theorem does not work well  with small  samples  even if  the  population  in non Gaussian. So  we cannot  rely on the central limit theorem

Conclusions and Recommendations  Conclusions  should  be drawn with  direct  reference to the objectives  of the study. The  readers should  be able  to read the objectives. T

A Company produces 150 cars. But the production rate varies with the distribution. Production Rate Probability 147 0.05 148 0.10 149 0.15 150 0.20 151 0.30 152 0.15 153 0.05 At pre

#what is the similarity and differences between transportation and linear programing models?