formulate the optimality equations, Operation Research

Assignment Help:

Each day you own 0 or 1 stocks of certain commodity. The price of the stock is a stochastic process that can be modeled as a Markov chain with transition rates as follows

 

 

day n+1

 

 

 

100

200

day n

100

0.5

0.5

 

200

0.25

0.75

At the start of a day at which you own a stock you may choose to either sell at the current price, or keep the stock. At the start of a day at which you do not own stock, you may choose to either buy one stock at the current price or do nothing. You have initial capital of 200.

Your target is to maximize the discounted value of the profit over an infinite horizon, use discountfactor 0.8 (per day).

a) Define the states and give for each state the possible decisions.

b) Formulate the optimality equations.

c) Carry out two iterations of value iteration.

d) Formulate the L.P.-model to solve this problem. Describe how you can obtain the optimal policy from the LP formulation.

e) Choose a stationary policy and investigate using the policy iteration algorithm whether or not that policy is optimal.

f) Give the number of stationary policies. Motivate your answer by using the definition of stationary policy.


Related Discussions:- formulate the optimality equations

Linear Programming, A paper mill produces two grades of paper viz., X and Y...

A paper mill produces two grades of paper viz., X and Y. Because of raw material restrictions, it cannot produce more than 400 tons of grade X paper and 300 tons of grade Y paper i

Competitive models, These models have been developed to establish a trade ...

These models have been developed to establish a trade off between costs of providing and the waiting time of a customer in the queuing system. Constructing a model entails desc

Research methodology, In research methodology we not only discuss the res...

In research methodology we not only discuss the research methods but also consider the logic behind the method we use in the context of our research study and explain wh

Carry out resource levelling for equipment resource, Teesside Construction ...

Teesside Construction is developing a schedule for a major building project to start in 04/01/2011 in Middlesbrough, UK. The project manager has identified major activities of the

Regression line - correlation regression analysis, Regression Line The...

Regression Line The line  of regression  is the  line  which give the best  estimate  to the  values  of one  variable  for any  specific  values  of other  variable. For t

Operations Research, a. What do you mean by linear programming problem? Exp...

a. What do you mean by linear programming problem? Explain the steps involved in linear programming problem formulation? b. A paper mill produces two grades of paper viz., X and Y.

Demerits - correlation regression analysis, Demerits a.It cannot  be ...

Demerits a.It cannot  be used in  the case  of  bi variate distribution. b.If the  numbers  of items  are greater than say  30, the calculation becomes  tedious  and  requ

Experimental method, In this method variables beings studied are contro...

In this method variables beings studied are controlled by the investigator. In other the effect of one variable is observed while other relevant variables are held constant

T, #Principles of OR

#Principles of OR

Linear proramming , A paper mill produces two grades of paper viz., X and Y...

A paper mill produces two grades of paper viz., X and Y. Because of raw material restrictions, it cannot produce more than 400 tons of grade X paper and 300 tons of grade Y paper i

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd