formulate the optimality equations, Operation Research

Assignment Help:

Each day you own 0 or 1 stocks of certain commodity. The price of the stock is a stochastic process that can be modeled as a Markov chain with transition rates as follows

 

 

day n+1

 

 

 

100

200

day n

100

0.5

0.5

 

200

0.25

0.75

At the start of a day at which you own a stock you may choose to either sell at the current price, or keep the stock. At the start of a day at which you do not own stock, you may choose to either buy one stock at the current price or do nothing. You have initial capital of 200.

Your target is to maximize the discounted value of the profit over an infinite horizon, use discountfactor 0.8 (per day).

a) Define the states and give for each state the possible decisions.

b) Formulate the optimality equations.

c) Carry out two iterations of value iteration.

d) Formulate the L.P.-model to solve this problem. Describe how you can obtain the optimal policy from the LP formulation.

e) Choose a stationary policy and investigate using the policy iteration algorithm whether or not that policy is optimal.

f) Give the number of stationary policies. Motivate your answer by using the definition of stationary policy.


Related Discussions:- formulate the optimality equations

Components included in the reseach proposal, Components Included in the Pro...

Components Included in the Proposal Personnel In case the proposal is addressed to the funding agencies, the qualifications of the key project personnel for study should be

Disadvantages of mean deviation - measure of dispersion, Disadvantages of ...

Disadvantages of Mean Deviation a.Mean deviation ignores  the algebraic  signs of the deviations and  such it is  not capable  of further algebraic  treatment. b.It is  no

Construction of a mathematical model, The 2 nd phase of operations Resear...

The 2 nd phase of operations Research is to construct a mathematical model representing the system under study. It requires the identification of both static and dynam

Linear programming, A paper mill produces two grades of paper viz X and Y. ...

A paper mill produces two grades of paper viz X and Y. Because of raw material restrictions, it cannot produce more than 400 tons of grade X paper and 300 tons of grade Y paper in

Simplex method, how to solve simplex method in LPP?

how to solve simplex method in LPP?

Linear programming, Solve the following Linear Programming Problem using Si...

Solve the following Linear Programming Problem using Simple method. Maximize Z= 3x1 + 2X2 Subject to the constraints: X1+ X2 = 4 X1 - X2 = 2 X1, X2 = 0

Draw a network for the project adn determine the critical pa, a)Draw a netw...

a)Draw a network for the project. b)Determine the critical path. Activity Duration Activity Duration 1-2 15 5-10 22 1-3 13 6-9 33 1-4 1

Conclusions and recommendations , Conclusions and Recommendations  Con...

Conclusions and Recommendations  Conclusions  should  be drawn with  direct  reference to the objectives  of the study. The  readers should  be able  to read the objectives. T

Disadvantage of standard deviation - measure of dispersion, Disadvantage ...

Disadvantage  of standard Deviation It is not  easy  to understand  and calculate. It gives  more  weight  to the extremes  and less  to the items   nearer to mean. Since

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd