Each day you own 0 or 1 stocks of certain commodity. The price of the stock is a stochastic process that can be modeled as a Markov chain with transition rates as follows

		day n+1
		100	200
day n	100	0.5	0.5
	200	0.25	0.75

At the start of a day at which you own a stock you may choose to either sell at the current price, or keep the stock. At the start of a day at which you do not own stock, you may choose to either buy one stock at the current price or do nothing. You have initial capital of 200.

Your target is to maximize the discounted value of the profit over an infinite horizon, use discountfactor 0.8 (per day).

a) Define the states and give for each state the possible decisions.

b) Formulate the optimality equations.

c) Carry out two iterations of value iteration.

d) Formulate the L.P.-model to solve this problem. Describe how you can obtain the optimal policy from the LP formulation.

e) Choose a stationary policy and investigate using the policy iteration algorithm whether or not that policy is optimal.

f) Give the number of stationary policies. Motivate your answer by using the definition of stationary policy.

Posted Date: 3/5/2013 8:10:30 AM | Location : United States

Ask an Expert

Related Discussions:- formulate the optimality equations, Assignment Help, Ask Question on formulate the optimality equations, Get Answer, Expert's Help, formulate the optimality equations Discussions

Write discussion on formulate the optimality equations
Your posts are moderated

Write your message here..

Related Questions

Modi, there are 5 plants located in different cities and manufacturer a com... there are 5 plants located in different cities and manufacturer a common produt A

Find out where you should now invest your money, Question : Suppose tha... Question : Suppose that you want to invest $10000 in the stock market by buying shares in one of two companies: A and B. Shares in Company A are risky but could yield a 50% ret

Linear Programming , A Paper mill produces two grades of paper viz. X and ... A Paper mill produces two grades of paper viz. X and Y. Because of raw material restrictions, it cannot produce more than 400 tons of grade X paper and 300 tons of grade Y paper in

Theoretical framework, Ask questiAvatars are virtual characters that can be... Ask questiAvatars are virtual characters that can be used as representatives of a company that is using the Internet as a distribution channel. For instance, avatars can be used as

Vogel approximation methods, This method is more  systematic and orderly th... This method is more  systematic and orderly than least cost method. Here penalties for each column and row of the transportation table are determined, and the row  or  column with

Assingment MB0048 Q. No. 2, pls. send me solved ans. on my email : pls. send me solved ans. on my email :

One sample tests- hypothesis testing , One Sample Tests The one sample... One Sample Tests The one sample test is  applied  to a situation where  only a single sample ( one  sample) is taken from  a population in this test the researcher may  be tak

PERT/CPM and Game theory, #questionC++ Program for PERT/CPM and Game theory... #questionC++ Program for PERT/CPM and Game theory..

Linear programing, Solve the following Linear Programming Problem using Sim... Solve the following Linear Programming Problem using Simple method. Maximize Z= 3x1 + 2X2 Subject to the constraints: X1+ X2 = 4 X1 - X2 = 2 X1, X2 = 0

Set of pareto optimal policies, Problem: A policy maker is considering seve... Problem: A policy maker is considering several policy options that lead to different utility levels of different individuals a) Which Policy is would be optimal according t