Each day you own 0 or 1 stocks of certain commodity. The price of the stock is a stochastic process that can be modeled as a Markov chain with transition rates as follows

		day n+1
		100	200
day n	100	0.5	0.5
	200	0.25	0.75

At the start of a day at which you own a stock you may choose to either sell at the current price, or keep the stock. At the start of a day at which you do not own stock, you may choose to either buy one stock at the current price or do nothing. You have initial capital of 200.

Your target is to maximize the discounted value of the profit over an infinite horizon, use discountfactor 0.8 (per day).

a) Define the states and give for each state the possible decisions.

b) Formulate the optimality equations.

c) Carry out two iterations of value iteration.

d) Formulate the L.P.-model to solve this problem. Describe how you can obtain the optimal policy from the LP formulation.

e) Choose a stationary policy and investigate using the policy iteration algorithm whether or not that policy is optimal.

f) Give the number of stationary policies. Motivate your answer by using the definition of stationary policy.

Posted Date: 3/5/2013 8:10:30 AM | Location : United States

Ask an Expert

Related Discussions:- formulate the optimality equations, Assignment Help, Ask Question on formulate the optimality equations, Get Answer, Expert's Help, formulate the optimality equations Discussions

Write discussion on formulate the optimality equations
Your posts are moderated

Write your message here..

Related Questions

Operation research, Significance of operation research Significance of operation research

Solve the problem using simplex method, #question. A paper mill produces tw... #question. A paper mill produces two grades of paper viz., X and Y. Because of raw material restrictions, it cannot produce more than 400 tons of grade X paper and 300 tons of grad

Scope, explain the significant and scope of operation research in scientifi... explain the significant and scope of operation research in scientific management

Linear Programming, A paper mill produces two grades of paper viz., X and Y... A paper mill produces two grades of paper viz., X and Y. Because of raw material restrictions, it cannot produce more than 400 tons of grade X paper and 300 tons of grade Y paper i

Formulate this as a Linear Programming Problem, A paper mill produces two g... A paper mill produces two grades of paper viz., X and Y. Because of raw material restrictions, it cannot produce more than 400 tons of grade X paper and 300 tons of grade Y pa

Linear regression, regression line drawn as y=c + 1075x, when x was 2, and ... regression line drawn as y=c + 1075x, when x was 2, and y was 239, given that y intercept was 11. calculate the residual

Mb0048, A paper mill produces two grades of paper viz., X and Y. Because of... A paper mill produces two grades of paper viz., X and Y. Because of raw material restrictions, it cannot produce more than 400 tons of grade X paper and 300 tons of grade Y paper i

Question, A paper mill produces two grades of paper viz., X and Y. Because ... A paper mill produces two grades of paper viz., X and Y. Because of raw material restrictions, it cannot produce more than 400 tons of grade X paper and 300 tons of grade Y paper i

Explain the method of taylor scientific management, a. Explain the method o... a. Explain the method of "Taylor's Scientific Management". List the elements of Taylor's Scientific Management. b. List the necessary managerial functions of a Manager. Explain.

Oral presentation - report writing presentation, Oral Presentation At ... Oral Presentation At times  oral presentation of the  results of the study is considered effective particularly in case where  policy recommendations are indicated by project