formulate the optimality equations, Operation Research

Each day you own 0 or 1 stocks of certain commodity. The price of the stock is a stochastic process that can be modeled as a Markov chain with transition rates as follows

 

 

day n+1

 

 

 

100

200

day n

100

0.5

0.5

 

200

0.25

0.75

At the start of a day at which you own a stock you may choose to either sell at the current price, or keep the stock. At the start of a day at which you do not own stock, you may choose to either buy one stock at the current price or do nothing. You have initial capital of 200.

Your target is to maximize the discounted value of the profit over an infinite horizon, use discountfactor 0.8 (per day).

a) Define the states and give for each state the possible decisions.

b) Formulate the optimality equations.

c) Carry out two iterations of value iteration.

d) Formulate the L.P.-model to solve this problem. Describe how you can obtain the optimal policy from the LP formulation.

e) Choose a stationary policy and investigate using the policy iteration algorithm whether or not that policy is optimal.

f) Give the number of stationary policies. Motivate your answer by using the definition of stationary policy.

Posted Date: 3/5/2013 8:10:30 AM | Location : United States







Related Discussions:- formulate the optimality equations, Assignment Help, Ask Question on formulate the optimality equations, Get Answer, Expert's Help, formulate the optimality equations Discussions

Write discussion on formulate the optimality equations
Your posts are moderated
Related Questions
Line Balancing Methods - Heuristic Approach  Heuristic mean serving to find i.e. to find out discover things for oneself. Heuristic describes a particular approach to problem so




The Operations Function has always relied heavily on information for its smooth running. During this course information has been introduced as one of the five inputs to the convers

Write a note on tracing a closed loop. What are the characteristic features of a closed loop?

A paper mill products two grade of paper viz., X & Y. Because of raw material restriction, it cannot produce more than 400 tons of grade X paper & 300 tons of grade Y paper in a we

Research Methodology 1. Discuss how the research will be executed to achieve the proposed research objectives. The methodology should be based on the methods that are used in

Solved LP Sample Assignment & Questions A person desires to decide the ingredients of a diet which will satisfy his routine necessities of fats, proteins, and carbohydrates at

Uses  of Mean  Deviation Mean  Deviation  is rarely being used as a measure of dispersion. But  due to  easy  and  simplicity  in calculation. It  is rather  useful  in busin