## formulate the optimality equations, Operation Research

Assignment Help:

Each day you own 0 or 1 stocks of certain commodity. The price of the stock is a stochastic process that can be modeled as a Markov chain with transition rates as follows

 day n+1 100 200 day n 100 0.5 0.5 200 0.25 0.75

At the start of a day at which you own a stock you may choose to either sell at the current price, or keep the stock. At the start of a day at which you do not own stock, you may choose to either buy one stock at the current price or do nothing. You have initial capital of 200.

Your target is to maximize the discounted value of the profit over an infinite horizon, use discountfactor 0.8 (per day).

a) Define the states and give for each state the possible decisions.

b) Formulate the optimality equations.

c) Carry out two iterations of value iteration.

d) Formulate the L.P.-model to solve this problem. Describe how you can obtain the optimal policy from the LP formulation.

e) Choose a stationary policy and investigate using the policy iteration algorithm whether or not that policy is optimal.

f) Give the number of stationary policies. Motivate your answer by using the definition of stationary policy.

#### Meaning of a research report, Problem The important task ahead of the r...

Problem The important task ahead of the researcher is to document the entire work done in the form of a well-structured research report. Describe in brief the components of a R

#### Concept and need for information, CONCEPT AND NEED FOR INFORMATION: W...

CONCEPT AND NEED FOR INFORMATION: We shall look at the meaning, of information as also the meaning of other related words such as data, facts, intelligence, advice, knowledge

#### Sequencing, how the sequencing techniques help the manager

how the sequencing techniques help the manager

#### Need answer, A paper mill produces two grades of paper viz., X and Y. Becau...

A paper mill produces two grades of paper viz., X and Y. Because of raw material restrictions, it cannot produce more than 400 tons of grade X paper and 300 tons of grade Y paper i

#### Uses of mean deviation - measure of dispersion, Uses  of Mean  Deviation...

Uses  of Mean  Deviation Mean  Deviation  is rarely being used as a measure of dispersion. But  due to  easy  and  simplicity  in calculation. It  is rather  useful  in busin

#### M/M/s queue, How do I use C# to program an M/M/s queue model?

How do I use C# to program an M/M/s queue model?

#### Mathematical Model, What is meant by a mathematical model of a real situati...

What is meant by a mathematical model of a real situation? Discuss the importance of models in the solution of Operations research problems

#### Methods of scientific research, Methods is a tool or a techniques used t...

Methods is a tool or a techniques used to collect data. It is procedure for obtaining knowledge based on empirical observation and logical reasoning. Field Study Metho

#### Linear programming, B A paper mill produces two grades of paper viz., X and...

B A paper mill produces two grades of paper viz., X and Y. Because of raw material restrictions, it cannot produce more than 400 tons of grade X paper and 300 tons of grade Y paper

#### Operation research, Discuss the methodology of operation research

Discuss the methodology of operation research  