Formulate this problem as a markov decision process

Assignment Help Basic Statistics
Reference no: EM131104728

A chemical company produces two chemicals, denoted by 0 and 1, and only one can be produced at a time. Each month a decision is made as to which chemical to produce that month. Because the demand for each chemical is predictable, it is known that if 1 is produced this month, there is a 70 percent chance that it will also be produced again next month. Similarly, if 0 is produced this month, there is only a 20 percent chance that it will be produced again next month. To combat the emissions of pollutants, the chemical company has two processes, process A, which is efficient in combating the pollution from the production of 1 but not from 0, and process B, which is efficient in combating the pollution from the production of 0 but not from 1. Only one process can be used at a time. The amount of pollution from the production of each chemical under each process is

Unfortunately, there is a time delay in setting up the pollution control processes, so that a decision as to which process to use must be made in the month prior to the production decision. Management wants to determine a policy for when to use each pollution control process that will minimize the expected total discounted amount of all future pollution with a discount factor of α = 0.5.

(a) Formulate this problem as a Markov decision process by identifying the states, the decisions, and the Cik. Identify all the (stationary deterministic) policies.

(b) Use the policy improvement algorithm to find an optimal policy.

Reference no: EM131104728

Questions Cloud

A chemical company produces two chemicals : A chemical company produces two chemicals, denoted by 0 and 1, and only one can be produced at a time. Each month a decision is made as to which chemical to produce that month.
Prepare a single step income statement for the year ended : Turner Corporation had net sales of $2,400,000 and interest revenue of $31,000 during 2004. Expenses for 2004 were: cost of goods sold $1,250,000; administrative expenses $212,000; selling expenses $280,000; interest expense $45,000.
What are samantha legal rights : Samantha purchased a used computer system from Office Rental Inc. who was updating its computers. Later Big Bank asserted the right to repossess the used computer system from Samantha since it had a lien on all of Office Rental's business equipmen..
Provide java code to create and initialize array of integers : Provide a Java code to create and initialize an array of integers (Java primitive int), floats or any other Java primitive type of your choice
Formulate this problem as a markov decision process : (a) Formulate this problem as a Markov decision process by identifying the states, the decisions, and the Cik. Identify all the (stationary deterministic) policies.
Determine the force in members fg eg and eh : Show transcribed image text The truss shown was designed to support the roof of a food market. For the given loading, determine the force in members FG, EG, and EH. Hint: Method of Section.
Communication theory ashford university discussion : Describe the essential principles of communication and provide examples of its benefits, forms, and purposes. In what ways have you been able to apply these principles in your work and/or studies? Support your response with a minimum of two source..
What factors do you think are associated with difference : Why do you think UCF's alcohol violation rate is so drastically different from the University of Miami? What factors do you think are associated with the difference?
Use the policy improvement algorithm to determine : The price of a certain stock is fluctuating between $10, $20, and $30 from month to month. Market analysts have predicted that if the stock is at $10 during any month, it will be at $10 or $20 the next month, with probabilities 4/5 and 1/5 respect..

Reviews

Write a Review

Basic Statistics Questions & Answers

  She is using an alpha value of 10 to conduct this test

question a researcher is interested in testing to determine if the mean of population one is different than the mean

  Compute the variance and the standard deviation

STA101 - Statistics for Business. A basketball player has the following points for seven games: 20, 25, 32, 18, 19, 22, and 30. Compute the following measures: a) Compute the sample mean (the average of the points of each game) Compute the variance a..

  R-dimensional random vector with the multinomial pmf

Consider a set of n independenttrials in which there are r possible outcomes s1,...,sr for each trial. In each trial, P[si] = pi. Let Ni equal the number of times that outcome si occurs over n trials. What is the joint PMF of N1,..., Nr?

  Probability one shift is unrepresented in sample of workers

The same chance of being selected as does any other group. What is the probability that at least one of the shifts will be unrepresented in the sample of workers?

  In a normal distribution curve with mean as 55 and standard

In a normal distribution curve with mean as 55 and standard deviation as 10 what will be the area on the right side of the curve and how?

  Coefficients of correlation and determination

1. Given the information in Exercise 15.13, deter- mine and interpret the coefficients of correlation and determination for January-May burned acreage in Florida versus January-May rainfall in the state.

  For the standard normal probability distribution the area

for the standard normal probability distribution the area to the right of the mean is -0.5 0.5 1 any value between 0

  Multiple regression-chi-square test statistic

A multiple regression analysis includes 25 data points and 4 independent variables results in SST = 200 and SSR = 150. the multiple standard error of estimate will be?

  Percentage of trucks can be expected to travel

What proportion of trucks can be expected to travel between 58 and 70 thousand miles in a year? What percentage of trucks can be expected to travel either less than 45 or more than 90 thousand miles in a year

  Visual interpretation

Create a visual of the data you collected from the questionnaires - You need to take the data you collected and transfer it into an appropriate visual for your reader

  Are the mpg measurements similar

Refer to Exercise 6.26 (page 371). In addition to the computer computing mpg, the driver also recorded the mpg by dividing the miles driven by the number of gallons at each ?ll-up.

  Probability that more than five will be sick on given Friday

the past many years, the average number of employees absent on Friday is 2.6. Given this data she asks you to compute the probability that more than 5 will be sick on a given Friday.

Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd