Explain markov chain and steady state probabilities

Assignment Help Mathematics
Reference no: EM13117870

Markov Chain and Steady State Probabilities

1. A production process contains a machine that deteriorates rapidly in both quantity and output under heavy usage, so it is inspected at the end of each day. Immediately after inspection the condition of the machine is noted and classified into one of four possible states:

State
0: good as new
1: Operable - minimum deterioration
2: Operable - major deterioration
3: Inoperable and replaced by a good new machine

The process can be modeled as a Markov Chain with the following transition matrix:

State...............0................1................2...............3
0.....................0................7/8............1/16..........1/16
1.....................0................3/4.............1/8...........1/8
2.....................0.................0...............1/2............1/2
3.....................1.................0................0...............0

a) find the steady state probabilities of being in each state

b) if the daily costs of being in states 0, 1, 2, 3 are $0, $1000, $3000, $6000 respectively, what is the expected long run daily cost?

c) reclassify state 3 as an absorbing state and calculate the expected number of days for a 'good as new' machine to become inoperable.

Reference no: EM13117870

Questions Cloud

How much carbon-14 would remain after 4 half-lives : The half-life of carbon-14 is 5,730 years. If you started with 100.0 g of carbon-14, how much carbon-14 would remain after 4 half-lives.
Determining a person''s blood type prior to receiving : How is it that, unlike polysaccharides such as starch and glycogen, the oligosaccharides on the surface of the plasma membrane can be involved in specific interaction? How is this feature illustrated by determining a person's blood type prior to r..
Probability that at least one televisions does not work : if tow televisions are randomly selected, compute the probability that both televisions work. what is the probability that at least one does not work?
Evaluate the magnitude of the torque about his shoulder : His arm is 70 cm long and has a mass of 4.0 kg. Evaluate the magnitude of the torque about his shoulder if he holds his arm straight out to his side, parallel to the floor?
Explain markov chain and steady state probabilities : A production process contains a machine that deteriorates rapidly in both quantity and output under heavy usage, so it is inspected at the end of each day. Immediately after inspection the condition of the machine is noted and classified into one ..
Use liposomes in an attempt to deliver drugs : Suppose you were planning to use liposomes in an attempt to deliver drugs to a particular type of cell in the body, for example, a fat or muscle cell. Is there any way you might be able to construct the liposome to increase its target specificity?
Galois theory-cubic polynomial : Show how to make a change of variables x' = x - lamda in f (x) = 0 to reduce to a monic equation where the coefficient of x^2 is zero
Comparative outline for the short stories : Write a comparative outline for the short stories "The Lottery" and "A Worn Path."
What is the equilibrium molar concentration of hydrogen : A mixture of 0.1079 M CO (g) and 0.1079 M H2O(g) was allowed to react and come to equilibrium at some temperature. If Kc = 5.668, what is the equilibrium molar concentration of H2 for the reaction.

Reviews

Write a Review

Mathematics Questions & Answers

  Find the test value for two population variances

Find the test value for two population variances

  Make a confidence interval at the 95 percent level

Make a confidence interval at the 95 percent level

  Find whether the given information results in one triangle

Find whether the given information results in one triangle.

  Hypothesis test for single mean

Hypothesis test for single mean

  Solve the system with any method

Solve the system with any method - Find which of the given two pairs are solutions for the following system

  Calculate the value of the appropriate test statistic

Calculate the value of the appropriate test statistic

  Calculate the probability on students

Calculate the probability that a student with an A on the midterm examination will obtain a final grade of A?

  Show the finite graph and vertices

Show the Finite graph and vertices

  Find the p value associated with the test of hypothesis

What is the p-value associated with the test of hypothesis you conducted?

  Can people really identify their favorite brand of cola

Can people really identify their favorite brand of cola.

  How many girls are there in the hall

The ratio of the number of Chinese boys to the number of Malay boys is 5:3.There are 178 more Chinese boys than Malay boys. How many girls are there in the hall?

  What depth will provide a maximum cross sectional area

Applications of quadratic equations: Maxima and minima and What depth will provide a maximum cross sectional area and thereby provide for the greatest flow of water

Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd