Compute transition probabilities pi

Reference no: EM13108345

At all times, the urn comprises N balls-some white balls and some black balls. At each stage, coin having probability p, 0 < p < 1, of landing heads is flipped. If heads appears, then ball is selected at random from urn and is replaced by white ball. Let Xn denote number of white balls in urn after nth stage.

(a) Is {Xn , n ≥ 0} a Markov chain? If so, describe why?
(b) What are its classes? Write down their periods? Are they transient or recurrent?
(c) Compute transition probabilities Pi,j .
(d) Let N = 2. Determine the proportion of time in each state.
(e) Based on answer in part (d) and your intuition, guess answer for limiting probability in general case.
(f) Prove your guess in part (c)
(g) If p = 1, determine expected time until there are only white balls in urn if initially there are i white and N - i black?

Reference no: EM13108345

Questions Cloud

Null and alternate hypothesis - type of error : Dr. H wants to conduct a statistical test that will show her new medication to be effective in decreasing violence in criminals. What is the null hypothesis? What is the alternate hypothesis?

Determine the project completion date : Bowman Builders manufactures steel storage sheds for commercial use, Joe Bowman, president of Bowman Builders, is contemplating producing sheds for home use.

Five steps of hypothesis testing : Describe the five steps of hypothesis testing. Compare Type I and Type II errors and give specific examples for each. Which error should be minimized the most and first?

Fiscal policy in the current economic situation : Please detail the possibilities of using fiscal policy to stimulate economic activity in Denmark in a situation of economic stagnation among the most important trading partners.

Compute transition probabilities pi : At all times, the urn comprises N balls-some white balls and some black balls. At each stage, coin having probability p, 0

Calculate the mad, mse and mape : The last 4 weekly values of sales were 80,100,105 and 90 units. The last 4 forecast (for the same 4 weeks) were 60, 80, 95 and 75 units. Calculate the MAD, MSE and MAPE for these 4 weeks

Explain the symbolism and significance of the leader work : Choose one leader from the exile or early restoration period. Explain the symbolism and significance of the leader's work and the impact this work had on the nation of Israel. Is that impact still prevalent today? Explain

Purpose for post tests : What is the purpose for post tests? To determine how much difference exists between the treatments.

What proportion of men in the us are 72 inches or taller : What height would a man need to be to fall into the bottom 2%?

User Account

All Pages