Compute the transition probabilities

Reference no: EM13159626

At all times, an urn contains N balls–some white balls and some black balls. At each stage, a coin having probability p, 0 < p < 1, of landing heads is flipped. If heads appears, then a ball is chosen at random from the urn and is replaced by a white ball. Let Xn denote the number of white balls in the urn after the nth stage.

(a)Is {Xn , n ≥ 0} a Markov chain? If so, explain why?
(b) What are its classes? What are their periods? Are they transient or recurrent?
(c) Compute the transition probabilities Pi,j .
(d) Let N = 2. Find the proportion of time in each state.
(e) Based on your answer in part (d) and your intuition, guess the answer for the limiting probability in the general case.
(f) Prove your guess in part (c)
(g) If p = 1, what is the expected time until there are only white balls in the urn if initially there are i white and N - i black?

Reference no: EM13159626

Questions Cloud

Confidence for the true variance of the product lengths : Lengths had a calculated sample standard deviation of 8 and mean of 9.4. Select the 95% confidence for the true variance of the product lengths. Use the appropriate table in the book.

State when blood is donated sodium oxalate : When blood is donated, sodium oxalate solution is used to precipitate Ca2+, which triggers clotting. A 108mL sample of blood contains 9.7*10^-5g Ca2+/mL

What is one mechanism that could render some viruses : It is unlikely that you will catch distemper from your cat. What is one mechanism that could render some viruses host-specific?

How might that person acquire the disease : If a person eats contaminated meat from a cow that suffered from mad cow disease, how might that person acquire the disease?

Compute the transition probabilities : What are its classes? What are their periods? Are they transient or recurrent? Compute the transition probabilities Pi,j .

Effect of the sale of land problem : In 2011, P Company sells land to its 80% owned subsidiary, S Company, at a gain of $50,000. What is the effect of this sale of land on consolidated net income assuming S Company still owns the land at the end of the year?

Control signals and label : Draw a diagram showing how the 68000 processor connects to a 64 KWord (64KB even + 64 KB odd) RAM IC. Show all relevant address, data, and control signals and label them correctly. Also show the MAD (memory address decoder) in your circuit diagram.

State mechanism of grignard synthesis of malachite green : Draw the mechanism of Grignard Synthesis of Malachite Green. (Ensure that all mechanistic arrows are correctly drawn.) Show the following

How about if you are a franchised dealer : If you are a manufacturer do you necessarily want the gray market to cease to exist? Why or why not? How about if you are a franchised dealer?

User Account

All Pages