Find recurrent and transient classes and periods of states

Assignment Help Mathematics
Reference no: EM131127728

A country has m+1 cities (m ∈ N), one of which is the capital. There is a direct railway connection between each city and the capital, but there are no tracks between any two "non-capital" cities. A traveler starts in the capital and takes a train to a randomly chosen noncapital city (all cities are equally likely to be chosen), spends a night there and returns the next morning and immediately boards the train to the next city according to the same rule, spends the night there, . . . , etc. We assume that his choice of the city is independent of the cities visited in the past. Let {Xn}nN0 be the number of visited non-capital cities up to (and including) day n, so that X= 1, but Xcould be either 1 or 2, etc.

Explain why {Xn}nN0 is a Markov chain on the appropriate state space S and the find the transition probabilities of {Xn}nN0, i.e., write an expression for

P[Xn+1 = j|X= i], for i,j ∈ S.

Find recurrent and transient classes and periods of all states. Sketch the transition graphfor m = 3.

Let τbe the first time the traveler has visited all m non-capital cities, i.e.

τ= min{n ∈ N0 : X= m}.

What is the distribution of τm, for m = 1 and m = 2.

Compute E[τm] for general m ∈ N. (Note: you don't need to use any heavy machinery. In particular, no knowledge of the "absorption and reward" techniques are necessary.)

Reference no: EM131127728

Questions Cloud

What is the expected price of the stock next year : Gordon & Co.'s stock has just paid its annual dividend of $1.10 per share. Analysts believe that Gordon will maintain its historic dividend growth rate of 3%. If the required return is 8%, what is the expected price of the stock next year?
Production manager of manufacturing facility : You are the production manager of a manufacturing facility. There will be a meeting with the Staff to discuss a potential back order that will occur if 10 batches are not produced between now and April 25, 2016. Based on what you learned on setting a..
The key to the cordless elevator : Building elevators are limited to about 800 meters. Above that height, elevator cables become too thick and too heavy for practical use. One solution is to eliminate the cable.
Calculate the peak current and the apparent power : Calculate the peak current and the apparent power supplied to the load.
Find recurrent and transient classes and periods of states : Find recurrent and transient classes and periods of all states - Explain why {Xn}n∈N0 is a Markov chain on the appropriate state space S and the find the transition probabilities
What is the required return on microsoft : Suppose Microsoft, Inc. is trading at $27.29 per share. It pays an annual dividend of $0.32 per share, which is double last year’s dividend of $0.16 per share. If this trend is expected to continue, what is the required return on Microsoft?
Cause the system step response : A control system is shown in Figure AP9.8. The gain K is greater than 500 and less than 3000. Select a gain that will cause the system step response to have an overshoot of less than 20%. Plot the Nichols diagram, and calculate the phase margin.
Misfire company is a small editorial services company : On August 31, 2010, the end of the current year, Misfire Company's accounting clerk prepared the unadjusted trial balance shown on the next page.
What is the current price per share : Huskie Motors just paid an annual dividend of $1.00 per share. Management has promised shareholders to increase dividends at a constant rate of 5%. If the required return is 12%, what is the current price per share?

Reviews

Write a Review

Mathematics Questions & Answers

  Questions on ferris wheel

Prepare a Flexible Budget Gator Divers is a company that provides diving services such as underwater ship repairs to clients in the Tampa Bay area.

  Logistic map

This assignment has two question related to maths. Questions are related to bifurcation cascade and logistic map.

  Finding the probability of cards

This assignment has questions related to probabiltiy.

  Systems of ode

Find all the xed points, and study their stability and Draw the phase portrait of the system, as well as the graphs of the solutions in all relevant cases.

  Derive the boolean expression

Derive the Boolean Expression and construct the switching circuit for the truth table stated

  System of equations

Evaluate which equations are under-identified, just-identified, and over-identified.

  Linear programming problem

Linear programming problem consisting of only two constraints with one objective function.

  Find the natural domain

Find the natural domain of the given functions.

  Introduction to numerical methods

Compute the coecients of the polynomials using the term recurrence relation.

  Chart of the topological manifold

De?nition of smoothness of functions on a smooth manifold is chart independent and hence geometric.

  Mathematics in computing

Questions related on mathematics in computing.

  Complex problems

Complex problems

Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd