Which source is less predictable and why

Assignment Help Humanities
Reference no: EM131326475

Two discrete memory less information sources X and Y each have an alphabet with six symbols, X = Y = {1, 2, 3, 4, 5, 6}. The probabilities of the letters for X are 1/2, 1/4, 1/8, 1/16, 1/32, and 1/32. The source Y has a uniform distribution.

1. Which source is less predictable and why?

2. Design Huffman codes for each source. Which Huffman code is more efficient? (Efficiency of a Huffman code is defined as the ratio of the source entropy to the average codeword length.)

3. If Huffman codes were designed for the second extension of these sources (i.e., two letters at a time), for which source would you expect a performance improvement compared to the single-letter Huffman code and why?

4. Now assume the two sources are independent and a new source Z is defined to be the sum of the two sources, i.e., Z = X + Y . Determine the entropy of this source, and verify that H(Z)

5. How do you justify the fact that H(Z) < H(X) + H(Y )? Under what circumstances can you have H(Z) = H(X) + H(Y )? Is there a case where you can have H(Z) > H(X) + H(Y )? Why?

Reference no: EM131326475

Questions Cloud

How much would you have at the end of five years : You currently have 10,000,000 to invest and can earn 15% interest compounded annually. How much would you have at the end of 5 years, 10 years, 15 years, and 20 years?
National budget simulation : http://www.econedlink.org/national-budget-simulator.php , work through the National Budget Simulation (Links to an external site.) in an effort to achieve a budget deficit of $1100B dollars.
What is the resulting average codeword length : What is the resulting average codeword length? Compare the average codeword length with the entropy of the source. (In what base would you compute the logarithms in the expression for the entropy for a meaningful comparison?)
Probability of getting a ticket : In deciding to park in an illegal place, any individual knows that the probability of getting a ticket is p and the fine for receiving the ticket is f. Suppose that all individuals are risk averse (that is, U''(W)
Which source is less predictable and why : How do you justify the fact that H(Z) H(X) + H(Y )? Why?
What is gain or loss on the early extinguishment of the bond : ACCT311: What is the gain or loss on the early extinguishment of the bonds? Based on this information, what is the amount of net cash flows from financing activities?
Marginal principle for consumers : Equal Marginal Principle a. Write down the equal marginal principle for consumers. b. When does this condition hold?
What is your impression of some of the core buddhist beliefs : What is your impression of some of the core Buddhist beliefs and which Buddhist teachings caught your attention most
Actual future nominal exchange rate : Continue with the previous question: Suppose the actual future nominal exchange rate et+1 turns out to be higher than what you have calculated in Question #28. If you had already bought the foreign asset, you will ____ this mistake. Your purchase o..

Reviews

Write a Review

Humanities Questions & Answers

  Write a paper about greek beliefs practices and rituals

Write a paper about GREEK BELIEFS, PRACTICES AND RITUALS.

  Prepare 750- word paper in which you describe a minimum of

prepare 750- word paper in which you describe a minimum of one crisis management situations associated with physical or

  Write the mesh equations for each of the networks

Write the mesh equations for each of the networks of Fig. 8.110, and, using determinants, solve for the loop currents in each network. Use clockwise mesh currents.

  Answer the questions from case poverty in america

Does the existence of poverty imply that our socioeconomic system is unjust? - Does the concentration of poverty in certain groups make it more unjust than it would be otherwise?

  By creating awareness of oppression and arousing sympathy

by creating awareness of oppression and arousing sympathy of supporters the arts can be a form of protest. identify and

  Write a paper about the documentary bigger than enron

Write a paper about the documentary "Bigger Than Enron".

  You have been hired to design an advertisement for a

you have been hired to design an advertisement for a gubernatorial candidate in your state. your ad may support or

  This is a grammar question regarding the verb conserve

this is a grammar question regarding the verb conserve. websters dictionary says it is a transitive verb and i have

  Write bibliography paper about domestic violence on women

Write an annotated bibliography about domestic violence on women. just find an article cite it and follow instruction i will be attaching the sample

  How was photography used as an instrument for social reform

How was photography used as an instrument for social reform? What photograph do you think makes the most powerful social commentary? Why?

  Determine the value of w

The bandwidth W of the pulse x(t) is defined as that value of W for which X(W)/X(0) = 0.01, where X( f ) is the Fourier transform of x(t). Determine the value of W and compare this value to that of raised cosine spectrum with 100 percent roll off.

  Question 1nbsp in the epic of gilgamesh what happened to

question 1nbsp in the epic of gilgamesh what happened to the plant of rejuvenation given to gilgamesh by utanapishtim?

Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd