Which source is less predictable and why

Assignment Help Humanities
Reference no: EM131326475

Two discrete memory less information sources X and Y each have an alphabet with six symbols, X = Y = {1, 2, 3, 4, 5, 6}. The probabilities of the letters for X are 1/2, 1/4, 1/8, 1/16, 1/32, and 1/32. The source Y has a uniform distribution.

1. Which source is less predictable and why?

2. Design Huffman codes for each source. Which Huffman code is more efficient? (Efficiency of a Huffman code is defined as the ratio of the source entropy to the average codeword length.)

3. If Huffman codes were designed for the second extension of these sources (i.e., two letters at a time), for which source would you expect a performance improvement compared to the single-letter Huffman code and why?

4. Now assume the two sources are independent and a new source Z is defined to be the sum of the two sources, i.e., Z = X + Y . Determine the entropy of this source, and verify that H(Z)

5. How do you justify the fact that H(Z) < H(X) + H(Y )? Under what circumstances can you have H(Z) = H(X) + H(Y )? Is there a case where you can have H(Z) > H(X) + H(Y )? Why?

Reference no: EM131326475

Questions Cloud

How much would you have at the end of five years : You currently have 10,000,000 to invest and can earn 15% interest compounded annually. How much would you have at the end of 5 years, 10 years, 15 years, and 20 years?
National budget simulation : http://www.econedlink.org/national-budget-simulator.php , work through the National Budget Simulation (Links to an external site.) in an effort to achieve a budget deficit of $1100B dollars.
What is the resulting average codeword length : What is the resulting average codeword length? Compare the average codeword length with the entropy of the source. (In what base would you compute the logarithms in the expression for the entropy for a meaningful comparison?)
Probability of getting a ticket : In deciding to park in an illegal place, any individual knows that the probability of getting a ticket is p and the fine for receiving the ticket is f. Suppose that all individuals are risk averse (that is, U''(W)
Which source is less predictable and why : How do you justify the fact that H(Z) H(X) + H(Y )? Why?
What is gain or loss on the early extinguishment of the bond : ACCT311: What is the gain or loss on the early extinguishment of the bonds? Based on this information, what is the amount of net cash flows from financing activities?
Marginal principle for consumers : Equal Marginal Principle a. Write down the equal marginal principle for consumers. b. When does this condition hold?
What is your impression of some of the core buddhist beliefs : What is your impression of some of the core Buddhist beliefs and which Buddhist teachings caught your attention most
Actual future nominal exchange rate : Continue with the previous question: Suppose the actual future nominal exchange rate et+1 turns out to be higher than what you have calculated in Question #28. If you had already bought the foreign asset, you will ____ this mistake. Your purchase o..

Reviews

Write a Review

 

Humanities Questions & Answers

  Discuss the united states legal system characteristics

Discuss the United States legal system's characteristics, its application and use in American society, and the ways in which it affects country's relations with the global community.

  Calculate the average heat of reaction

The equilibrium constant for the dissociation of N204 has the values 0.664 and 0.141 at the temperatures 318 K and 298 K, respectively. Calculate the average heat of reaction within this temperature range.

  Questionnbsp read the article titled weaving the world

questionnbsp read the article titled weaving the world together. then do the following taskin your own words summarise

  Find the loss in snr due to the mistiming

In a binary PAM system, the clock that specifies the sampling of the correlator output is offset from the optimum sampling time by 10 percent.

  Define and apply social contract theory

Define and apply social contract theory. Is it appropriate for organizations like the one in the video to use a U.S. law (Fair Labor Standards Act of 1938) to offer low wages for its disabled workers? Why or why not?

  Written assignment students will be asked to complete a

written assignment students will be asked to complete a writing assignment on mental health issue 7-10 pages of written

  Calculate the heat capacity of the equilibrium

Calculate the degree of ionization of cesium vapor at 10-6 atm at the two temperatures 2260 K and 2520 K.

  Determine the truth-table of the function

Analyze the logic network in Fig. 2.7 and simplify it by using properties of Boolean expressions. Determine the truth-table of the function realized by this network.

  Discuss differences between staples and regional variation

Discuss the differences between the staples and regional variation in ingredients between northern and southern europeans.

  Write a paper on cultural differences

What are three differences in the way these people communicate compared to the way we in our culture communicate and describe what you have observed about each difference and how you feel about it.

  What different viewpoints and perspectives are presented

Define issue/problem. What are the causes of this problem, or what led up to this policy/law? What group of people is most affected by this problem? Why? How are they affected? What are the potential risks to society and to the people affected b..

  What was the deviant behavior

What was the deviant behavior? - What were the demographics of the group that witnessed the behavior?- How did the group react to the behavior?

Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd