Would you expect the incremental em to be more efficient

Assignment Help Computer Engineering

Reference no: EM131855075

Problem

We now consider how to use the interpretation of the EM as maximizing an energy functional to allow partial or incremental updates over the instances. Consider the EM algorithm of algorithm. In the Compute-ESS we collect the statistics from all the instances. This requires running inference on all the instances. We now consider a procedure that performs partial updates where it update the expected su-cient statistics for some, but not all, of the instances. In particular, suppose we replace this procedure by one that runs inference on a single instance and uses the update to replace the old contribution of the instance with a new one. This procedure, instead of computing all the expected sufficient statistics in each E-step, caches the contribution of each instance to the sufficient statistics, and then updates only a single one in each iteration.

a. Show that the incremental EM algorithm converges to a fixed point of the log-likelihood function. To do so, show that each iteration improves the EM energy functional.

b. How would that analysis generalize if in each iteration the algorithm performs a partial update for k instances (instead of 1)?

c. Assume that the computations in the M-step are relatively negligible compared to the inference in the E-step. Would you expect the incremental EM to be more efficient than standard EM? If so, why?

Reference no: EM131855075

Questions Cloud

Common forms of cell injury and common theme : What is the difference between Common forms of cell injury and Common theme in cell injury?

What is the multi-factor productivity : A company has introduced a process improvement that reduces processing time for each unit, so that output is increased by 25% with less material.

What system alterations should the nurse anticipate : What system alterations should the nurse anticipate in the client with closed head injury/concussion? (This would include acid-base imbalance

How could ma earth create an ethical climate : How effectively do you think Ma Earth is practicing corporate social responsibility in this situation? Explain the reasoning behind your evaluation.

Would you expect the incremental em to be more efficient : Assume that the computations in the M-step are relatively negligible. Would you expect the incremental EM to be more efficient than standard EM? If so, why?

Nursing management of hypovolemic shock : Are there more differences or similarities in then nursing management of hypovolemic shock, cardiogenic shock, and heart failure?

Calculate labor productivity under each system : Compute labor productivity under each system. Use carts per worker per hour as the measure of labor productivity. (Round your answers to 2 decimal places.)

Determine the optimal order quantity : Determine the optimal order quantity. Determine the number of orders per year.

Analyze which messages change after we update the parameters : Analyze which messages change after we update the parameters for P(Xi| Ui). Use this analysis to show how, after an initial pre-computation step.

User Account

All Pages