Curse of dimensionality, Advanced Statistics

The phrase first spoken by one of the witches in Macbeth. Now this is used to describe the exponential rise in the number of possible locations in the multivariate space as dimensionality increases. Thus the single binary variable has the two probable values, a 10-dimensional binary vector has over the thousand possible values and a 20-dimensional binary vector over the million possible values. This implies that sample sizes should be increase exponentially with the dimension in order to maintain the constant average sample size in the cells of space. Another consequence is that, for the multivariate normal distribution, the vast mass of the probability lies far from the centre of it if the dimensionality is large.

Posted Date: 7/27/2012 1:15:24 AM | Location : United States

Related Discussions:- Curse of dimensionality, Assignment Help, Ask Question on Curse of dimensionality, Get Answer, Expert's Help, Curse of dimensionality Discussions

Write discussion on Curse of dimensionality
Your posts are moderated
Related Questions
After graduating from Tech Julia was unable to find regular employment and approached the Director of Athletics at Tech to request that she remain a vendor of the following year.

1. You are interested in investigating if being above or below the median income (medloinc) impacts ACT means (act94) for schools. Complete the necessary steps to examine univariat

Why Graph theory? It is the branch of mathematics concerned with the properties of sets of points (vertices or nodes) some of which are connected by the lines known as the edges. A

It is an informal method of assessing the effect of the publication bias, generally in the context of the meta-analysis. The effect measures from each of the reported study are plo

Generalized method of moments (gmm) is the estimation method popular in econometrics which generalizes the method of the moments estimator. Essentially same as what is known as the

Conjugate prior : The distribution for samples from the particular probability distribution such that the posterior distribution at each stage of the sampling is of the identical f

Compound symmetry : The property possessed by the variance-covariance matrix of the set of multivariate data when its chief diagonal elements are equal to each other, and in additi

Principal components regression analysis is a process often taken in use to overcome the problem of multicollinearity in the regression, when simply deleting a number of the expla


Classification and regression tree technique (CART): The alternative to the multiple regression and associated techniques or methods for determining subsets of the explanatory va