Curse of dimensionality, Advanced Statistics

The phrase first spoken by one of the witches in Macbeth. Now this is used to describe the exponential rise in the number of possible locations in the multivariate space as dimensionality increases. Thus the single binary variable has the two probable values, a 10-dimensional binary vector has over the thousand possible values and a 20-dimensional binary vector over the million possible values. This implies that sample sizes should be increase exponentially with the dimension in order to maintain the constant average sample size in the cells of space. Another consequence is that, for the multivariate normal distribution, the vast mass of the probability lies far from the centre of it if the dimensionality is large.

Posted Date: 7/27/2012 1:15:24 AM | Location : United States







Related Discussions:- Curse of dimensionality, Assignment Help, Ask Question on Curse of dimensionality, Get Answer, Expert's Help, Curse of dimensionality Discussions

Write discussion on Curse of dimensionality
Your posts are moderated
Related Questions
Negative binomial distribution is the probability distribution of number of failures, X, before the kth success in the sequence of Bernoulli trials where the probability of succes

Model is the description of the supposed structure of a set of observations which can range from a fairly imprecise verbal account to, more commonly, a formalized mathematical exp

Bimodal distribution : The probability distribution, or we can simply say the frequency distribution, with two modes. Figure 15 shows the example of each of them

Records on the computer manufacturing process at Pratt-Zungia Limited show that the percentage of defective computers sent to  customers has been 5% over the last few years. Shipme

Software which started out as the spreadsheet targeting at manipulating the tables of number for financial analysis, which has now developed into a more flexible package for workin

The GRE has a combined verbal and quantitative mean of 1000 and a standard deviation of 200.

Chernoff's faces : A method or technique for representing the multivariate data graphically. Each observation is represented by the computer-created face, the features of which are

The non-trivial extraction of implicit, earlier unknown and potentially useful information from data, specifically high-dimensional data, using pattern recognition, artificial inte

Geometric distribution: The probability distribution of the number of trials (N) before the first success in the sequence of Bernoulli trials. Specifically the distribution is can

The linear component ηi, de?ned just in the traditional way: η i = x' 1 A monotone differentiable link function g that describes how E(Yi) = µi is related to the linear compon