Curse of dimensionality, Advanced Statistics

The phrase first spoken by one of the witches in Macbeth. Now this is used to describe the exponential rise in the number of possible locations in the multivariate space as dimensionality increases. Thus the single binary variable has the two probable values, a 10-dimensional binary vector has over the thousand possible values and a 20-dimensional binary vector over the million possible values. This implies that sample sizes should be increase exponentially with the dimension in order to maintain the constant average sample size in the cells of space. Another consequence is that, for the multivariate normal distribution, the vast mass of the probability lies far from the centre of it if the dimensionality is large.

Posted Date: 7/27/2012 1:15:24 AM | Location : United States







Related Discussions:- Curse of dimensionality, Assignment Help, Ask Question on Curse of dimensionality, Get Answer, Expert's Help, Curse of dimensionality Discussions

Write discussion on Curse of dimensionality
Your posts are moderated
Related Questions
Pie chart is an extensively used graphical technique for presenting relative frequencies related with the observed values of the categorical variable. The chart comprises of a cir


2 jobs n machines,graphical method,how to determine which job should proceed first on each machine

Length-biased sampling : The bias which arises in the sampling scheme based on the visits of patient, when some individuals are more likely to be chosen than others simply because

The functions of the data and the parameters of interest which can be brought in use to conduct inference about the parameters when full distribution of the observations is unknown

Mann Whitney test is a distribution free test which is used as an alternative to the Student's t-test for assessing that whether the two populations have the same median. The test

Blinding : A procedure used in clinical trials to get rid of the possible bias which might be introduced if the patient and/or the doctor knew which treatment the patient is receiv

ain why the simulated result doesn''t have to be exact as the theoretical calculation

Incidental parameter problem is a problem which sometimes occurs when the number of parameters increases in the tandem with the number of observations. For instance, models for pa

Quittingill effect is a  problem which occurs most frequently in studies of the smoker cessation where smokers frequently quit smoking following the onset of the disease symptoms