Curse of dimensionality, Advanced Statistics

The phrase first spoken by one of the witches in Macbeth. Now this is used to describe the exponential rise in the number of possible locations in the multivariate space as dimensionality increases. Thus the single binary variable has the two probable values, a 10-dimensional binary vector has over the thousand possible values and a 20-dimensional binary vector over the million possible values. This implies that sample sizes should be increase exponentially with the dimension in order to maintain the constant average sample size in the cells of space. Another consequence is that, for the multivariate normal distribution, the vast mass of the probability lies far from the centre of it if the dimensionality is large.

Posted Date: 7/27/2012 1:15:24 AM | Location : United States







Related Discussions:- Curse of dimensionality, Assignment Help, Ask Question on Curse of dimensionality, Get Answer, Expert's Help, Curse of dimensionality Discussions

Write discussion on Curse of dimensionality
Your posts are moderated
Related Questions

Mann Whitney test is a distribution free test which is used as an alternative to the Student's t-test for assessing that whether the two populations have the same median. The test

Interested in 10 hour program with twice a week tutoring for 1 hour each. Need tutor to assist with answering the assignment questions for the next 5 weeks.

A value related with the square matrix which represents sums and products of its elements. For instance, if the matrix is   then the determinant of A (conventionally written as

Randomized response technique : The procedure for collecting the information on sensitive issues by means of the survey, in which an element of chance is introduced as to what quer

The term used for the estimation of the misclassification rate in the discriminant analysis. Number of techniques has been proposed for two-group situation, but the multiple-group

Categorical variable : A variable which provides the appropriate label of observation after the allocation to one of the several possible categories, for instance, the respiratory

Play-the-winner rule is a process sometimes considered in the clinical trials in which the response to treatment is positive (a success) or negative (a failure). One of two treatm

Missing values : The observations missing from the set of data for some of the reason. In longitudinal studies, for instance, they might occur because subjects drop out of the stud

Modern hotels and certain establishments make use of an electronic door lock system. To open a door an electronic card is inserted into a slot. A green light indicates that the doo