Curse of dimensionality, Advanced Statistics

The phrase first spoken by one of the witches in Macbeth. Now this is used to describe the exponential rise in the number of possible locations in the multivariate space as dimensionality increases. Thus the single binary variable has the two probable values, a 10-dimensional binary vector has over the thousand possible values and a 20-dimensional binary vector over the million possible values. This implies that sample sizes should be increase exponentially with the dimension in order to maintain the constant average sample size in the cells of space. Another consequence is that, for the multivariate normal distribution, the vast mass of the probability lies far from the centre of it if the dimensionality is large.

Posted Date: 7/27/2012 1:15:24 AM | Location : United States







Related Discussions:- Curse of dimensionality, Assignment Help, Ask Question on Curse of dimensionality, Get Answer, Expert's Help, Curse of dimensionality Discussions

Write discussion on Curse of dimensionality
Your posts are moderated
Related Questions
The initial evaluation of the set of observations to see whether or not they appear to satisfy the hypotheses or assumptions of the methods to be used in their analysis. Techniques

Range is the difference between the largest and smallest observations in the data set. Commonly used as an easy-to-calculate measure of the dispersion in the set of observations b

Pascal's triangle  is an arrangement of numbers described by Pascal in his Traité du Triangle Arithmétique published in the year 1665 as 'The number in each cell is equal to in the

Attitude scaling : The process of analysing the positions of the individuals on scales purporting to measure attitudes, for instance a liberal-conservative scale, ora risk-willingn

Latent class analysis is a technique of assessing whether the set of observations including q categorical variables, in specific, binary variables, consists of the number of diffe

Correlation matrix : A square, symmetric matrix with the rows and columns corresponding to the variables, in which the non diagonal elements are correlations between the pairs of t

MEANING ,IMPORTANCE AND RELEAVANCE OF SCATTER DIAGRAM

Indirect least squares: An estimation technique used in the fitting of structural equation models. Commonly least squares are first used to estimate reduced form parameters. Usi


The Null Hypothesis - H0: β 1 = 0 i.e. there is homoscedasticity errors and no heteroscedasticity exists The Alternative Hypothesis - H1: β 1 ≠ 0 i.e. there is no homoscedasti