Outliers - reasons for screening data, Advanced Statistics

Assignment Help:

Outliers - Reasons for Screening Data

Outliers are due to data entry errors, subject is not a member of the population that the sample is trying to represent, or the subject is really different. Statistical tests are quite sensitive to outliers so this problem should be addressed.

Univariate outliers are easy to detect (z-scores, box plots, histograms, etc.) standard scores larger than +/-3 are outliers (consider 4 is n>100 or 2.5 if n<10)

Multivariate outliers are difficult to detect. Mahalanobis distance is one powerful technique to use in this case (discussed later). This is evaluated as a chi-square statistic with degrees of freedom equal to number of variables in the analysis. A chi-sqaure statistic value that is significant beyond p<0.001 level determines outliers.

In most cases, it is ok to drop the value from the sample. One can also take steps to reduce the relative influence of outliers if the researcher decides to include the values in the analysis.


Related Discussions:- Outliers - reasons for screening data

Explain markers of disease progression, Markers of disease progression : Qu...

Markers of disease progression : Quantities which form a general monotonic series throughout the course of the disease and assist with its modelling. In uasual such quantities are

Data fusion, The act of combining data from heterogeneous sources with the ...

The act of combining data from heterogeneous sources with the intent of extracting information that would not be available for any single source in isolation. An example is the com

Business forcastin.., elements , importance, limitation, and theories

elements , importance, limitation, and theories

Chebyshev''s inequality, Chebyshev's inequality: A statement about the pro...

Chebyshev's inequality: A statement about the proportion of the observations which fall within some number of the standard deviations of the mean for any of the probability distri

Homework and Assignment assistance for RES610 Course, Interested in 10 hour...

Interested in 10 hour program with twice a week tutoring for 1 hour each. Need tutor to assist with answering the assignment questions for the next 5 weeks.

Determinant, A value related with the square matrix which represents sums a...

A value related with the square matrix which represents sums and products of its elements. For instance, if the matrix is   then the determinant of A (conventionally written as

Data mining, The non-trivial extraction of implicit, earlier unknown and po...

The non-trivial extraction of implicit, earlier unknown and potentially useful information from data, specifically high-dimensional data, using pattern recognition, artificial inte

Latin square, Latin square  is an experimental design targeted at removing ...

Latin square  is an experimental design targeted at removing from the experimental error the variation from two extraneous sources so that a more sensitive test of the treatment ef

Locally weighted regression, Locally weighted regression  is the method of ...

Locally weighted regression  is the method of regression analysis in which the polynomials of degree one (linear) or two (quadratic) are used to approximate regression function in

Explain median absolute deviation (mad), Median absolute deviation (MAD) : ...

Median absolute deviation (MAD) : It is the very robust estimator of the scale given by the following equation   or, in other words we can say that, the median of the absolute

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd