Explain ridge regression, Applied Statistics

Using log(x1), log(x2) and log(x3) as the predictors, do pair wise scatterplots of all pairs of variables (including the response) and comment (use the pairs function). Do you think that multi collinearity might be a problem with these data?

Plot the ridge trace for a grid of 50 values for the shrinkage parameter  over the range [0; 1]. Based on this plot suggest a reasonable value for . Find the estimates of the coecients for a ridge re gression with your chosen value of  (using centred and scaled predictors).

(The following question is based on Exercise 8.5 of Myers (1990), Classical and Modern Regression with Applications (Second Edition)," Duxbury).

With centred and scaled predictor variables, the ridge regression estimator for the coecients of the predictors is where y is the vector of responses, X is the design matrix for the centred and scaled predictors, is

1709_basic linear models.png

the shirnkage parameter and I denotes the identity matrix. We write n for the number of observations and k for the number of predictors. Writing biR for the ith component of bR, we will prove in this question that where 2 is the variance of the responses, and vi, i = 1,.......k are the eigenvalues of XTX. The di erent parts of the question below lead you through the proof.

735_basic linear models1.png

(a) Write XTX = QDQT for the eigenvalue decomposition of XTX, where D = diag(v1,........vk) is the diagonal matrix of eigenvalues and Q is an orthogonal matrix (QTQ = I) where the columns are the eigenvectors of XTX. Show that XTX +I = Q(D+I)QT .

2344_basic linear models2.png

where V ar(bR) denotes the covariance matrix of bR. (Hint: recall the result from basic linear models that if Y is a k  1 random vector with V ar(Y ) = V and if A is a k  k matrix and Z = AY then V ar(Z) = AV AT ).

Posted Date: 2/28/2013 12:46:51 AM | Location : United States

Related Discussions:- Explain ridge regression, Assignment Help, Ask Question on Explain ridge regression, Get Answer, Expert's Help, Explain ridge regression Discussions

Write discussion on Explain ridge regression
Your posts are moderated
Related Questions
Among the students doing a given course, there are four boys enrolled in the ordinary version of the course, six girls enrolled in the ordinary version of the course,and six boys e

Correspondence analysis is an exploratory technique used to analyze simple two-way and multi-way tables containing measures of correspondence between the rows and colulnns of an

In the case of permanent magnet DC motor whose stator consists of a permanent magnet we can take the field current to be constant (i.e. a constant magnetic field) and it can be sho

Read the following data on the economy of Angoia and answer/respond to the questions/instructions that follow. Unless otherwise stated, the monetary figures are in real billions o

Standard Error The measure of reliability of the estimating equation that we have developed is given by standard error of estimate. The standard error of estimate represented b

Level of Significance: α The main purpose of hypothesis testing is not to question the computed value of the sample statistic, but to make judgment about the difference between

how is a free hand graph secular trend method plotted

Framing of Questionnaire: Questionnaire is a schedule of questions which is sent to the respondents for filling in by them in their own handwriting together the information rel

Of the 6,325 kindergarten students who participated in the study, almost half or 3,052 were eligible for a free lunch program. The categorical variable sesk (1 == free lunch, 2 = n

what is the independent variable in how energetic do people feel after drinking different types of soft drints?