Explain ridge regression, Applied Statistics

Using log(x1), log(x2) and log(x3) as the predictors, do pair wise scatterplots of all pairs of variables (including the response) and comment (use the pairs function). Do you think that multi collinearity might be a problem with these data?

Plot the ridge trace for a grid of 50 values for the shrinkage parameter  over the range [0; 1]. Based on this plot suggest a reasonable value for . Find the estimates of the coecients for a ridge re gression with your chosen value of  (using centred and scaled predictors).

(The following question is based on Exercise 8.5 of Myers (1990), Classical and Modern Regression with Applications (Second Edition)," Duxbury).

With centred and scaled predictor variables, the ridge regression estimator for the coecients of the predictors is where y is the vector of responses, X is the design matrix for the centred and scaled predictors, is

1709_basic linear models.png

the shirnkage parameter and I denotes the identity matrix. We write n for the number of observations and k for the number of predictors. Writing biR for the ith component of bR, we will prove in this question that where 2 is the variance of the responses, and vi, i = 1,.......k are the eigenvalues of XTX. The di erent parts of the question below lead you through the proof.

735_basic linear models1.png

(a) Write XTX = QDQT for the eigenvalue decomposition of XTX, where D = diag(v1,........vk) is the diagonal matrix of eigenvalues and Q is an orthogonal matrix (QTQ = I) where the columns are the eigenvectors of XTX. Show that XTX +I = Q(D+I)QT .

2344_basic linear models2.png

where V ar(bR) denotes the covariance matrix of bR. (Hint: recall the result from basic linear models that if Y is a k  1 random vector with V ar(Y ) = V and if A is a k  k matrix and Z = AY then V ar(Z) = AV AT ).

Posted Date: 2/28/2013 12:46:51 AM | Location : United States

Related Discussions:- Explain ridge regression, Assignment Help, Ask Question on Explain ridge regression, Get Answer, Expert's Help, Explain ridge regression Discussions

Write discussion on Explain ridge regression
Your posts are moderated
Related Questions
(a) Average rainfall during the month of January is found to be 58 mm. A Class A pan evaporation recorded an average of 8.12 mm/day near an irrigation reservoir. The average

In this problem, we use the CSDATA data set, which is available in 'CSDATA.txt'. We do ne an indicator variable, say HIGPA, to be 1 if the GPA is 3.0 or better and 0 other- wise. S

Simple Random Sampling In Simple Random Sampling each possible sample has an equal chance of being selected. Further, each item in the entire population also has an equal chan

Multi stage or Cluster Random sampling  Under this method, the random selection is made of primary, intermediate and final units from a given population. The area of investigat

Geometric Mean The geometric mean   of numbers is defined as the th root of the product of numbers .It is obtained by multiplying all the values of a variable and then extracti

Your company has developed a new product .Your company is a reputed company with 50% market share of same range of products. Your competitors also come with their new products equa

Multivariate analysis of variance (MANOVA) is a technique to assess group differences across multiple metric dependent variables simultaneously, based on a set of categorical (non-

Consider an MBA program as a processing network where the flow unit consists of a student in the program.  Suppose the organizations that hire and promote MBAs are considered to be

how can i use continuous frailty in multi state models?

Chemical processors manufacture wondercool using two processes- mixing and distillation. The following details relate to the distillation process for a period. No opening work i