Why does shuffling defeat the purpose of k-fold cv

Assignment Help Other Engineering

Reference no: EM131926805

Problem

1. Why is shuffling a dataset before conducting k-fold CV generally a bad idea in finance? What is the purpose of shuffling? Why does shuffling defeat the purpose of k-fold CV in financial datasets?

2. Take a pair of matrices (X, y), representing observed features and labels. These could be one of the datasets derived from the exercises in Chapter 3.

(a) Derive the performance from a 10-fold CV of an RF classifier on (X, y), without shuffling.

(b) Derive the performance from a 10-fold CV of an RF on (X, y), with shuffling.

(d) How does shuffling leak information?

Text Book: Advances in Financial Machine Learning By Marcos Lopez de Prado.

Reference no: EM131926805

Questions Cloud

Compute the rolling standard deviation of two-sampled series : Compute the rolling standard deviation of the two-sampled series. Which one is least heteroscedastic? What is the reason for these results?

What method achieves the lowest test statistic : Apply the Jarque-Bera normality test on returns from the three bar types. What method achieves the lowest test statistic?

What would be the mathematical grounds for disregarding : Suppose that you develop a momentum strategy on a futures contract. What would be the mathematical grounds for disregarding the second result, if any?

What is the key to avoiding selection bias : What if we split the dataset in three sets: training, validation, and testing? What is the key to avoiding selection bias?

Why does shuffling defeat the purpose of k-fold cv : Why is shuffling a dataset before conducting k-fold CV generally a bad idea in finance? Why does shuffling defeat the purpose of k-fold CV in financial dataset?

What can you conclude about productivity improvement : Last year, Chop-M-Up, Inc. implemented a new labor process and redesigned its product, hoping to increase input usage efficiency.

Should the proposed discount be offered : The firm's current average collection period is 60 days, sales are 40,000 units, selling price is $45 per unit, and variable cost per unit is $36.

What break date does the method select : Compute the SDFC (Chow-type) explosiveness test. What break date does this method select? Is this what you expected?

Calculate what the annual payments and interest charges : The market discount rate is assumed to be 6%. Beyond this initial tabulation, estimate the present worth of the annual payments.

User Account

All Pages