Discuss how we can avoid data leakage in ml

Assignment Help Data Structure & Algorithms

Reference no: EM134046255

Assignment:

Data leakage refers to a mistake make by the creator of a machine learning model in which they accidentally share information between the test and training datasets. For example, Andrew Ng's group had 100k x-rays of 30k patients, meaning 3 images per patient. The paper used random splitting instead of ensuring that all images of a patient was in the same split. Hence the model partially memorized the patients instead of learning to recognize pneumonia in chest x-rays (Example from Wikipedia).

- Give an example of possible data leakage that can be incorporated in the machine learning training process (e.g., your term-project).

- Discuss how we can avoid data leakage in ML.

Reference no: EM134046255

Questions Cloud

Which enables a computer to function as a print server : The print management system for Linux, which enables a computer to function as a print server, is known as what?

Constant decrease in number of capitalist magnates : Along with the constant decrease in the number of capitalist magnates, who unsurp and monopolize all teh advantages of this process of transformation

Should server engineer use to lower priority level of low : What command should the server engineer use to lower the priority level of a low-criticality service on some machines without restarting the application?

Price rises and quantity demanded increases : The price rises and the quantity demanded increases. Here's why: If sellers expect that the price of houses will be higher in the future

Discuss how we can avoid data leakage in ml : Give an example of possible data leakage that can be incorporated in the machine learning training process (e.g., your term-project).

How to run their operation-inform others in same business : How to run their operation and inform others in the same business about their particular formulas, programs, methods, techniques, and processes.

Creative destruction : The emergence of self-driving cars is an example of creative destruction because multiple choice self-driving cars will be less expensive to build

Full production of sweatshirts and applesauce : Currently, the country of Lauronia is at full production of sweatshirts and applesauce.

Supported the needs of those most economically vulnerable : Cecilia, do you have evidence that the 20 million jobs created supported the needs of those most economically vulnerable?

User Account

All Pages