Avoiding Over fitting - Artificial intelligence

As  we  discussed  in  the last  lecture,  over fitting  is  a  normal  problem  in machine learning. Decision trees suffer from that, because they are skilled to stop when  they  have  completely  classify  all  the  training  data,  i.e.,  every  branch  is complete  just  far sufficient to  suitably  categories  the  examples important to  the branch. Various ways to overcoming over fitting in decision trees have been used. As summarized by Tom Mitchell, these attempts fit into two types:

·       Stop growing the tree before it reaches excellence.

• Allow the tree to complete grow, and then post-prune some of the branches from it.

The second approach has been found to be more useable in practice. Both methods boil down to the question of shaping the right tree size. See Chapter 3 of Tom Mitchell's book for more detailed explanation of over fitting  prevention in decision tree knowledge.

 

Posted Date: 10/3/2012 1:16:08 AM | Location : United States

Ask an Expert

Related Discussions:- Avoiding over fitting in decision trees, Assignment Help, Ask Question on Avoiding over fitting in decision trees, Get Answer, Expert's Help, Avoiding over fitting in decision trees Discussions

Write discussion on Avoiding over fitting in decision trees
Your posts are moderated

Write your message here..

Related Questions

Using library methods returns number of threads, Q. Using Library methods r... Q. Using Library methods returns number of threads? #include void subdomain(float x[ ], int istart, int ipoints) { int i; for (i = 0; i x[istart+i] = 123.456;

Define deadlock, Define deadlock. A process requests resources; if the ... Define deadlock. A process requests resources; if the resources are not available at that time, the method enters a wait state. Waiting processes might never again change state

Define memory cell, Define memory cell? A memory cell is capable of sto... Define memory cell? A memory cell is capable of storing single bit of information. It is usually organized in the form of an array

Microprocessors and interfaces, #question.write cycle timing diagram for ma... #question.write cycle timing diagram for maximum mode of 8086 microprocessor.

Explain about bus of register transfer, Explain about Bus of register trans... Explain about Bus of register transfer Since a computer has   several registers, paths must be provided to transfer information among registors. If separate lines are used amon

Illustrate when are intermolecular forces the strongest, Q. Illustrate when... Q. Illustrate when are intermolecular forces the strongest? Answer:- Intermolecular forces dispersion and dipole-dipole and hydrogen bonds. These forces are feeble than ch

The concept of electronic cash, The concept of electronic cash is to implem... The concept of electronic cash is to implement payment by Using computers over network

Generation of erp products, 1. How does this new generation of ERP products... 1. How does this new generation of ERP products differ from traditional solutions? 2. What are the major external forces driving competition in the ERP industry? Cloud comput

Define the concept of encapsulation of OOA, Encapsulation of OOA Encap... Encapsulation of OOA Encapsulation separates the interface of an abstraction from its implementation. By taking the above example i.e. of a car, we can now categorize them as:

What is the difference between awt and swt, SWT (Standard Widget Toolkit) i... SWT (Standard Widget Toolkit) is a totally independent Graphical User Interface (GUI) toolkit from IBM. They formed it for the creation of Eclipse Integrated Development Environmen