Avoiding Over fitting - Artificial intelligence

As  we  discussed  in  the last  lecture,  over fitting  is  a  normal  problem  in machine learning. Decision trees suffer from that, because they are skilled to stop when  they  have  completely  classify  all  the  training  data,  i.e.,  every  branch  is complete  just  far sufficient to  suitably  categories  the  examples important to  the branch. Various ways to overcoming over fitting in decision trees have been used. As summarized by Tom Mitchell, these attempts fit into two types:

·       Stop growing the tree before it reaches excellence.

• Allow the tree to complete grow, and then post-prune some of the branches from it.

The second approach has been found to be more useable in practice. Both methods boil down to the question of shaping the right tree size. See Chapter 3 of Tom Mitchell's book for more detailed explanation of over fitting  prevention in decision tree knowledge.

 

Posted Date: 10/3/2012 1:16:08 AM | Location : United States

Ask an Expert

Related Discussions:- Avoiding over fitting in decision trees, Assignment Help, Ask Question on Avoiding over fitting in decision trees, Get Answer, Expert's Help, Avoiding over fitting in decision trees Discussions

Write discussion on Avoiding over fitting in decision trees
Your posts are moderated

Write your message here..

Related Questions

Identifying stakeholders, I have chosen an imaginary example to illustrate... I have chosen an imaginary example to illustrate the different stakeholder categories. At Home sells a selection of consumer products, currently listed in a paper catalogue, whi

Use string manipulating functions , Write a script that will first initiali... Write a script that will first initialize a string variable that will kept x and y coordinates of a point in the form 'x 3.1 y 6.4'.  Then, use string manipulating functions to ext

How are the instructions provided to computer, Let's answer our second ques... Let's answer our second question first. All computers have a Unit which performs arithmetic and logical functions. This Unit is called as Arithmetic and Logic Unit (ALU). However h

What is system conception, What is system conception? It deals with gen... What is system conception? It deals with genesis of an application and formulating tentative needs. The purpose of the system conception is to defer details and understand what

Difference among the static rams and dynamic ram, Difference among the Stat... Difference among the Static rams and dynamic rams. Static RAM: It is costly as each bit of memory will take around 6 CMOS transistors. More speedy as transistors are us

Computer graphics, equations og character generation equations og character generation

Define functionality of application layer in tcp/ip protocol, Define the fu... Define the functionality of application layer in TCP/IP protocol stack? Function of Application Layer: The top layer within the Internet reference model is the applicatio

Data stream and instruction stream-flynn’s classification, Data Stream an... Data Stream and Instruction Stream The term 'stream' refers to an order or flow of either data operated or instructions on by the computer. In the complete chain of instructi

Interrupts - computer architecture, Interrupts Interrupt-request lin... Interrupts Interrupt-request line o   Interrupt-acknowledge signal o   Interrupt-request signal Interrupt-service routine o   May have no relationship t

Risks by merchant perspective in electronic payment system, What are the ri... What are the risks by merchant's perspective in Electronic Payment Systems? Through merchant's perspective: • Copied or Forged payment instruments • Insufficient funds in