Information gain, Computer Engineering

Information Gain:

Now next here instantly return to the problem of trying to determine the best attribute to choose for a particular node in a tree. As in the following measure calculates a numerical value for a given attribute and A and with respect to a set of examples and S. However notice that there the values of attribute A will range over a set of possibilities that we call Values(A), so that for a particular value from that set, v, we write Sv  for the set of examples that have value v for attribute A. 

Moreover the information gain of attribute A, that is relative to a collection of examples, S, is calculated as: 

2074_Information Gain.png

Thus the information gain of an attribute can be seen as the expected reduction in entropy caused through knowing the value of attribute A

Posted Date: 1/11/2013 6:41:41 AM | Location : United States







Related Discussions:- Information gain, Assignment Help, Ask Question on Information gain, Get Answer, Expert's Help, Information gain Discussions

Write discussion on Information gain
Your posts are moderated
Related Questions
Give difference between assembler and compiler. Assembler: It is the translator for an assembly language of computer. An assembly language is a low-level programming language

Porcess of Identifying Input and Output Values First, recognize what data is going to be used as input to system, and what will be output from system. Input and output values

advantages of dda line algoritm

Which method do you invoke on the DataAdapter control to load  your generated dataset with data? dataAdapter.Fill(ds). The beauty of this method is  it automatically implicitly

Single BUS STRUCTURES : The Bus structure and multiple bus structures are kinds of bus or computing. A bus is fundamentally a subsystem which transfers data amongst the compo

How many types of size categories and data classes are there? There are five size categories (0-4) and 11 data classes only three of which are suitable for application tables:

Swing is a GUI toolkit for Java. It is one kind of the Java Foundation Classes (JFC). Swing haves graphical user interface (GUI) widgets such as text boxes, buttons, split-panes, a

Explain the characteristics of vector processing

Graphs are represented using Adjacency linked list