Information gain, Computer Engineering

Information Gain:

Now next here instantly return to the problem of trying to determine the best attribute to choose for a particular node in a tree. As in the following measure calculates a numerical value for a given attribute and A and with respect to a set of examples and S. However notice that there the values of attribute A will range over a set of possibilities that we call Values(A), so that for a particular value from that set, v, we write Sv  for the set of examples that have value v for attribute A. 

Moreover the information gain of attribute A, that is relative to a collection of examples, S, is calculated as: 

2074_Information Gain.png

Thus the information gain of an attribute can be seen as the expected reduction in entropy caused through knowing the value of attribute A

Posted Date: 1/11/2013 6:41:41 AM | Location : United States

Related Discussions:- Information gain, Assignment Help, Ask Question on Information gain, Get Answer, Expert's Help, Information gain Discussions

Write discussion on Information gain
Your posts are moderated
Related Questions
A museum has a collection of old posters advertising events of various kinds (theatre, sport, fairs, lectures etc.). It wishes to keep a record of these, containing, for each poste

Define miss rate? It is the number of misses' states as a fraction of attempted accesses.

And-Introduction: In generally English says that "if we know that a lot of things are true, so we know that the conjunction of all of them is true", then we can introduce conj

Q. What is Mini computer? The term minicomputer introduced in 1960's when it was realized that numerous computing tasks don't need an expensive modern mainframe computers howev

Illustrate what are the Multimedia applications Multimedia comprise the use of a computer to present: - Text - Video - Graphics - Sound - Animation In an inte

Higher Order Predicate Logic: In first order predicate logic, we are allowed to quantify over objects only. If we let  ourselves  to  quantify  over  predicate  or  function  s

Explain architecture of World Wide Web with the basic entities. The architecture of the World Wide Web, demonstrated below, is the one of clients, as like Netscape, Lynx or Int

SELECTIVE COMPLEMENT The selective-complement process complements bits in register A where there are corresponding 1's inside register B. It does not affect bit positions which

Number systems   Consider a decimal number:               7654.32   Short hand for:            7 * 103 + 6*102 + 5* 101 + 4*100 + 3*10 -1  + 2*10 -2   Likewise

State about the Data Glove  Data glove is used to grasp a "virtual" object. The glove is constructed with a series of sensors that detect hand and finger motions. Electromagnet