Sigmoid units, Computer Engineering

Sigmoid units:

Always remember that the function inside units take as input the weighted sum, S and of the values coming from the units connected to it. However the function inside sigmoid units calculates the following value that given a real-valued input S: is as

2248_Sigmoid units.png

Whereas e is the base of natural logarithms, e = 2.718... 

Where we plot the output from sigmoid units given various weighted sums as input that looks remarkably like a step function as: 

983_Sigmoid units1.png

Obviously by getting a differentiable function that looks like the step function was the whole point of the exercise. Moreover, not only is this function differentiable but  there the derivative is fairly simply expressed in terms of the function itself as: 

970_Sigmoid units2.png

So note that the output values for the σ function range between but never make it to 0 and 1. It means that e-S is never negative so the denominator of the fraction tends to 0 as S gets very big in the negative direction and then tends to 1 as it gets very big in the positive direction. In fact this tendency happens fairly quickly as: in the middle ground between 0 and 1 is rarely seen means the sharp or near step in the function. Just because of it looking like a step function that we can think of it firing and not-firing as in a perceptron as: if a positive real is input and the output will generally be close to +1 then a negative real is input the output will generally be close to -1.

Posted Date: 1/11/2013 7:11:17 AM | Location : United States







Related Discussions:- Sigmoid units, Assignment Help, Ask Question on Sigmoid units, Get Answer, Expert's Help, Sigmoid units Discussions

Write discussion on Sigmoid units
Your posts are moderated
Related Questions
The Concept of Process Informally, a method is a program in execution, behind the program has been loaded in the main memory. However, a method is more than just a program code

The process of importing data from one more Access database follows these common steps they are. ? Preparing the document for import operation and make ensure that extensions ar

Functionality first and then Security?

Evaluation Functions: Evaluation functions calculate approximately the score which can be prove of guaranteed if a particular world state is reached. Same like in chess, evalu

Intuitively Simple - User Friendliness This is the degree to which the system operates in congruence with human operation, in effect the machine does what we naturally think i

Or-Introduction : Thus if we know about one thing is true, and also we know that a sentence when there thing is in a disjunction is true. Here if we consider example, like we

OLAP is called as online analytical processing which gives answers to queries which are multi dimensional in nature. It composes relational reporting and data mining for giving sol

Q. Types of messages? The messages can be of many types.  A specific field of all messages may be reserved to signify message type.  The message passing primitives are like thi

All SAP Databases are Relational Databases is the all sap databases.

Discuss about Constrained-Random Verification Methodology Advent  of  constrained-random  verification  gives  verification  engineers  an  effective  method  to achieve covera