Sigmoid units, Computer Engineering

Sigmoid units:

Always remember that the function inside units take as input the weighted sum, S and of the values coming from the units connected to it. However the function inside sigmoid units calculates the following value that given a real-valued input S: is as

2248_Sigmoid units.png

Whereas e is the base of natural logarithms, e = 2.718... 

Where we plot the output from sigmoid units given various weighted sums as input that looks remarkably like a step function as: 

983_Sigmoid units1.png

Obviously by getting a differentiable function that looks like the step function was the whole point of the exercise. Moreover, not only is this function differentiable but  there the derivative is fairly simply expressed in terms of the function itself as: 

970_Sigmoid units2.png

So note that the output values for the σ function range between but never make it to 0 and 1. It means that e-S is never negative so the denominator of the fraction tends to 0 as S gets very big in the negative direction and then tends to 1 as it gets very big in the positive direction. In fact this tendency happens fairly quickly as: in the middle ground between 0 and 1 is rarely seen means the sharp or near step in the function. Just because of it looking like a step function that we can think of it firing and not-firing as in a perceptron as: if a positive real is input and the output will generally be close to +1 then a negative real is input the output will generally be close to -1.

Posted Date: 1/11/2013 7:11:17 AM | Location : United States







Related Discussions:- Sigmoid units, Assignment Help, Ask Question on Sigmoid units, Get Answer, Expert's Help, Sigmoid units Discussions

Write discussion on Sigmoid units
Your posts are moderated
Related Questions
Question: (a) Explain the three categories of design patterns. Give two examples from each category. (b) When describing a pattern what is the purpose of "The Intent", an

Load address for the first word of the program is called? Ans. load address origin is known as load address for the first word of the program.

Prolog: Still we can take our card game from the previous lecture like a case study for the implementation of a logic-based expert system. So there the rules were: four cards

Equivalence between VHDL and C? There is concept of understanding in C there is structure.Based upon requirement structure provide facility to store collection of various data

Tree (recursive definition) A tree is a finite set of one or more than one nodes such that. (1) There is a specially designated node known as the root. (2) The left over

Explain segmentation? Segment memory addressing divides memory into many segments. Each of these segments can be considered as a linear memory space. Every one of these segmen

Rational RequisitePro is a needed management tool that helps project teams control the development process. RequisitePro organizes your requirements by linking Microsoft Word to a

Write the HTML code for the following table: T E M P E R A T U R E C I T I E S

Q. Approaches for development of information systems? Numerous approaches are available for development of Information Systems. They are as below: • Model Driven: It put e

The sorting method where array to be sorted is partitioned again and again in such a way that all elements less than or equivalent to partitioning element appear before it and thos