Sigmoid units, Computer Engineering

Sigmoid units:

Always remember that the function inside units take as input the weighted sum, S and of the values coming from the units connected to it. However the function inside sigmoid units calculates the following value that given a real-valued input S: is as

2248_Sigmoid units.png

Whereas e is the base of natural logarithms, e = 2.718... 

Where we plot the output from sigmoid units given various weighted sums as input that looks remarkably like a step function as: 

983_Sigmoid units1.png

Obviously by getting a differentiable function that looks like the step function was the whole point of the exercise. Moreover, not only is this function differentiable but  there the derivative is fairly simply expressed in terms of the function itself as: 

970_Sigmoid units2.png

So note that the output values for the σ function range between but never make it to 0 and 1. It means that e-S is never negative so the denominator of the fraction tends to 0 as S gets very big in the negative direction and then tends to 1 as it gets very big in the positive direction. In fact this tendency happens fairly quickly as: in the middle ground between 0 and 1 is rarely seen means the sharp or near step in the function. Just because of it looking like a step function that we can think of it firing and not-firing as in a perceptron as: if a positive real is input and the output will generally be close to +1 then a negative real is input the output will generally be close to -1.

Posted Date: 1/11/2013 7:11:17 AM | Location : United States







Related Discussions:- Sigmoid units, Assignment Help, Ask Question on Sigmoid units, Get Answer, Expert's Help, Sigmoid units Discussions

Write discussion on Sigmoid units
Your posts are moderated
Related Questions
Layout view is helpful for laying out Web pages. However you can adjust most of your design elements in Layout view, certain changes should be completed in Standard view. When you

Q. Explain working of Digital camera? A Digital camera is a camera which captures and stores still images and video (Digital Video Cameras) as digital data in place of on photo

The Concept of Thread Thread is a chronological flow of control within a process. A process can include one or more threads. Threads have their own register values and program

Discuss about OS as system software? OS is a large program or actually a collection of routines that is used to control the sharing of and interaction between various computer

Write a BASH/C shell script which takes a name of a directory as a command line argument, and prints unique login name of the users having files in that directory. Your code should

Problem : (a) The concept of an agent is generally defined by listing the properties that agents exhibit. Identify and describe the properties that you would associate with th

Public Key Encryption A cryptographic system that uses two-keys-a public  key known to everyone and a private or secret key known only to the recipient of the message. An si

What does the 'SUPPRESS DIALOG' do? Suppressing of whole screens is possible with this command.  This command permits us to perform screen processing "in the background".  Sup

What are the advantages and disadvantages of a Smart Card?    Advantages of Smart Card: 1. It gives convenience & support for multiple currencies over borders. 2. Used

Q. Show Sample Instruction Format of MIPS instruction? Early MIPS architectures had 32-bit instructions and later versions have 64-bit implementations. The first commercial