Sigmoid units-artificial intelligence, Computer Engineering

Assignment Help:

Sigmoid units - Artificial intelligence

Remember that the function inside units take as input the weighted sum, S, of the values coming from the units associated to it. The function inside sigmoid units calculates the following value that given a real-valued input S:

2090_Sigmoid units.png

Where e is the base of natural logarithms, e = 2.718...

When we plot the output from sigmoid units given several weighted sums as input, it seems remarkably like a step function:

 

841_Sigmoid units1.png

Certainly, getting a differentiable function which seems like the step function was the main point of the exercise. Definitely, not only is this function differentiable, but the derivative is fairly expressed simply in terms of the function itself:

1259_Sigmoid units2.png

Notice that the output values for the σ function range between but never make it to 1and 0. This is because e-S is never -ve, and the denominator of the fraction tends to 0 as S gets very large  in the -ve direction, and tends to 1 as it gets very large in the +ve direction. This tendency happens quickly: the middle ground between 0 and 1 is hardly ever seen because of the sharp (near) step in the function. Because of it seems like a step function, we may think of it firing and not-firing as in a perceptron: if a positive real is input, the output will normally be close to +1 and if a negative real is input the output will normally be close to -1.


Related Discussions:- Sigmoid units-artificial intelligence

Determine the uses of defparam, Using defparam Parameter values can be ...

Using defparam Parameter values can be changed in any module instance in the design with keyword defparam. Hierarchical name of the module instance can be used to override para

Structural hazards - computer architecture, Structural hazards - computer a...

Structural hazards - computer architecture: A structural hazard takes place when a part of the processor's hardware is required by 2 or more than two instructions at the same

Explain scientific applications and image processing, Scientific Applicatio...

Scientific Applications/Image processing Major of concurrent processing applications from science and other academic disciplines, are mostly have based on numerical simulations

Define locality of reference, Define locality of reference? What are its ty...

Define locality of reference? What are its types?  During the course of implementation of a program memory references by the processor for both the instruction and the data ten

Explain about hamming error correcting code, Q. Explain about Hamming error...

Q. Explain about Hamming error correcting code? Richard Hamming at Bell Laboratories worked out this code. We will only introduce this code with help of an illustration for 4 b

Node at the highest level in the structure, Node at the highest level in th...

Node at the highest level in the structure is known as?? Root.

Explain clr, What is CLR?  CLR(Common Language Runtime) is the major r...

What is CLR?  CLR(Common Language Runtime) is the major resource of .Net Framework. It is collection of services like garbage collector, exception handler, jit compilers etc. w

What are the layers of data description in r/3, What are the layers of data...

What are the layers of data description in R/3? There layesr are there:- The external layer. The ABAP/4 layer. The database layer.

Running time - metrics for performance evaluation, Running Time - Metrics f...

Running Time - Metrics for performance evaluation: Running time is amount of time consumed in execution of an algorithm for a provided input on N-processor based parallel comp

Meaning of convergence regarding e-commerce, What does the term convergence...

What does the term convergence mean regarding E-commerce? Convergence regarding e-commerce: The capability to leverage and integrate the different data sources and proces

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd