Sigmoid units-artificial intelligence, Computer Engineering

Assignment Help:

Sigmoid units - Artificial intelligence

Remember that the function inside units take as input the weighted sum, S, of the values coming from the units associated to it. The function inside sigmoid units calculates the following value that given a real-valued input S:

2090_Sigmoid units.png

Where e is the base of natural logarithms, e = 2.718...

When we plot the output from sigmoid units given several weighted sums as input, it seems remarkably like a step function:

 

841_Sigmoid units1.png

Certainly, getting a differentiable function which seems like the step function was the main point of the exercise. Definitely, not only is this function differentiable, but the derivative is fairly expressed simply in terms of the function itself:

1259_Sigmoid units2.png

Notice that the output values for the σ function range between but never make it to 1and 0. This is because e-S is never -ve, and the denominator of the fraction tends to 0 as S gets very large  in the -ve direction, and tends to 1 as it gets very large in the +ve direction. This tendency happens quickly: the middle ground between 0 and 1 is hardly ever seen because of the sharp (near) step in the function. Because of it seems like a step function, we may think of it firing and not-firing as in a perceptron: if a positive real is input, the output will normally be close to +1 and if a negative real is input the output will normally be close to -1.


Related Discussions:- Sigmoid units-artificial intelligence

What is the meaning of toggle in a JK flip flop, In a JK Flip-Flop, toggle ...

In a JK Flip-Flop, toggle means ? Ans. Change the output to the opposite state implies the meas of toggle, in a JK Flip-Flop.

Explain high performance of instruction execution, Q. Explain High performa...

Q. Explain High performance of Instruction execution? High performance of Instruction execution: While mapping of HLL to machine instruction the compiler favours relatively sim

Eme, state function and path function

state function and path function

Address translation - computer architecture, Address translation: ...

Address translation: Compiler time : If it is known in advance that a program will reside at a particular location of primary memory, and then the compiler can be told to

Why is translation look-aside buffers important, Why is Translation Look-as...

Why is Translation Look-aside Buffers (TLBs) important? The implementation of page-table is completed in the following manner: Page table is maintained in main memory.

Explain naming convention libraries, Explanation:- Common used functions...

Explanation:- Common used functions are placed in libraries. These are located in the SQABas32 subdirectory of the Robot working directory. A library is separated into three fil

Probabilistic hough transformation, The probabilistic Hough transform uses ...

The probabilistic Hough transform uses random sampling instead of an accumulator array. In this approach the number of random samples r, is not specified in the OpenCV call, but

Dataflow computing, Dataflow Computing A different to the von Neumann m...

Dataflow Computing A different to the von Neumann model of computation is the dataflow computation model. In a dataflow model, control is fixed to the flow of data. The order o

What are the languages evolved in the html open standard, What are the lang...

What are the languages evolved in the html open standard Even the companies or developers themselves have been affected with such modifications to the open standards since they

Is the basic list deleted when the new list is created, Is the basic list d...

Is the basic list deleted when the new list is created? No.  It is not removed and you can return back to it using one of the standard navigation functions like clicking on th

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd