Sigmoid units-artificial intelligence, Computer Engineering

Assignment Help:

Sigmoid units - Artificial intelligence

Remember that the function inside units take as input the weighted sum, S, of the values coming from the units associated to it. The function inside sigmoid units calculates the following value that given a real-valued input S:

2090_Sigmoid units.png

Where e is the base of natural logarithms, e = 2.718...

When we plot the output from sigmoid units given several weighted sums as input, it seems remarkably like a step function:

 

841_Sigmoid units1.png

Certainly, getting a differentiable function which seems like the step function was the main point of the exercise. Definitely, not only is this function differentiable, but the derivative is fairly expressed simply in terms of the function itself:

1259_Sigmoid units2.png

Notice that the output values for the σ function range between but never make it to 1and 0. This is because e-S is never -ve, and the denominator of the fraction tends to 0 as S gets very large  in the -ve direction, and tends to 1 as it gets very large in the +ve direction. This tendency happens quickly: the middle ground between 0 and 1 is hardly ever seen because of the sharp (near) step in the function. Because of it seems like a step function, we may think of it firing and not-firing as in a perceptron: if a positive real is input, the output will normally be close to +1 and if a negative real is input the output will normally be close to -1.


Related Discussions:- Sigmoid units-artificial intelligence

What is soap and how does it relate to xml, The Simple Object Access Protoc...

The Simple Object Access Protocol (SOAP) uses XML to describe a protocol for the exchange of information in distributed computing environments. SOAP having of three components: an

Illustrate left shift register with parallel load, Q. Illustrate Left shift...

Q. Illustrate Left shift register with parallel load? A register that shifts data in one direction only is known as Uni-directional shift register and a register that can shift

What are the reasons for feedback in a control system, Question: a) Wha...

Question: a) What are the reasons for feedback in a control system? b) What are the roles of the configuration and fault managers in a real-time system? c) What are stimu

Exit command, Your shell must accept the exit command. This command will ...

Your shell must accept the exit command. This command will be in the form: e x i t When you encounter this command, your shell should terminate. Please note that when you

Dynamic cons, i want dynamic cons simple program in c++

i want dynamic cons simple program in c++

What is c++ reference and java final, What is C++ reference and JAVA final?...

What is C++ reference and JAVA final? Association ends must be bound at initialization and cannot be altered. C++ references can fully enforce these semantics, and the JAVA fin

Advantage of booth and restoring division algorithm, Describe the advantage...

Describe the advantage of using Booth algorithm? Ans:  a) It achieves efficiency in the number of additions needed when the multiplier has a few large blocks of 1's. b) It

Operating system, define request edge and assignment edge

define request edge and assignment edge

What do you mean by complexity of an algorithm, What do you mean by complex...

What do you mean by complexity of an algorithm? The term complexity is used to define the performance of an algorithm. Typically performance is calculated in terms of time or s

Drawbacks of specifying parameter assignments using defparam, The disadvant...

The disadvantages of specifying parameter assignments using defparam are: -  Parameter  is  essentially specified  by  the  scope  of  hierarchies  underneath  which  it exists

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd