Sigmoid units-artificial intelligence, Computer Engineering

Assignment Help:

Sigmoid units - Artificial intelligence

Remember that the function inside units take as input the weighted sum, S, of the values coming from the units associated to it. The function inside sigmoid units calculates the following value that given a real-valued input S:

2090_Sigmoid units.png

Where e is the base of natural logarithms, e = 2.718...

When we plot the output from sigmoid units given several weighted sums as input, it seems remarkably like a step function:

 

841_Sigmoid units1.png

Certainly, getting a differentiable function which seems like the step function was the main point of the exercise. Definitely, not only is this function differentiable, but the derivative is fairly expressed simply in terms of the function itself:

1259_Sigmoid units2.png

Notice that the output values for the σ function range between but never make it to 1and 0. This is because e-S is never -ve, and the denominator of the fraction tends to 0 as S gets very large  in the -ve direction, and tends to 1 as it gets very large in the +ve direction. This tendency happens quickly: the middle ground between 0 and 1 is hardly ever seen because of the sharp (near) step in the function. Because of it seems like a step function, we may think of it firing and not-firing as in a perceptron: if a positive real is input, the output will normally be close to +1 and if a negative real is input the output will normally be close to -1.


Related Discussions:- Sigmoid units-artificial intelligence

What is parallel computing, Parallel computing has been a topic of interes...

Parallel computing has been a topic of interest in computing society over the previous few decades. Ever-growing amount of databases and increasing complexity of new problems are

What is meant by hotspots, What is meant by hotspots? A Hotspot is a l...

What is meant by hotspots? A Hotspot is a list area where the mouse pointer appears as an upright hand symbol. When a user points to that area (and the hand cursor is active),

What is random access memory, What is random access memory(RAM or MAIN MEMO...

What is random access memory(RAM or MAIN MEMORY) and mention its types? The main memory in the central storage unit in a computer system. It is relatively large and fast memory

What is selective complement - logic micro operations, SELECTIVE COMPLEMEN...

SELECTIVE COMPLEMENT The selective-complement process complements bits in register A where there are corresponding 1's inside register B. It does not affect bit positions which

Exception handling and recursion, In the previous assignment, you implement...

In the previous assignment, you implemented a stack and a list that both inherited from the abstract class ArrayIntCollection. In this task you are supposed to extend that implemen

Explain the synchronous-transmission, A control character is sent at the be...

A control character is sent at the beginning as well as at the end of every block in the synchronous-transmission in order to  (A) Synchronize the clock of transmitter and rece

Simplify the expression by using karnaugh map, Simplify   the   following  ...

Simplify   the   following   expression   into   sum   of   products   using   Karnaugh   map F(A, B, C, D) = ∑ (1,3,4,5,6,7,9,12,13) Ans. Simplification of the giv

Advantages and disadvantages of structured analysis, Advantages and Disadva...

Advantages and Disadvantages of Structured Analysis With time, you will find out that most customers understand structured methods better than object oriented (OO) methods. As

What is register set, What is Register Set Register Set:  Register set ...

What is Register Set Register Set:  Register set is used to keep immediate data during the implementation of instruction. This area of processor having of various registers.

Object oriented systems analysis and design, Analysis and design form the b...

Analysis and design form the basis on any significant software artifact. Analysis is critical in terms of making sure that the final artifact actually meets user requirements (ie b

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd