Sigmoid units-artificial intelligence, Computer Engineering

Sigmoid units - Artificial intelligence

Remember that the function inside units take as input the weighted sum, S, of the values coming from the units associated to it. The function inside sigmoid units calculates the following value that given a real-valued input S:

2090_Sigmoid units.png

Where e is the base of natural logarithms, e = 2.718...

When we plot the output from sigmoid units given several weighted sums as input, it seems remarkably like a step function:

 

841_Sigmoid units1.png

Certainly, getting a differentiable function which seems like the step function was the main point of the exercise. Definitely, not only is this function differentiable, but the derivative is fairly expressed simply in terms of the function itself:

1259_Sigmoid units2.png

Notice that the output values for the σ function range between but never make it to 1and 0. This is because e-S is never -ve, and the denominator of the fraction tends to 0 as S gets very large  in the -ve direction, and tends to 1 as it gets very large in the +ve direction. This tendency happens quickly: the middle ground between 0 and 1 is hardly ever seen because of the sharp (near) step in the function. Because of it seems like a step function, we may think of it firing and not-firing as in a perceptron: if a positive real is input, the output will normally be close to +1 and if a negative real is input the output will normally be close to -1.

Posted Date: 10/2/2012 6:16:27 AM | Location : United States







Related Discussions:- Sigmoid units-artificial intelligence, Assignment Help, Ask Question on Sigmoid units-artificial intelligence, Get Answer, Expert's Help, Sigmoid units-artificial intelligence Discussions

Write discussion on Sigmoid units-artificial intelligence
Your posts are moderated
Related Questions
Distinguish between combinational logic circuits and sequential logic circuits. Ans: Combinational logic circuits:- (i) Outputs only depend upon present state of the i

Define Mapping and List  mapping procedure? The transformation of data from main memory to cache memory is known as an Mapping. Associative mapping Direct mapping

Define interrupt and ISR? An interrupt is a request from an I/O device for service by the processor. The processor gives the requested service by implementing the interrupt ser

Q.  Find the minimum SOP and POS expression for the following functions using K- Map and realize the expression using appropriate gates. Also realize SOP form using NAND-to-NAND ga

Applications of Microprogramming: Microprogramming application:: emulation o   Use of a micro program on 1 machine to execute programs initially written to run on ano

Can math operations be performed on a void pointer? No. Pointer addition and subtraction are based on advancing the pointer by a number of elements. By explanation, if you have

End systems are connected together by communication links. There are various types of communication links, which are made of numerous types of physical media, comprising twisted pa

An experts systems must perform well that is achieve the same levels of performance in the domain of interest that human experts can achieve. But simply producing good so

a. Design a fast adder. What are the variations in a fast adder? b. Define how the virtual address is changed into real address in a paged virtual memory system. Give an example

what is complex instruction set computer and reduced complex instruction set computer