Example multi-layer ann with sigmoid units, Computer Engineering

Assignment Help:

Example Multi-layer ANN with Sigmoid Units - Artificial intelligence:

We will discuss ourselves here with ANNs containing only 1 hidden layer, as this makes describing the back propagation routine simpler. Notice that networks where you may feed in the input on the left and propagate it forward to get an output are known feed forward networks. Below is such an ANN, with 2 sigmoid units in the hidden layer. The weights have been set arbitrarily between all the units.

 

2290_Example Multi-layer ANN with Sigmoid Units.png

Notice that the sigma units have been recognized with sigma signs in the node on the graph. As we did with perceptrons, we may give this network an input and determine the output. Also we may look to see which units "fired", for example, had a value closer to 1 than to 0.

Imagine we input the values 10, 30, 20 into the 3 input units, from top to bottom. Then the weighted sum approaching into H1 will be:

SH1 = (0.2 * 10) + (-0.1 * 30) + (0.4 * 20) = 2 -3 + 8 = 7.

Then the σ function is applied to SH1 to give:

σ (SH1) = 1/(1+e-7) = 1/(1+0.000912) = 0.999

[Do not forget to -ve S]. In Simple term, the weighted sum coming into H2 will be: SH2 = (0.7 * 10) + (-1.2 * 30) + (1.2 * 20) = 7 - 36 + 24 = -5

And σ applied to SH2 gives:

σ (SH2) = 1/(1+e5) = 1/(1+148.4) = 0.0067

From this, we may see that H1 has fired, but H2 has not fired. Now we can calculate that the weighted sum put in to output unit O1 will be:

SO1 = (1.1 * 0.999) + (0.1*0.0067) = 1.0996

And the weighted sum put in to output unit O2 will be: SO2 = (3.1 * 0.999) + (1.17*0.0067) = 3.1047

Now the output sigmoid unit in O1 will calculate the output values from the network for O1:

σ (SO1) = 1/(1+e-1.0996) = 1/(1+0.333) = 0.750

and the output from the network for O2:

σ(SO2) = 1/(1+e-3.1047) = 1/(1+0.045) = 0.957

Thus, if this network represented the learned rules for a categorization problem, the input triple (10,30,20) would be categorized into the category related with O2, because this has the bigger output.


Related Discussions:- Example multi-layer ann with sigmoid units

State the drawbacks of laptop as compared to PC, State the drawbacks of lap...

State the drawbacks of laptop compared to PC The main disadvantages of laptops compared to desk top PCs are: -  They tend to be more expensive to purchase -  It's easie

First-order models -artificial intelligence, First-Order Models - Artificia...

First-Order Models - Artificial intelligence: We proposed first-order logic like good knowledge representation language rather than propositional logic because it is more expre

Security protocols used for e-commerce applications, Explain dissimilar sec...

Explain dissimilar security protocols used for e-commerce applications.   The e-commerce systems of today are composed of a number of components including: a commerce server, d

Which loader is executed when a system is first turned on, Which loader is ...

Which loader is executed when a system is first turned on or restarted? Ans. Bootstrap loader executed while a system is first turned on or restarted.

Calculate width and height of the grid, Given a cell, we must determine its...

Given a cell, we must determine its neighbouring cells i.e. those with which it shares a wall. The cells with an x are the neighbours of the cell c. Write the function getneighbour

Memory organization - computer architecture, Memory Organization - Computer...

Memory Organization - Computer architecture: BASIC CONCEPTS: Address space - 16-bit : 216 = 64K mem. locations - 32-bit : 232 = 4G mem. locations -          40-b

How to input to circuit, Q. How to input to circuit? Register A bit...

Q. How to input to circuit? Register A bits as a0, a1, a2 and a3 in the corresponding X bits of the Full Adder (FA). Register B bits as given in the Figure above as in

Coding advantages of casex or casez, Coding advantages of casex or casez ...

Coding advantages of casex or casez By using casex or casez has the following coding advantages: -  It reduces number of lines, especially if the number of bits had been m

Network, Give an intuitive explanation of why the maximum throughput, for s...

Give an intuitive explanation of why the maximum throughput, for small beta, is approximately the same for CSMA slotted Aloha and FCFS splitting with CSMA. Show the optimal expecte

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd