Example multi-layer ann with sigmoid units, Computer Engineering

Assignment Help:

Example Multi-layer ANN with Sigmoid Units - Artificial intelligence:

We will discuss ourselves here with ANNs containing only 1 hidden layer, as this makes describing the back propagation routine simpler. Notice that networks where you may feed in the input on the left and propagate it forward to get an output are known feed forward networks. Below is such an ANN, with 2 sigmoid units in the hidden layer. The weights have been set arbitrarily between all the units.

 

2290_Example Multi-layer ANN with Sigmoid Units.png

Notice that the sigma units have been recognized with sigma signs in the node on the graph. As we did with perceptrons, we may give this network an input and determine the output. Also we may look to see which units "fired", for example, had a value closer to 1 than to 0.

Imagine we input the values 10, 30, 20 into the 3 input units, from top to bottom. Then the weighted sum approaching into H1 will be:

SH1 = (0.2 * 10) + (-0.1 * 30) + (0.4 * 20) = 2 -3 + 8 = 7.

Then the σ function is applied to SH1 to give:

σ (SH1) = 1/(1+e-7) = 1/(1+0.000912) = 0.999

[Do not forget to -ve S]. In Simple term, the weighted sum coming into H2 will be: SH2 = (0.7 * 10) + (-1.2 * 30) + (1.2 * 20) = 7 - 36 + 24 = -5

And σ applied to SH2 gives:

σ (SH2) = 1/(1+e5) = 1/(1+148.4) = 0.0067

From this, we may see that H1 has fired, but H2 has not fired. Now we can calculate that the weighted sum put in to output unit O1 will be:

SO1 = (1.1 * 0.999) + (0.1*0.0067) = 1.0996

And the weighted sum put in to output unit O2 will be: SO2 = (3.1 * 0.999) + (1.17*0.0067) = 3.1047

Now the output sigmoid unit in O1 will calculate the output values from the network for O1:

σ (SO1) = 1/(1+e-1.0996) = 1/(1+0.333) = 0.750

and the output from the network for O2:

σ(SO2) = 1/(1+e-3.1047) = 1/(1+0.045) = 0.957

Thus, if this network represented the learned rules for a categorization problem, the input triple (10,30,20) would be categorized into the category related with O2, because this has the bigger output.


Related Discussions:- Example multi-layer ann with sigmoid units

Isoquants, what are the types of isoquants

what are the types of isoquants

what is a persistent cookie in php, A persistent cookie is a cookie which ...

A persistent cookie is a cookie which is keeps in a cookie file permanently on the browser's computer. By default, cookies are formed as temporary cookies which keep only in the br

., advantages and disadvantages of a header node

advantages and disadvantages of a header node

Data types done between abap/4 & external level, How is conversion of data ...

How is conversion of data types done between ABAP/4 & external level? Conversion among the external layer and the ABAP/4 layer is completed in the SAP dialog manager DYNP.

Design principles, The usability and user experience goalsprovidet heintera...

The usability and user experience goalsprovidet heinteraction designer with high-level goals for the interactivep roduct. Thenextissueis how to design a product that satisfies thes

Ann representation, ANN Representation: Mostly 'ANNs' are taught on "A...

ANN Representation: Mostly 'ANNs' are taught on "AI" courses since their motivation from brain studies and the fact which they are used in an "AI" task and namely machine lear

Why use a DTD (Document Type Definition), Why use a DTD ( Document Type Def...

Why use a DTD ( Document Type Definition )? XML gives an application independent method of sharing data. Along with a DTD, independent group of people can agree to employ a com

Technology management, These five questions are part of the assignment. The...

These five questions are part of the assignment. The answers of each question can be written in around 300 words (with relevant diagrams and Refrences). Assignement should be comnp

Segment combinations, Segment Combinations In 8086 assembler provides a...

Segment Combinations In 8086 assembler provides a means for combining segments declared in various modules. Some typical combine types are: 1.   PUBLIC: This combine directi

Write Your Message!

Captcha
Free Assignment Quote

Assured A++ Grade

Get guaranteed satisfaction & time on delivery in every assignment order you paid with us! We ensure premium quality solution document along with free turntin report!

All rights reserved! Copyrights ©2019-2020 ExpertsMind IT Educational Pvt Ltd