Multi-layer network architectures, Computer Engineering

Multi-Layer Network Architectures:

As we considered we saw in the previous lecture that perceptrons have limited scope in the type of concepts that they can learn - but they can only learn linearly separable functions. Moreover, we can think of constructing larger networks by building them out of perceptrons. So in generally such larger networks that we call the step function units the perceptron units are in multi-layer networks.

However as with individual perceptrons there multi-layer networks can be used for learning tasks. In fact, the learning algorithm in which we look at as the backpropagation routine is derived mathematically by utilising differential calculus. Hence the derivation relies on having a differentiable threshold function that effectively rules out using perceptron units so if we want to be sure that backpropagation works correctly. Conversely the step function in perceptrons is not continuous, thus non-differentiable. If there an alternative unit was therefore chosen that had similar properties to the step function in perceptron units but that was differentiable.

Posted Date: 1/10/2013 7:39:48 AM | Location : United States







Related Discussions:- Multi-layer network architectures, Assignment Help, Ask Question on Multi-layer network architectures, Get Answer, Expert's Help, Multi-layer network architectures Discussions

Write discussion on Multi-layer network architectures
Your posts are moderated
Related Questions
If quicksort is so quick, why bother with anything else? If bubble sort is so bad, why even mention it? For that matter, why are there so many sorting algorithms?

Define the Identifiers of c language? In C the names of the functions, variables and arrays and various other user - defined items are called identifiers. The first character o

Static or Dynamic - artificial intelligence An environment is static if it doesn't change while an agent's program is making the decision about how to act. When programming ag

CGI is significant whenever you require to retain state information about a user, or run an application which communicates with the server. Things like guestbook's, Chat clients, d

Q. Show the Simple Arithmetic Application? The question is why can't we simply employ XCHG instruction with 2 memory variables as operand? To answer the question let's look int

Q. How is an instruction represented? Instruction is signified as a sequence of bits. A layout of an instruction is called as instruction format. Instruction formats are princi

Explain the basic performance equation Ans: The basic performance equation is following T = N * S/ R T =>  It is processor time required to execute a program N => act

Reading Decision Trees: However we can justified by see that a link between decision tree representations and logical representations that can be exploited to make it easier t

What is meant by stacked list? A stacked list is nothing but secondary list and is showed on a full-size screen unless you have specified its coordinates using the window comm

Dynamic modelling: state diagrams A state diagrams allow you to further explore operations and attributes which need to be defined for an object. They comprises of sets of sta