Multi-layer network architectures, Computer Engineering

Multi-Layer Network Architectures:

As we considered we saw in the previous lecture that perceptrons have limited scope in the type of concepts that they can learn - but they can only learn linearly separable functions. Moreover, we can think of constructing larger networks by building them out of perceptrons. So in generally such larger networks that we call the step function units the perceptron units are in multi-layer networks.

However as with individual perceptrons there multi-layer networks can be used for learning tasks. In fact, the learning algorithm in which we look at as the backpropagation routine is derived mathematically by utilising differential calculus. Hence the derivation relies on having a differentiable threshold function that effectively rules out using perceptron units so if we want to be sure that backpropagation works correctly. Conversely the step function in perceptrons is not continuous, thus non-differentiable. If there an alternative unit was therefore chosen that had similar properties to the step function in perceptron units but that was differentiable.

Posted Date: 1/10/2013 7:39:48 AM | Location : United States







Related Discussions:- Multi-layer network architectures, Assignment Help, Ask Question on Multi-layer network architectures, Get Answer, Expert's Help, Multi-layer network architectures Discussions

Write discussion on Multi-layer network architectures
Your posts are moderated
Related Questions
A computer system that allows multiple users to run programs at similar time   Multi tasking system

Explain Implementation techniques Implementation techniques(e.g. remote invocation, HTTP). An event-based cooperation can be executed using message passing or it can  be based

Describe about the Embedded applications assembly Embedded applications assembly and C programs are developed since embedded programs aren't large. For all others high-level an

Mobile Computing 1. What is Wireless Protocol Requirements and also explain in brief medium access control protocol. 2. Illustrate FDMA and TDMA concepts. 3. What are the

haw to convert context free grammar to regular grammar

Which approaches do not require knowledge of the system state? Ans. Deadlock detection, deadlock prevention and deadlock avoidance; none of the given require knowledge of the s

What is partition? Partitions divide a system into several independent or weakly coupled subsystems, each giving one kind of service. Partitions use peer-peer subsystems.

What are the major systems of a telecommunication network? The main systems of any telecommunication network may contain the following main systems: a. Subscriber end instr

A given microprocessor has words of 1 byte.  What is the smallest and largest integer that can be characterized in the following representations?   a) unsigned b) sign- ma

Data Validation condition: The following condition stated below must be met for a data to be valid as is shown in the figure 3a below. 1. The data on the SDA line must remain stabl