Backpropagation:

However Backpropagation can be seen as utilising searching a space of network configurations as weights in order to find a configuration with the least error, measured in the above fashion. Hence the very complicated network structure look like as the error surface that is searched can have local minima so this is a problem for multi-layer networks where we look at ways around it below.

So now having said that, even if a learned network is in a local minima there it may still perform adequately hence multi-layer networks have been utilise to great effect in real world situations as see Tom Mitchell's book for a description of an "ANN" that can drive a car! 

According to the problem of local minima is to utilise random re-start as described in the lecture on search techniques. But different initial random weightings for the network may mean like it converges to different local minima or the best of these can be taken for the learned ANN.

However, as described there in Mitchell's book, a "committee" of networks could be learned that with the as possibly weighted average of their decisions taken as an overall decision for a given test example.

Posted Date: 1/11/2013 7:23:07 AM | Location : United States

Ask an Expert

Related Discussions:- Backpropagation, Assignment Help, Ask Question on Backpropagation, Get Answer, Expert's Help, Backpropagation Discussions

Write discussion on Backpropagation
Your posts are moderated

Write your message here..

Related Questions

By which exposing EPROM contents can be erased, EPROM contents can be eras... EPROM contents can be erased by exposing it to ? Ans. By exposing EPROM contents to Ultraviolet rays, it can be erased. The Ultraviolet (UV) light passes throughout a window i

COMPUTER SYSTEM, Classify computer systems according to capacity. How they ... Classify computer systems according to capacity. How they are different from computers according to the classification of technology. Provide comparative study also.

Set up this problem as an lp problem, The Laser Computer Printer Company de... The Laser Computer Printer Company decides monthly what to produce during the subsequent month. They produce three types of printers, the Laser Rocket, the Alpha Laser, and the La

What do you meant by static and dynamic modeling, Static modeling is used t... Static modeling is used to state structure of the objects that are in the problem domain. These are expressed using class, object and USECASE diagrams. But Dynamic modeling sig

Basic working of network layer, Q. Basic working of Network layer? Net... Q. Basic working of Network layer? Network layer: Network layer is responsible for routing a packet within the subnet that is, from source to destination nodes across numerou

Mathematical applications, The current 32 and 64 bit machines can represent... The current 32 and 64 bit machines can represent integers of around 9 digits and 30 digits respectively, while various scientific and mathematical applications have to represent in

Define miss penalty, Define miss penalty? The extra time required to br... Define miss penalty? The extra time required to bring the desired information into the cache is known as miss penalty.

What is busy hour traffic, Busy hour traffic is the (A)  maximum avera... Busy hour traffic is the (A)  maximum average simultaneous traffic. (B)  traffic during peak hour. (C)  traffic when all subscribers are engaged. (D)  the durat

What is preemptive and nonpreemptive scheduling, What is preemptive and non... What is preemptive and nonpreemptive scheduling? Under nonpreemptive scheduling once the CPU has been allocated to a process, the process keeps the CPU unless it releases the C

Boiler troubles, Differences between internal and external treatment in boi... Differences between internal and external treatment in boiler