Single program multiple date in parallel virtual machine, Computer Networking

Single Program Multiple Date

A common style of writing data parallel programs for MIMD computers is SPMD (single program, multiple data): all the processors implement the same program, but each operates on a dissimilar portion of problem data. It is simplest to program than true MIMD, but more flexible than SIMD. Though most parallel computers today are MIMD architecturally, they are generally programmed in SPMD style. In this style, though there is no central controller, the worker nodes carry on doing basically the same thing at essentially the similar time. Instead of central copies of control variables saved on the control processor of a SIMD computer, control variables (iteration counts and so on) are generally stored in a replicated fashion across MIMD nodes. Every node has its own local copy of these global control variables, but each node updates them in an identical way. There are no centrally issued parallel instructions, but communications generally happen in the well-defined collective states. These data replaces occur in a prefixed manner that implicitly or explicitly synchronize the peer nodes. The condition is something like an orchestra without a conductor. There is no central control, but every individual plays from the similar script. The group as a whole stays in lockstep. This loosely synchronous style has few similarities to the Bulk Synchronous Parallel (BSP) model of computing introduced by the theorist Les Valiant in the early 1990s. The restricted pattern of the collective synchronization is simpler to deal with than the difficult synchronisation problems of a general concurrent programming.

A natural assumption was that it should be possible and not too hard to capture the SPMD model for programming MIMD computers in data-parallel languages, along lines same to the successful SIMD languages. Many research prototype languages attempted to do this, with some success. By the 90s the value of portable, standardized programming languages was universally recognized, and there seemed to be a number of consensuses about what a standard language for SPMD programming ought to look like. Then the High Performance Fortran (HPF) standard was introduced.

Posted Date: 3/2/2013 7:32:35 AM | Location : United States







Related Discussions:- Single program multiple date in parallel virtual machine, Assignment Help, Ask Question on Single program multiple date in parallel virtual machine, Get Answer, Expert's Help, Single program multiple date in parallel virtual machine Discussions

Write discussion on Single program multiple date in parallel virtual machine
Your posts are moderated
Related Questions

Cut-Through is the best mode of switching. Store and Forward reads in the whole frame, confirms the frame is valid, and then forwards the frame onto the wire. Cut-Through only chec

Normal 0 false false false EN-IN X-NONE X-NONE

How big can an Intranet be? An Intranet can be as big as a community of interest. Scale is an important factor in web implementation, but it has no bearing on the logical asso

What everyday object is the same as The RAM function to the computer?

Give me a wide idea about simple pendulum and its types with equation and tables as usual assignment?

Why do we require to subtract two from number of hosts?

The following information was obtained from a host computer: 00:05:17.176507 74.125.228.54.1270 > 64.254.128.66.25: S 2688560409:2688560409(0) win 16384 (DF) (ttl 46, id 2096

802.11 Architecture ESS (Extended service set) two or more BSSs with APs connected through a distribution system (wired LAN) in an infrastructure network

Token Bus Frame Format No length field Data is able to be much larger (timers prevent hogs) Frame control Ack required? Data vs Control frame and how is