What do understand by the granularity of a parallel system, Computer Engineering

What do understand by the granularity of a parallel system?

Granularity refers to the quantity of computation complete in parallel relative to the size of the entire program. In parallel computing, granularity is a qualitative measure of the percentage of computation to communication.  Through granularity of the system, parallel- processing systems can be distributed into two set: fine-grain systems and coarse-grain systems.  In fine-grained systems parallel parts are relatively little and which means more frequent communication. Fine-grain processing's had short computation to communication ratio and requires elevated communication above your head. In coarse grained systems parallel parts are relatively large and which means less computation and more communication. If granularity is too superior it is possible that the overhead required for communications and synchronization between tasks takes longer than the computation. On the other side, in coarse-grain parallel systems, relatively huge amounts of computational work are completed. Coarse-grain processing's has a high computation to communication ratio and imply more chances for performance increase.


Posted Date: 3/1/2013 5:59:29 AM | Location : United States

Related Discussions:- What do understand by the granularity of a parallel system, Assignment Help, Ask Question on What do understand by the granularity of a parallel system, Get Answer, Expert's Help, What do understand by the granularity of a parallel system Discussions

Write discussion on What do understand by the granularity of a parallel system
Your posts are moderated
Related Questions
i) The width of the sorting + merging circuit is equivalent to maximum number of devices needed in a phase is O(n/2). As in the above diagram maximum number of devices for a given

Multi-Layer Network Architectures - Artificial intelligence: Perceptrons have restricted scope in the type of concepts they may learn - they may just learn linearly separable f

Determine about the Radio Frequency (RFID)  This method includes using small electronic devices containing an Identification microchip and antenna; they work in a similar way

Exponential Search Another alternative to variable size decrease-and-conquer search is known as exponential search. This algorithm begins searching at the beginning of the list

Q. Illustrate why does a tea kettle sing? Answer:- There is a little attachment with a hole in it which acts as a whistle. It is inserted into the spout of the kettle as w

Q. Explain about fundamental nature of a Computer? The fundamental nature of a Computer is as an information transformer. So a computer should be able to take input and process

Q. What is Missing offset? The xxxx in machine language for instruction at line 0010 is there since the assembler doesn't know DATA segment location which will be determined at

Returns the information about tasks running int info = pvm_tasks( int where, int *ntask, struct pvmtaskinfo **taskp ) struct pvmtaskinfo {  int ti_tid; int ti_pt

Problem : (a) The concept of an agent is generally defined by listing the properties that agents exhibit. Identify and describe the properties that you would associate with th

Q. Show Encoding data options? PVM uses SUN's XDR library to make a machine independent data format if you request it. Settings for encoding option are:  PvmDataDefault: Use