Factor Causing Parallel Overheads

Figure clearly explains that the performance metrics are not able to achieve a linear curve in comparison to the enhance in number of processors in the parallel computer. The reason for the above is the presence of overheads in the parallel computer which may degrade the performance. The well-known sources of overheads in a parallel computer are:

1) Cost involved in inter-processor communication

2) Uneven load distribution

3) Synchronization

4) Parallel Balance Point

The following section explains them in detail.