What is the need for parallel processing?
1. Parallel computing involves breaking jobs into discrete parts that can be executed concurrently.
2. Each part is further divided into a series of instructions.
3. Instructions from each part execute simultaneously on different CPUs.
4. Parallel systems involve the simultaneous use of multiple computer resources, which can include:
- A single computer with multiple processors
- Multiple computers connected by a network (parallel processing cluster)
- A combination of both
5. Parallel processing improves performance by allowing tasks to be completed faster and more
efficiently.
6. Programming for parallel systems is more difficult than for single-processor systems.
7. This complexity is due to varying architectures and the need to coordinate and synchronize
multiple CPUs.