Book Description:
Ever since the invention of the computer, users have demanded more and more computational power to tackle increasingly complex problems. A common means of increasing the amount of computational power available for solving a problem is to use parallel computing. Unfortunately, however, creating efficient parallel programs is notoriously difficult. In addition to all of the well-known problems that are associated with constructing a good serial algorithm, there are a number of problems specifically associated with constructing a good parallel algorithm. These mainly revolve around ensuring that all processors are kept busy and that they have timely access to the data that they require. Unfortunately, however, controlling a number of processors operating in parallel can be exponentially more complicated than controlling one processor. Furthermore, unlike data placement in serial programs, where sophisticated compilation techniques that optimise cache behaviour and memory interleaving are common, optimising data placement throughout the vastly more complex memory hierarchy present in parallel computers is often left to the parallel application programmer. All of these problems are compounded by the large number of parallel computing architectures that exist, because they often exhibit vastly different performance characteristics, which makes writing well-optimised, portable code especially difficult.
The primary weapon against these problems in a parallel programmer’s or parallel computer architect’s arsenal is – or at least should be –the art of performance prediction. This book provides a historical exposition of over four decades of research into techniques for modelling the performance of computer programs running on parallel computers.

We’ve partnered with Copyright Clearance Center to make it easy for you to request permissions to reuse Nova content.
For more information, click here or click the "Get Permission" button below to link directly to this book on Copyright Clearance Center's website.

Table of Contents:
Preface

1. Introduction, pp. 1-3

2. Amdahl, pp. 5

3. Fortune and Wylie, pp. 7-8

4. Hoare; Milner; Alur and Dill, pp. 9-11

5. Valiant, pp. 13-14

6. Hockney, pp. 15-16

7. Saavedra and Smith, pp. 17-18

8. Culler, pp. 19-20

9. Grama, pp. 21-22

10. Adve, pp. 23-25

11. Singh, pp. 27-28

12. Mehra, pp. 29-31

13. Parashar and Hariri, pp. 33-35

14. Skillicorn, pp. 37-40

15. Crovella and LeBlanc, pp. 41-42

16. Mraz; Tabe, pp. 43-45

17. Clement, Quinn and Steed, pp. 47-48

18. Islam, pp. 49-50

19. Jonkers,pp. 51-54

20. Van Gemund, pp. 55-59

21. Labarta and Girona, pp. 61-62

22. Dunlop and Hey, pp. 63-65

23. Becker, pp. 67-68

24. Gautama, pp. 69

25. Tam and Wang, pp. 71-72

26. Kranzlm¨ uller and Schaubschl¨ager, pp. 73-75

27. Magnusson et al.; Hughes et al., pp. 77-78

28. Grove and Coddington, pp. 79-84

29. SciDAC PERC and PERI, pp. 85-86

30. Conclusion, pp. 87

References, pp. 89-115

Index