Today’s readings (Lecture 14, 11/10/2015)

• P. Pacheco, An Introduction to Parallel Programming, Chapter 3, pp. 101-109.

Tutorial material/To dig deeper

• mpitutorial.com. A good source of tutorials. The relevant sections for today’s lectures are as follows.
  • Broadcast and Collective Communication
  • Reduce and Allreduce

• MPI Tutorial, by Blaise Barney, §9. Collective Communication

• RS/6000 SP: Practical MPI Programming, IBM Red Book.
  The relevant parts for this lecture is Chapter 2 §2.3. Though somewhat dated, this is an excellent source of information about MPI. Note that the code examples are written in Fortran.

• Advanced techniques in MPI
  • MPI: The Complete Reference, by Marc Snir et al. Buffering and Safety.
  • Send modes, The Message Passing Interface (MPI) standard

Software

• Parallel print function. PPF is the Parallel Tools consortium’s parallel print facility. For more information, consult the PPF web site at http://computation.llnl.gov/casc/ppf/ppf.html. The software is installed on Bang and Stampede in $(PUB)/lib/PPF, with examples in $(PUB)/examples/PPF (See the README file for important information about using the software).