Today’s readings (Lecture 18, 12/24/2015)

• The future of microprocessors, by Shekhar Borkar and Andrew A. Chien, Comm. ACM 54(5):67-77 (May 2011).

To probe further

• Victor W. Lee et al., Debunking the 100X GPU vs. CPU myth: an evaluation of throughput computing on CPU and GPU, ISCA ’10

• T. Nguyen, P. Cicotti, E. Bylaska, D. Quinlan and S. B. Baden, Bamboo: Translating MPI applications to a latency-tolerant, data-driven form, Conf. Proc. SC ’12, Salt Lake City, UT, Nov. 10-16, 2012.

• F. Petrini, D. J. Kerbyson and S. Pakin, The Case of the Missing Supercomputer Performance: Achieving Optimal Performance on the 8,192 Processors of ASCI Q, Proc. 2003 ACM/IEEE Conf on Supercomputing (SC ’03), 2003.

• Exascale computing study: technology challenges in achieving exascale systems, by P. Kogge et al, September 2008, DARPA.
• The International Exascale Software Project roadmap, by J. Dongarra et al., Intl J. of High Performance Computing Applications 25(1):3-60, February 2011.
• Exascale.org
• Advanced Archtiectures and Critical Technoglogies for Exascale Computing. US Dept of Energy, 2011. Many presentations. Start with William Harrod’s Overview

More about Advanced Collective Communication

• Optimization of Collective Communication Operations in MPICH, by R. Thakur, R. Rabenseifner, and W. Gropp. Int’l. J. of High Performance Computing Applications, (19)1:49-66, Spring 2005. Under the hood of MPICH collectives.
• G. E. Blelloch et al, A comparison of sorting algorithms for the connection machine CM-2. Proc SPAA ’91.
• Make Barnett et al., Building a high-performance collective communication library, Proc. Supercomputing ’94, pp 107-116. Discusses van de Geijn’s linear time broadcast algorithm for long messages.
• Detailed discussions about MPI collective communication (For Reference). MPI: The Complete Reference, by Marc Snir et al.