Courses and textbooks in parallel and scientific computation

Courses

• Course notes at Cambridge University (on a wide range of subjects, not only in HPC)
• How to write Fast Numerical Code, Markus Püschel, ETH
• CERCS Multicore Repository
• Scientific Computing and Visualization,Aiichiro Nakano, USC.     Fall ’09     Spring ’08
• MIT’s Open courseware
  • 18.085, Computational Science and Engineering (Fall 2008) (Also see Spring 2013
  • 18.086 (Spring 2006)
• Applied Parallel Programming (ECE 498 AL), Wen-Mei Hwu (UIUC) and David Kirk (NVIDIA)
• Applications of Parallel Computers, UC Berkeley (Taught by Jim Demmel and others), and links to resources including web pages from prior years. In particular, Jim Demmel wrote extensive notes in spring 1996
  
• Applied Parallel Computing, John Gilbert, UC Santa Barbara (Click Here for earlier versions of the course)
• CS258, Parallel Computer Architecture, David Culler, U.C. Berkeley.
• MIT OpenCourseWare
• Short courses at Texas A & M Supercomputing Facility, and other Documentation

Texts

• HyperStat Online Textbook
• Online version of Cleve Moler’s Numerical Computing with MATLAB
• Numerical Recipes (in C or Fortran), 2nd Ed., by Press et al., Cambridge University Press.
• Scientific Computing: An Introductory Survey, 2nd Ed., by Michael Heath, McGraw-Hill, 2002. Includes links and software modules accessible via applets.
• Introduction to Linear Algebra, 4th Ed., by Gilbert Strang, coming soon.
• Algorithms in the Real World, Guy Blelloch, CMU.
• Designing and Building Parallel Programs, by I. Foster (Addison-Wesley Publishers)
• Parallel Computing Works, by G. Fox, R. Williams, and P. Messina (Morgan Kaufmann Publishers)
• Computer structures: principles and examples,, 2nd Ed, compiled by D. Siewiorek, C. G. Bell, A. Newell, New York, McGraw-Hill, 1982. (Classic architecture readings)
• Parallel Computer Architecture, by Culler, Singh, and Gupta
• Calculus, by Gilbert Strang
• Templates for the Solution of Linear Systems," by Richard Barrett et al, SIAM.