Foundations of High-Performance Computing

Foundations of High Performance Computing offers a comprehensive and up-to-date reference to high-performance computing (HPC). Laying the ground work for the companion text, High-Performance Computing: Applications and Frontiers, Foundations of High Performance Computing serves as a comprehensive introduction to the fundamental concepts, systems, and introductory programming techniques required for high performance computing. It is designed for graduate students, early-career professionals, and researchers seeking to build a solid foundation in HPC. This volume focuses on infrastructure, programming basics, and practical access to HPC systems. Foundations of High Performance Computing utilises a five-part structure to guide the reader through the concepts and applications of high performance computing. The first part introduces HPC, covering the evolution of HPC and offering an architectural overview of HPC systems. Part Two looks at the basics of HPC programming, beginning with resource management and performance metrics in parallel systems, discussing practical access to HPC, and considering the concepts behind distributed and shared memory. Part Three, Foundations of Parallel Computing, focuses on OpenMP for multithreading, MPI programming, GPU computing, OpenACC, and CUDA. In Part Four, the author concentrates on parallel I/O, data management, filesystems, cloud based HPC and virtualization. The book concludes with a reference and glossary. Foundations of High Performance Computing equips the reader with a thorough grounding in the basics of HPC, providing a comprehensive, multidisciplinary guide to the principles, and concepts that underpin high performance computing.