A premier, deeply granular performance analysis tool. Computer scientists use it to optimize thread execution, memory access, and vectorization to ensure their code is extracting maximum theoretical performance from the underlying CPU/GPU architecture.

Other

High Performance Computing

Page

https://www.intel.com/content/www/us/en/developer/tools/oneapi/vtune-profiler.html

HPCToolkit analyzes program performance to pinpoint exact bottlenecks (e.g., CPU idle time, cache misses, memory overhead) across thousands of nodes without heavily slowing down the application during testing.

Other

High Performance Computing

Software

https://hpctoolkit.org/

Ray

A unified framework for scaling AI and Python applications. Computer scientists use it to easily distribute reinforcement learning algorithms, hyperparameter tuning, and Python-based data processing across an HPC cluster without writing low-level MPI code.

Other

Software

https://github.com/ray-project/ray

A deep learning optimization library that makes distributed training of massive AI models (like Large Language Models) possible. It manages memory and pipeline parallelism across thousands of GPUs on an HPC, solving the problem of models being too large to fit in a single machine's VRAM.

Other

High Performance Computing

Software

https://github.com/deepspeedai/DeepSpeed

Apptainer

Linux Foundation

A container solution specifically designed for HPC systems. Unlike Docker, it does not require root privileges (enhancing security) and integrates seamlessly with underlying hardware (GPUs, Infiniband).

Other

High Performance Computing

Software

https://apptainer.org/

A state-of-the-art package manager built specifically for HPC. It allows researchers to install multiple software versions with different compilers (e.g., GCC, Intel) without them conflicting with one another.

Other

High Performance Computing

Software

https://spack.io/

OpenHPC

Linux Foundation

A comprehensive project providing a collection (stack) of pre-compiled packages and best practices for building an HPC cluster from scratch.

Other

Software

https://openhpc.community/

One of the most popular open-source resource managers and job schedulers. It is responsible for receiving user "jobs," queuing them, and allocating the appropriate compute nodes for their execution.

Other

High Performance Computing

Software

https://slurm.schedmd.com/

McPAT is an architectural modeling tool for chip multiprocessors (CMP). The main focus of McPAT is accurate power and area modeling, and a target clock rate is used as a design constraint. McPAT performs automatic extensive search to find optimal designs that satisfy the target clock frequency.

Computer architecture

High Performance Computing

Repository

https://github.com/uwsampa/mcpat

FireSim is an open-source FPGA-accelerated full-system hardware simulation platform that makes it easy to validate, profile, and debug RTL hardware implementations at 10s to 100s of MHz.

Computer architecture

High Performance Computing

Repository

https://github.com/firesim/firesim