Releases: Azure/azhpc-images
Ubuntu HPC Images - 20241023
The Ubuntu HPC Images includes optimizations and recommended configurations to deliver optimal performance, consistency, and reliability. These images (Ubuntu HPC 20.04, Ubuntu HPC 22.04) consists of the following HPC tools and libraries:
- Mellanox OFED 24.07-0.6.1
- Pre-configured IPoIB (IP-over-InfiniBand)
- Popular InfiniBand based MPI Libraries
- HPC-X v2.18
- IntelMPI 2021.13.1
- MVAPICH2 2.3.7-1
- OpenMPI 5.0.5
- Communication Runtimes
- Libfabric
- OpenUCX
- NCCL 2.22.3-1
- NCCL RDMA Sharp Plugin
- PMIx 4.2.9-1
- Optimized libraries
- AMD Optimizing C/C++ and Fortran Compilers 4.2.0
- Intel MKL 2024.2.1.105
- GPU Drivers
- Nvidia GPU Driver 560.35.03
- NV Peer Memory (GPU Direct RDMA)
- NVIDIA Fabric Manager
- CUDA 12.6
- GDRCopy 2.5-1 (GitHub master)
- Data Center GPU Manager 3.3.7
- Azure HPC Diagnostics Tool
- SKU based Customizations
- Topology files
- NCCL configuration
- Moby 27.0.3-ubuntu20.04u1
- Docker 27.0.3-1
- Azure Managed Lustre 2.15.4-42-gd6d405d
- Moneo v0.3.5
- Azure HPC Health checks v0.4.2
Deploying HPC VM Images:
The HPC VM images are available from Azure Marketplace, and they can be deployed through a variety of deployment vehicles (CycleCloud, Batch, ARM templates, etc).
AzureHPC scripts provide an easy way to quickly deploy an HPC cluster using an HPC VM image.
The Ubuntu Images are available in the marketplace with the following URIs:
microsoft-dsvm:ubuntu-hpc:2004:20.04.2024102301
microsoft-dsvm:ubuntu-hpc:2204:22.04.2024102301
What's changed:
- Ubuntu 22.04: Updated kernel to 5.15.0-1074-azure
- Ubuntu 20.04: Updated kernel to 5.15.0-1074-azure
- Updated Nvidia GPU Driver to 560.35.03
- Updated GDRCopy with commit 1366e20d140c5638fcaa6c72b373ac69f7ab2532 from master to fix an issue with GPU driver compatibility.
- Fixed an issue with the HCOLL path in the OpenMPI module
Known issues:
- IMPI osu_bcast performance is poor at larger message sizes. If this is your use case, pull the latest master from the UCX repo, install and append new ucx lib location to LD_LIBRARY_PATH.
- NDv2 & NCv3 SKUs: NVIDIA GPU drivers now install the Open Linux Kernel Modules, which do not support the V100 in the NDv2 and NCv3. If you need to use these SKUs, you'll either need to use a previous image or create a custom image with our scripts but override with NVIDIA's proprietary kernel modules
AlmaLinux 8.10 HPC Image - 20241018
The AlmaLinux 8.10 HPC Image includes optimizations and recommended configurations to deliver optimal performance, consistency, and reliability. This image consists of the following HPC tools and libraries:
- Mellanox OFED 24.07-0.6.1
- Pre-configured IPoIB (IP-over-InfiniBand)
- Popular InfiniBand based MPI Libraries
- HPC-X v2.18
- IntelMPI 2021.13.1
- MVAPICH2 2.3.7-1
- OpenMPI 5.0.5
- Communication Runtimes
- Libfabric
- OpenUCX
- NCCL 2.22.3-1
- NCCL RDMA Sharp Plugin
- PMIx 4.2.9-1
- Optimized libraries
- AMD Optimizing C/C++ and Fortran Compilers 4.2.0
- Intel MKL 2024.2.1.105
- GPU Drivers
- Nvidia GPU Driver 560.35.03
- NV Peer Memory (GPU Direct RDMA)
- NVIDIA Fabric Manager
- CUDA 12.6
- GDRCopy 2.5-1 (GitHub master)
- Data Center GPU Manager 3.3.7
- Azure HPC Diagnostics Tool
- SKU based Customizations
- Topology files
- NCCL configuration
- Moby 27.0.3-1.el8
- Docker 27.0.3-1
- Azure Managed Lustre 2.15.4-42-gd6d405d
- Moneo v0.3.5
- Azure HPC Health checks v0.4.2
Deploying HPC VM Images:
The HPC VM images are available from Azure Marketplace, and they can be deployed through a variety of deployment vehicles (CycleCloud, Batch, ARM templates, etc).
AzureHPC scripts provide an easy way to quickly deploy an HPC cluster using an HPC VM image.
The AlmaLinux 8.10 Image is available in the marketplace with the following URIs :
almalinux:almalinux-hpc:8_10-hpc-gen2:8.10.2024101801
almalinux:almalinux-hpc:8-hpc-gen2:8.10.2024101801
What's changed:
- Updated kernel to 4.18.0-553.16.1.el8_10.x86_64
- Updated Nvidia GPU Driver to 560.35.03
- Updated GDRCopy with commit 1366e20d140c5638fcaa6c72b373ac69f7ab2532 from master to fix an issue with GPU driver compatibility.
- Fixed an issue with the HCOLL path in the OpenMPI module
Known issues:
- IMPI osu_bcast performance is poor at larger message sizes. If this is your use case, pull the latest master from the UCX repo, install and append new ucx lib location to LD_LIBRARY_PATH.
- NDv2 & NCv3 SKUs: NVIDIA GPU drivers now install the Open Linux Kernel Modules, which do not support the V100 in the NDv2 and NCv3. If you need to use these SKUs, you'll either need to use a previous image or create a custom image with our scripts but override with NVIDIA's proprietary kernel modules
AlmaLinux 8.10 HPC Image - 20240923
The AlmaLinux 8.10 HPC Image includes optimizations and recommended configurations to deliver optimal performance, consistency, and reliability. This image consists of the following HPC tools and libraries:
- Mellanox OFED 24.07-0.6.1
- Pre-configured IPoIB (IP-over-InfiniBand)
- Popular InfiniBand based MPI Libraries
- HPC-X v2.18
- IntelMPI 2021.13.1
- MVAPICH2 2.3.7-1
- OpenMPI 5.0.5
- Communication Runtimes
- Libfabric
- OpenUCX
- NCCL 2.22.3-1
- NCCL RDMA Sharp Plugin
- PMIx 4.2.9-1
- Optimized libraries
- AMD Optimizing C/C++ and Fortran Compilers 4.2.0
- Intel MKL 2024.2.1.105
- GPU Drivers
- Nvidia GPU Driver 550.90.07
- NV Peer Memory (GPU Direct RDMA)
- NVIDIA Fabric Manager
- CUDA 12.6
- GDRCopy 2.4.1
- Data Center GPU Manager 3.3.7
- Azure HPC Diagnostics Tool
- SKU based Customizations
- Topology files
- NCCL configuration
- Moby 27.0.3-1.el8
- Docker 27.0.3-1
- Azure Managed Lustre 2.15.4-42-gd6d405d
- Moneo v0.3.5
- Azure HPC Health checks v0.4.2
Deploying HPC VM Images:
The HPC VM images are available from Azure Marketplace, and they can be deployed through a variety of deployment vehicles (CycleCloud, Batch, ARM templates, etc).
AzureHPC scripts provide an easy way to quickly deploy an HPC cluster using an HPC VM image.
The AlmaLinux 8.10 Image is available in the marketplace with the following URIs :
almalinux:almalinux-hpc:8_10-hpc-gen2:8.10.2024092301
almalinux:almalinux-hpc:8-hpc-gen2:8.10.2024092301
What's changed:
- Updated to AlmaLinux 8.10
Known issues:
- IMPI osu_bcast performance is poor at larger message sizes. If this is your use case, pull the latest master from the UCX repo, install and append new ucx lib location to LD_LIBRARY_PATH.
Ubuntu HPC Images - 20240917
The Ubuntu HPC Images includes optimizations and recommended configurations to deliver optimal performance, consistency, and reliability. These images (Ubuntu HPC 20.04, Ubuntu HPC 22.04) consists of the following HPC tools and libraries:
- Mellanox OFED 24.07-0.6.1
- Pre-configured IPoIB (IP-over-InfiniBand)
- Popular InfiniBand based MPI Libraries
- HPC-X v2.18
- IntelMPI 2021.13.1
- MVAPICH2 2.3.7-1
- OpenMPI 5.0.5
- Communication Runtimes
- Libfabric
- OpenUCX
- NCCL 2.22.3-1
- NCCL RDMA Sharp Plugin
- PMIx 4.2.9-1
- Optimized libraries
- AMD Optimizing C/C++ and Fortran Compilers 4.2.0
- Intel MKL 2024.2.1.105
- GPU Drivers
- Nvidia GPU Driver 550.90.07
- NV Peer Memory (GPU Direct RDMA)
- NVIDIA Fabric Manager
- CUDA 12.6
- GDRCopy 2.4.1
- Data Center GPU Manager 3.3.7
- Azure HPC Diagnostics Tool
- SKU based Customizations
- Topology files
- NCCL configuration
- Moby 27.0.3-ubuntu20.04u1
- Docker 27.0.3-1
- Azure Managed Lustre 2.15.4-42-gd6d405d
- Moneo v0.3.5
- Azure HPC Health checks v0.4.2
Deploying HPC VM Images:
The HPC VM images are available from Azure Marketplace, and they can be deployed through a variety of deployment vehicles (CycleCloud, Batch, ARM templates, etc).
AzureHPC scripts provide an easy way to quickly deploy an HPC cluster using an HPC VM image.
The Ubuntu Images are available in the marketplace with the following URIs:
microsoft-dsvm:ubuntu-hpc:2004:20.04.2024091701
microsoft-dsvm:ubuntu-hpc:2204:22.04.2024091701
What's changed:
- Ubuntu 22.04: Updated kernel to 5.15.0-1071-azure
- Ubuntu 20.04: Updated kernel to 5.15.0-1071-azure
Known issues:
- IMPI osu_bcast performance is poor at larger message sizes. If this is your use case, pull the latest master from the UCX repo, install and append new ucx lib location to LD_LIBRARY_PATH.
Ubuntu HPC Images - 20240624
The Ubuntu HPC Images includes optimizations and recommended configurations to deliver optimal performance, consistency, and reliability. These images (Ubuntu HPC 20.04, Ubuntu HPC 22.04) consists of the following HPC tools and libraries:
- Mellanox OFED 24.01-0.3.3.1
- Pre-configured IPoIB (IP-over-InfiniBand)
- Popular InfiniBand based MPI Libraries
- HPC-X v2.18
- IntelMPI 2021.12.0
- MVAPICH2 2.3.7-1
- OpenMPI 5.0.2
- Communication Runtimes
- Libfabric
- OpenUCX
- NCCL 2.21.5-1
- NCCL RDMA Sharp Plugin
- PMIx 4.2.9-1
- Optimized libraries
- AMD Optimizing C/C++ and Fortran Compilers 4.0.0-1
- Intel MKL 2024.0.0.49673
- GPU Drivers
- Nvidia GPU Driver 535.161.08
- NV Peer Memory (GPU Direct RDMA)
- NVIDIA Fabric Manager
- CUDA 12.4
- GDRCopy 2.3
- Data Center GPU Manager 3.3.3
- Azure HPC Diagnostics Tool
- SKU based Customizations
- Topology files
- NCCL configuration
- Moby 26.1.1-ubuntu22.04u1
- NVIDIA Docker container 26.1.1-1
- Azure Managed Lustre 2.15.4-42-gd6d405d
- Moneo v0.3.5
- Azure HPC Health checks v0.4.2
Deploying HPC VM Images:
The HPC VM images are available from Azure Marketplace, and they can be deployed through a variety of deployment vehicles (CycleCloud, Batch, ARM templates, etc).
AzureHPC scripts provide an easy way to quickly deploy an HPC cluster using an HPC VM image.
The Ubuntu Images are available in the marketplace with the following URIs:
microsoft-dsvm:ubuntu-hpc:2004:20.04.2024062501
microsoft-dsvm:ubuntu-hpc:2204:22.04.2024062401
What's changed:
- Ubuntu 22.04: Updated kernel to 5.15.0-1066-azure
- Ubuntu 20.04: Updated kernel to 5.15.0-1064-azure
- Restrict NCv4 topo file and graph file usage to only 96-core VM size
- Security fixes and updates
Ubuntu HPC Images - 20240509
The Ubuntu HPC Images includes optimizations and recommended configurations to deliver optimal performance, consistency, and reliability. These images (Ubuntu HPC 20.04, Ubuntu HPC 22.04) consists of the following HPC tools and libraries:
- Mellanox OFED 24.01-0.3.3.1
- Pre-configured IPoIB (IP-over-InfiniBand)
- Popular InfiniBand based MPI Libraries
- HPC-X v2.18
- IntelMPI 2021.12.0
- MVAPICH2 2.3.7-1
- OpenMPI 5.0.2
- Communication Runtimes
- Libfabric
- OpenUCX
- NCCL 2.21.5-1
- NCCL RDMA Sharp Plugin
- PMIx 4.2.9-1
- Optimized libraries
- AMD Optimizing C/C++ and Fortran Compilers 4.0.0-1
- Intel MKL 2024.0.0.49673
- GPU Drivers
- Nvidia GPU Driver 535.161.08
- NV Peer Memory (GPU Direct RDMA)
- NVIDIA Fabric Manager
- CUDA 12.4
- GDRCopy 2.3
- Data Center GPU Manager 3.3.3
- Azure HPC Diagnostics Tool
- SKU based Customizations
- Topology files
- NCCL configuration
- Moby 26.1.1-ubuntu22.04u1
- NVIDIA Docker container 26.1.1-1
- Azure Managed Lustre 2.15.4-42-gd6d405d
- Moneo v0.3.5
- Azure HPC Health checks v0.4.2
Deploying HPC VM Images:
The HPC VM images are available from Azure Marketplace, and they can be deployed through a variety of deployment vehicles (CycleCloud, Batch, ARM templates, etc).
AzureHPC scripts provide an easy way to quickly deploy an HPC cluster using an HPC VM image.
The Ubuntu Images are available in the marketplace with the following URIs:
microsoft-dsvm:ubuntu-hpc:2004:20.04.2024050901
microsoft-dsvm:ubuntu-hpc:2204:22.04.2024050901
What's changed:
- Ubuntu 22.04: Updated kernel to 5.15.0-1063-azure, removed popup suggesting to update to 6.5
- Ubuntu 20.04: Updated kernel to 5.15.0-1061-azure
Ubuntu HPC Images - 20240430
The Ubuntu HPC Images includes optimizations and recommended configurations to deliver optimal performance, consistency, and reliability. These images (Ubuntu HPC 20.04, Ubuntu HPC 22.04) consists of the following HPC tools and libraries:
- Mellanox OFED 24.01-0.3.3.1
- Pre-configured IPoIB (IP-over-InfiniBand)
- Popular InfiniBand based MPI Libraries
- HPC-X v2.18
- IntelMPI 2021.12.0
- MVAPICH2 2.3.7-1
- OpenMPI 5.0.2
- Communication Runtimes
- Libfabric
- OpenUCX
- NCCL 2.21.5-1
- NCCL RDMA Sharp Plugin
- PMIx 4.2.9-1
- Optimized libraries
- AMD Optimizing C/C++ and Fortran Compilers 4.0.0-1
- Intel MKL 2024.0.0.49673
- GPU Drivers
- Nvidia GPU Driver 535.161.08
- NV Peer Memory (GPU Direct RDMA)
- NVIDIA Fabric Manager
- CUDA 12.4
- GDRCopy 2.3
- Data Center GPU Manager 3.3.3
- Azure HPC Diagnostics Tool
- SKU based Customizations
- Topology files
- NCCL configuration
- Moby 26.1.1-ubuntu22.04u1
- NVIDIA Docker container 26.1.1-1
- Azure Managed Lustre 2.15.4-42-gd6d405d
- Moneo v0.3.5
- Azure HPC Health checks v0.4.2
Deploying HPC VM Images:
The HPC VM images are available from Azure Marketplace, and they can be deployed through a variety of deployment vehicles (CycleCloud, Batch, ARM templates, etc).
AzureHPC scripts provide an easy way to quickly deploy an HPC cluster using an HPC VM image.
The Ubuntu Images are available in the marketplace with the following URIs:
microsoft-dsvm:ubuntu-hpc:2004:20.04.2024043001
microsoft-dsvm:ubuntu-hpc:2204:22.04.2024043001
What's changed:
- Added support for PMIx 4.x (#301)
- Created a single JSON file for HPC component version management
- Corrected ncv4 topology
AlmaLinux 8.7 HPC Image - 20240426
The AlmaLinux 8.7 HPC Image includes optimizations and recommended configurations to deliver optimal performance, consistency, and reliability. This image consists of the following HPC tools and libraries:
- Mellanox OFED 24.01-0.3.3.1
- Pre-configured IPoIB (IP-over-InfiniBand)
- Popular InfiniBand based MPI Libraries
- HPC-X v2.18
- IntelMPI 2021.12.0
- MVAPICH2 2.3.7-1
- OpenMPI 5.0.2
- Communication Runtimes
- Libfabric
- OpenUCX
- NCCL 2.21.5-1
- NCCL RDMA Sharp Plugin
- PMIx 4.2.9-1
- Optimized libraries
- AMD Blis 4.0
- AMD FFTW 4.0
- AMD Flame 4.0
- Intel MKL 2024.0.0.49673
- GCC 9.2.0
- GPU Drivers
- Nvidia GPU Driver 535.161.08
- NV Peer Memory (GPU Direct RDMA)
- NVIDIA Fabric Manager
- CUDA 12.4
- GDRCopy 2.3
- Data Center GPU Manager 3.3.3
- Azure HPC Diagnostics Tool
- SKU based Customizations
- Topology files
- NCCL configuration
- NVIDIA Docker container 24.0.7-1
- Azure Managed Lustre 2.15.1_24_gbaa21ca
- Moneo v0.3.5
- Azure HPC Health checks v0.4.2
Deploying HPC VM Images:
The HPC VM images are available from Azure Marketplace, and they can be deployed through a variety of deployment vehicles (CycleCloud, Batch, ARM templates, etc).
AzureHPC scripts provide an easy way to quickly deploy an HPC cluster using an HPC VM image.
The AlmaLinux 8.7 Image is available in the marketplace with the following URIs :
almalinux:almalinux-hpc:8-hpc-gen2:8.7.2024042601
almalinux:almalinux-hpc:8_7-hpc-gen2:8.7.2024042601
What's changed:
Ubuntu HPC Images - 20231127
The Ubuntu HPC Images includes optimizations and recommended configurations to deliver optimal performance, consistency, and reliability. These images (Ubuntu HPC 20.04, Ubuntu HPC 22.04) consists of the following HPC tools and libraries:
- Mellanox OFED 23.07-0.5.1.2
- Pre-configured IPoIB (IP-over-InfiniBand)
- Popular InfiniBand based MPI Libraries
- HPC-X v2.16
- IntelMPI 2021.9.0
- MVAPICH2 2.3.7-1
- OpenMPI 4.1.5
- Communication Runtimes
- Libfabric
- OpenUCX
- NCCL 2.19.3-1
- NCCL RDMA Sharp Plugin
- Optimized libraries
- AMD Optimizing C/C++ and Fortran Compilers 4.0.0.0_1
- Intel MKL 2023.2.0.4949
- GPU Drivers
- Nvidia GPU Driver 535.86.10
- NV Peer Memory (GPU Direct RDMA)
- NVIDIA Fabric Manager
- CUDA 12.2
- GDRCopy 2.3
- Data Center GPU Manager 3.1.8
- Azure HPC Diagnostics Tool
- SKU based Customizations
- Topology files
- NCCL configuration
- Moby 24.0.7-ubuntu22.04u1
- NVIDIA Docker container 24.0.7-1
- Azure Managed Lustre 2.15.1-29-gbae0abe
- Moneo v0.3.3
- Azure HPC Health checks v0.2.6
Deploying HPC VM Images :
The HPC VM images are available from Azure Marketplace, and they can be deployed through a variety of deployment vehicles (CycleCloud, Batch, ARM templates, etc).
AzureHPC scripts provide an easy way to quickly deploy an HPC cluster using an HPC VM image.
The Ubuntu Images are available in the marketplace with the following URIs :
microsoft-dsvm:ubuntu-hpc:2004:20.04.2023111801
microsoft-dsvm:ubuntu-hpc:2204:22.04.2023111801
What's changed :
- Updates to Mellanox OFED 23.07-0.5.1.2
- Updates to HPC-X v2.16
- Updates to NVIDIA GPU driver 535.86.10
- Updates to NCCL 2.19.3-1
- Updates to Intel MKL 2023.2.0.4949
- Updates to Moneo v0.3.3
- Updates to Health checks v0.2.6
- Updates to NVIDIA docker and Moby engine
AlmaLinux 8.7 HPC Image - 20231128
The AlmaLinux 8.7 HPC Image includes optimizations and recommended configurations to deliver optimal performance, consistency, and reliability. This image consists of the following HPC tools and libraries:
- Mellanox OFED 23.07-0.5.1.2
- Pre-configured IPoIB (IP-over-InfiniBand)
- Popular InfiniBand based MPI Libraries
- HPC-X v2.16
- IntelMPI 2021.9.0
- MVAPICH2 2.3.7-1
- OpenMPI 4.1.5
- Communication Runtimes
- Libfabric
- OpenUCX
- Optimized libraries
- AMD Blis 4.0
- AMD FFTW 4.0
- AMD Flame 4.0
- Intel MKL 2023.2.0.49497
- GCC 9.2.0
- GPU Drivers
- Nvidia GPU Driver 535.86.10
- NCCL - 2.19.3-1
- NCCL RDMA Sharp Plugin
- NV Peer Memory (GPU Direct RDMA)
- GDRCopy 2.3
- Data Center GPU Manager 3.1.8
- Moby
- Docker 24.0.7-1
Deploying HPC VM Images :
The HPC VM images are available from Azure Marketplace, and they can be deployed through a variety of deployment vehicles (CycleCloud, Batch, ARM templates, etc).
AzureHPC scripts provide an easy way to quickly deploy an HPC cluster using an HPC VM image.
The AlmaLinux 8.7 Image is available in the marketplace with the following URIs :
almalinux:almalinux-hpc:8-hpc-gen1:8.7.2023111401
almalinux:almalinux-hpc:8_7-hpc-gen1:8.7.2023111401
almalinux:almalinux-hpc:8-hpc-gen2:8.7.2023111401
almalinux:almalinux-hpc:8_7-hpc-gen2:8.7.2023111401