Skip to content

Releases: Azure/azhpc-images

Ubuntu HPC Images - 20241023

23 Oct 22:56
ae0cb33
Compare
Choose a tag to compare

The Ubuntu HPC Images includes optimizations and recommended configurations to deliver optimal performance, consistency, and reliability. These images (Ubuntu HPC 20.04, Ubuntu HPC 22.04) consists of the following HPC tools and libraries:

  • Mellanox OFED 24.07-0.6.1
  • Pre-configured IPoIB (IP-over-InfiniBand)
  • Popular InfiniBand based MPI Libraries
    • HPC-X v2.18
    • IntelMPI 2021.13.1
    • MVAPICH2 2.3.7-1
    • OpenMPI 5.0.5
  • Communication Runtimes
    • Libfabric
    • OpenUCX
    • NCCL 2.22.3-1
    • NCCL RDMA Sharp Plugin
    • PMIx 4.2.9-1
  • Optimized libraries
    • AMD Optimizing C/C++ and Fortran Compilers 4.2.0
    • Intel MKL 2024.2.1.105
  • GPU Drivers
    • Nvidia GPU Driver 560.35.03
    • NV Peer Memory (GPU Direct RDMA)
    • NVIDIA Fabric Manager
    • CUDA 12.6
  • GDRCopy 2.5-1 (GitHub master)
  • Data Center GPU Manager 3.3.7
  • Azure HPC Diagnostics Tool
  • SKU based Customizations
    • Topology files
    • NCCL configuration
  • Moby 27.0.3-ubuntu20.04u1
  • Docker 27.0.3-1
  • Azure Managed Lustre 2.15.4-42-gd6d405d
  • Moneo v0.3.5
  • Azure HPC Health checks v0.4.2

Deploying HPC VM Images:

The HPC VM images are available from Azure Marketplace, and they can be deployed through a variety of deployment vehicles (CycleCloud, Batch, ARM templates, etc).
AzureHPC scripts provide an easy way to quickly deploy an HPC cluster using an HPC VM image.

The Ubuntu Images are available in the marketplace with the following URIs:

microsoft-dsvm:ubuntu-hpc:2004:20.04.2024102301
microsoft-dsvm:ubuntu-hpc:2204:22.04.2024102301

What's changed:

  • Ubuntu 22.04: Updated kernel to 5.15.0-1074-azure
  • Ubuntu 20.04: Updated kernel to 5.15.0-1074-azure
  • Updated Nvidia GPU Driver to 560.35.03
  • Updated GDRCopy with commit 1366e20d140c5638fcaa6c72b373ac69f7ab2532 from master to fix an issue with GPU driver compatibility.
  • Fixed an issue with the HCOLL path in the OpenMPI module

Known issues:

  • IMPI osu_bcast performance is poor at larger message sizes. If this is your use case, pull the latest master from the UCX repo, install and append new ucx lib location to LD_LIBRARY_PATH.
  • NDv2 & NCv3 SKUs: NVIDIA GPU drivers now install the Open Linux Kernel Modules, which do not support the V100 in the NDv2 and NCv3. If you need to use these SKUs, you'll either need to use a previous image or create a custom image with our scripts but override with NVIDIA's proprietary kernel modules

AlmaLinux 8.10 HPC Image - 20241018

23 Oct 23:01
ae0cb33
Compare
Choose a tag to compare

The AlmaLinux 8.10 HPC Image includes optimizations and recommended configurations to deliver optimal performance, consistency, and reliability. This image consists of the following HPC tools and libraries:

  • Mellanox OFED 24.07-0.6.1
  • Pre-configured IPoIB (IP-over-InfiniBand)
  • Popular InfiniBand based MPI Libraries
    • HPC-X v2.18
    • IntelMPI 2021.13.1
    • MVAPICH2 2.3.7-1
    • OpenMPI 5.0.5
  • Communication Runtimes
    • Libfabric
    • OpenUCX
    • NCCL 2.22.3-1
    • NCCL RDMA Sharp Plugin
    • PMIx 4.2.9-1
  • Optimized libraries
    • AMD Optimizing C/C++ and Fortran Compilers 4.2.0
    • Intel MKL 2024.2.1.105
  • GPU Drivers
    • Nvidia GPU Driver 560.35.03
    • NV Peer Memory (GPU Direct RDMA)
    • NVIDIA Fabric Manager
    • CUDA 12.6
  • GDRCopy 2.5-1 (GitHub master)
  • Data Center GPU Manager 3.3.7
  • Azure HPC Diagnostics Tool
  • SKU based Customizations
    • Topology files
    • NCCL configuration
  • Moby 27.0.3-1.el8
  • Docker 27.0.3-1
  • Azure Managed Lustre 2.15.4-42-gd6d405d
  • Moneo v0.3.5
  • Azure HPC Health checks v0.4.2

Deploying HPC VM Images:

The HPC VM images are available from Azure Marketplace, and they can be deployed through a variety of deployment vehicles (CycleCloud, Batch, ARM templates, etc).
AzureHPC scripts provide an easy way to quickly deploy an HPC cluster using an HPC VM image.

The AlmaLinux 8.10 Image is available in the marketplace with the following URIs :

almalinux:almalinux-hpc:8_10-hpc-gen2:8.10.2024101801
almalinux:almalinux-hpc:8-hpc-gen2:8.10.2024101801

What's changed:

  • Updated kernel to 4.18.0-553.16.1.el8_10.x86_64
  • Updated Nvidia GPU Driver to 560.35.03
  • Updated GDRCopy with commit 1366e20d140c5638fcaa6c72b373ac69f7ab2532 from master to fix an issue with GPU driver compatibility.
  • Fixed an issue with the HCOLL path in the OpenMPI module

Known issues:

  • IMPI osu_bcast performance is poor at larger message sizes. If this is your use case, pull the latest master from the UCX repo, install and append new ucx lib location to LD_LIBRARY_PATH.
  • NDv2 & NCv3 SKUs: NVIDIA GPU drivers now install the Open Linux Kernel Modules, which do not support the V100 in the NDv2 and NCv3. If you need to use these SKUs, you'll either need to use a previous image or create a custom image with our scripts but override with NVIDIA's proprietary kernel modules

AlmaLinux 8.10 HPC Image - 20240923

01 Oct 18:49
6c3e6bb
Compare
Choose a tag to compare

The AlmaLinux 8.10 HPC Image includes optimizations and recommended configurations to deliver optimal performance, consistency, and reliability. This image consists of the following HPC tools and libraries:

  • Mellanox OFED 24.07-0.6.1
  • Pre-configured IPoIB (IP-over-InfiniBand)
  • Popular InfiniBand based MPI Libraries
    • HPC-X v2.18
    • IntelMPI 2021.13.1
    • MVAPICH2 2.3.7-1
    • OpenMPI 5.0.5
  • Communication Runtimes
    • Libfabric
    • OpenUCX
    • NCCL 2.22.3-1
    • NCCL RDMA Sharp Plugin
    • PMIx 4.2.9-1
  • Optimized libraries
    • AMD Optimizing C/C++ and Fortran Compilers 4.2.0
    • Intel MKL 2024.2.1.105
  • GPU Drivers
    • Nvidia GPU Driver 550.90.07
    • NV Peer Memory (GPU Direct RDMA)
    • NVIDIA Fabric Manager
    • CUDA 12.6
  • GDRCopy 2.4.1
  • Data Center GPU Manager 3.3.7
  • Azure HPC Diagnostics Tool
  • SKU based Customizations
    • Topology files
    • NCCL configuration
  • Moby 27.0.3-1.el8
  • Docker 27.0.3-1
  • Azure Managed Lustre 2.15.4-42-gd6d405d
  • Moneo v0.3.5
  • Azure HPC Health checks v0.4.2

Deploying HPC VM Images:

The HPC VM images are available from Azure Marketplace, and they can be deployed through a variety of deployment vehicles (CycleCloud, Batch, ARM templates, etc).
AzureHPC scripts provide an easy way to quickly deploy an HPC cluster using an HPC VM image.

The AlmaLinux 8.10 Image is available in the marketplace with the following URIs :

almalinux:almalinux-hpc:8_10-hpc-gen2:8.10.2024092301
almalinux:almalinux-hpc:8-hpc-gen2:8.10.2024092301

What's changed:

  • Updated to AlmaLinux 8.10

Known issues:

  • IMPI osu_bcast performance is poor at larger message sizes. If this is your use case, pull the latest master from the UCX repo, install and append new ucx lib location to LD_LIBRARY_PATH.

Ubuntu HPC Images - 20240917

17 Sep 19:04
d145736
Compare
Choose a tag to compare

The Ubuntu HPC Images includes optimizations and recommended configurations to deliver optimal performance, consistency, and reliability. These images (Ubuntu HPC 20.04, Ubuntu HPC 22.04) consists of the following HPC tools and libraries:

  • Mellanox OFED 24.07-0.6.1
  • Pre-configured IPoIB (IP-over-InfiniBand)
  • Popular InfiniBand based MPI Libraries
    • HPC-X v2.18
    • IntelMPI 2021.13.1
    • MVAPICH2 2.3.7-1
    • OpenMPI 5.0.5
  • Communication Runtimes
    • Libfabric
    • OpenUCX
    • NCCL 2.22.3-1
    • NCCL RDMA Sharp Plugin
    • PMIx 4.2.9-1
  • Optimized libraries
    • AMD Optimizing C/C++ and Fortran Compilers 4.2.0
    • Intel MKL 2024.2.1.105
  • GPU Drivers
    • Nvidia GPU Driver 550.90.07
    • NV Peer Memory (GPU Direct RDMA)
    • NVIDIA Fabric Manager
    • CUDA 12.6
  • GDRCopy 2.4.1
  • Data Center GPU Manager 3.3.7
  • Azure HPC Diagnostics Tool
  • SKU based Customizations
    • Topology files
    • NCCL configuration
  • Moby 27.0.3-ubuntu20.04u1
  • Docker 27.0.3-1
  • Azure Managed Lustre 2.15.4-42-gd6d405d
  • Moneo v0.3.5
  • Azure HPC Health checks v0.4.2

Deploying HPC VM Images:

The HPC VM images are available from Azure Marketplace, and they can be deployed through a variety of deployment vehicles (CycleCloud, Batch, ARM templates, etc).
AzureHPC scripts provide an easy way to quickly deploy an HPC cluster using an HPC VM image.

The Ubuntu Images are available in the marketplace with the following URIs:

microsoft-dsvm:ubuntu-hpc:2004:20.04.2024091701
microsoft-dsvm:ubuntu-hpc:2204:22.04.2024091701

What's changed:

  • Ubuntu 22.04: Updated kernel to 5.15.0-1071-azure
  • Ubuntu 20.04: Updated kernel to 5.15.0-1071-azure

Known issues:

  • IMPI osu_bcast performance is poor at larger message sizes. If this is your use case, pull the latest master from the UCX repo, install and append new ucx lib location to LD_LIBRARY_PATH.

Ubuntu HPC Images - 20240624

25 Jun 19:06
75ba3b4
Compare
Choose a tag to compare

The Ubuntu HPC Images includes optimizations and recommended configurations to deliver optimal performance, consistency, and reliability. These images (Ubuntu HPC 20.04, Ubuntu HPC 22.04) consists of the following HPC tools and libraries:

  • Mellanox OFED 24.01-0.3.3.1
  • Pre-configured IPoIB (IP-over-InfiniBand)
  • Popular InfiniBand based MPI Libraries
    • HPC-X v2.18
    • IntelMPI 2021.12.0
    • MVAPICH2 2.3.7-1
    • OpenMPI 5.0.2
  • Communication Runtimes
    • Libfabric
    • OpenUCX
    • NCCL 2.21.5-1
    • NCCL RDMA Sharp Plugin
    • PMIx 4.2.9-1
  • Optimized libraries
    • AMD Optimizing C/C++ and Fortran Compilers 4.0.0-1
    • Intel MKL 2024.0.0.49673
  • GPU Drivers
    • Nvidia GPU Driver 535.161.08
    • NV Peer Memory (GPU Direct RDMA)
    • NVIDIA Fabric Manager
    • CUDA 12.4
  • GDRCopy 2.3
  • Data Center GPU Manager 3.3.3
  • Azure HPC Diagnostics Tool
  • SKU based Customizations
    • Topology files
    • NCCL configuration
  • Moby 26.1.1-ubuntu22.04u1
  • NVIDIA Docker container 26.1.1-1
  • Azure Managed Lustre 2.15.4-42-gd6d405d
  • Moneo v0.3.5
  • Azure HPC Health checks v0.4.2

Deploying HPC VM Images:

The HPC VM images are available from Azure Marketplace, and they can be deployed through a variety of deployment vehicles (CycleCloud, Batch, ARM templates, etc).
AzureHPC scripts provide an easy way to quickly deploy an HPC cluster using an HPC VM image.

The Ubuntu Images are available in the marketplace with the following URIs:

microsoft-dsvm:ubuntu-hpc:2004:20.04.2024062501
microsoft-dsvm:ubuntu-hpc:2204:22.04.2024062401

What's changed:

  • Ubuntu 22.04: Updated kernel to 5.15.0-1066-azure
  • Ubuntu 20.04: Updated kernel to 5.15.0-1064-azure
  • Restrict NCv4 topo file and graph file usage to only 96-core VM size
  • Security fixes and updates

Ubuntu HPC Images - 20240509

10 May 17:50
ff37994
Compare
Choose a tag to compare

The Ubuntu HPC Images includes optimizations and recommended configurations to deliver optimal performance, consistency, and reliability. These images (Ubuntu HPC 20.04, Ubuntu HPC 22.04) consists of the following HPC tools and libraries:

  • Mellanox OFED 24.01-0.3.3.1
  • Pre-configured IPoIB (IP-over-InfiniBand)
  • Popular InfiniBand based MPI Libraries
    • HPC-X v2.18
    • IntelMPI 2021.12.0
    • MVAPICH2 2.3.7-1
    • OpenMPI 5.0.2
  • Communication Runtimes
    • Libfabric
    • OpenUCX
    • NCCL 2.21.5-1
    • NCCL RDMA Sharp Plugin
    • PMIx 4.2.9-1
  • Optimized libraries
    • AMD Optimizing C/C++ and Fortran Compilers 4.0.0-1
    • Intel MKL 2024.0.0.49673
  • GPU Drivers
    • Nvidia GPU Driver 535.161.08
    • NV Peer Memory (GPU Direct RDMA)
    • NVIDIA Fabric Manager
    • CUDA 12.4
  • GDRCopy 2.3
  • Data Center GPU Manager 3.3.3
  • Azure HPC Diagnostics Tool
  • SKU based Customizations
    • Topology files
    • NCCL configuration
  • Moby 26.1.1-ubuntu22.04u1
  • NVIDIA Docker container 26.1.1-1
  • Azure Managed Lustre 2.15.4-42-gd6d405d
  • Moneo v0.3.5
  • Azure HPC Health checks v0.4.2

Deploying HPC VM Images:

The HPC VM images are available from Azure Marketplace, and they can be deployed through a variety of deployment vehicles (CycleCloud, Batch, ARM templates, etc).
AzureHPC scripts provide an easy way to quickly deploy an HPC cluster using an HPC VM image.

The Ubuntu Images are available in the marketplace with the following URIs:

microsoft-dsvm:ubuntu-hpc:2004:20.04.2024050901
microsoft-dsvm:ubuntu-hpc:2204:22.04.2024050901

What's changed:

  • Ubuntu 22.04: Updated kernel to 5.15.0-1063-azure, removed popup suggesting to update to 6.5
  • Ubuntu 20.04: Updated kernel to 5.15.0-1061-azure

Ubuntu HPC Images - 20240430

02 May 17:01
2dca6ea
Compare
Choose a tag to compare

The Ubuntu HPC Images includes optimizations and recommended configurations to deliver optimal performance, consistency, and reliability. These images (Ubuntu HPC 20.04, Ubuntu HPC 22.04) consists of the following HPC tools and libraries:

  • Mellanox OFED 24.01-0.3.3.1
  • Pre-configured IPoIB (IP-over-InfiniBand)
  • Popular InfiniBand based MPI Libraries
    • HPC-X v2.18
    • IntelMPI 2021.12.0
    • MVAPICH2 2.3.7-1
    • OpenMPI 5.0.2
  • Communication Runtimes
    • Libfabric
    • OpenUCX
    • NCCL 2.21.5-1
    • NCCL RDMA Sharp Plugin
    • PMIx 4.2.9-1
  • Optimized libraries
    • AMD Optimizing C/C++ and Fortran Compilers 4.0.0-1
    • Intel MKL 2024.0.0.49673
  • GPU Drivers
    • Nvidia GPU Driver 535.161.08
    • NV Peer Memory (GPU Direct RDMA)
    • NVIDIA Fabric Manager
    • CUDA 12.4
  • GDRCopy 2.3
  • Data Center GPU Manager 3.3.3
  • Azure HPC Diagnostics Tool
  • SKU based Customizations
    • Topology files
    • NCCL configuration
  • Moby 26.1.1-ubuntu22.04u1
  • NVIDIA Docker container 26.1.1-1
  • Azure Managed Lustre 2.15.4-42-gd6d405d
  • Moneo v0.3.5
  • Azure HPC Health checks v0.4.2

Deploying HPC VM Images:

The HPC VM images are available from Azure Marketplace, and they can be deployed through a variety of deployment vehicles (CycleCloud, Batch, ARM templates, etc).
AzureHPC scripts provide an easy way to quickly deploy an HPC cluster using an HPC VM image.

The Ubuntu Images are available in the marketplace with the following URIs:

microsoft-dsvm:ubuntu-hpc:2004:20.04.2024043001
microsoft-dsvm:ubuntu-hpc:2204:22.04.2024043001

What's changed:

  • Added support for PMIx 4.x (#301)
  • Created a single JSON file for HPC component version management
  • Corrected ncv4 topology

AlmaLinux 8.7 HPC Image - 20240426

01 May 00:48
2dca6ea
Compare
Choose a tag to compare

The AlmaLinux 8.7 HPC Image includes optimizations and recommended configurations to deliver optimal performance, consistency, and reliability. This image consists of the following HPC tools and libraries:

  • Mellanox OFED 24.01-0.3.3.1
  • Pre-configured IPoIB (IP-over-InfiniBand)
  • Popular InfiniBand based MPI Libraries
    • HPC-X v2.18
    • IntelMPI 2021.12.0
    • MVAPICH2 2.3.7-1
    • OpenMPI 5.0.2
  • Communication Runtimes
    • Libfabric
    • OpenUCX
    • NCCL 2.21.5-1
    • NCCL RDMA Sharp Plugin
    • PMIx 4.2.9-1
  • Optimized libraries
    • AMD Blis 4.0
    • AMD FFTW 4.0
    • AMD Flame 4.0
    • Intel MKL 2024.0.0.49673
  • GCC 9.2.0
  • GPU Drivers
    • Nvidia GPU Driver 535.161.08
    • NV Peer Memory (GPU Direct RDMA)
    • NVIDIA Fabric Manager
    • CUDA 12.4
  • GDRCopy 2.3
  • Data Center GPU Manager 3.3.3
  • Azure HPC Diagnostics Tool
  • SKU based Customizations
    • Topology files
    • NCCL configuration
  • NVIDIA Docker container 24.0.7-1
  • Azure Managed Lustre 2.15.1_24_gbaa21ca
  • Moneo v0.3.5
  • Azure HPC Health checks v0.4.2

Deploying HPC VM Images:

The HPC VM images are available from Azure Marketplace, and they can be deployed through a variety of deployment vehicles (CycleCloud, Batch, ARM templates, etc).
AzureHPC scripts provide an easy way to quickly deploy an HPC cluster using an HPC VM image.

The AlmaLinux 8.7 Image is available in the marketplace with the following URIs :

almalinux:almalinux-hpc:8-hpc-gen2:8.7.2024042601
almalinux:almalinux-hpc:8_7-hpc-gen2:8.7.2024042601

What's changed:

  • Updated AlmaLinux 8 GPG key (#305)
  • Added support for PMIx 4.x (#301)
  • Created a single JSON file for HPC component version management
  • Corrected ncv4 topology

Ubuntu HPC Images - 20231127

27 Nov 22:42
2fde031
Compare
Choose a tag to compare

The Ubuntu HPC Images includes optimizations and recommended configurations to deliver optimal performance, consistency, and reliability. These images (Ubuntu HPC 20.04, Ubuntu HPC 22.04) consists of the following HPC tools and libraries:

  • Mellanox OFED 23.07-0.5.1.2
  • Pre-configured IPoIB (IP-over-InfiniBand)
  • Popular InfiniBand based MPI Libraries
    • HPC-X v2.16
    • IntelMPI 2021.9.0
    • MVAPICH2 2.3.7-1
    • OpenMPI 4.1.5
  • Communication Runtimes
    • Libfabric
    • OpenUCX
    • NCCL 2.19.3-1
    • NCCL RDMA Sharp Plugin
  • Optimized libraries
    • AMD Optimizing C/C++ and Fortran Compilers 4.0.0.0_1
    • Intel MKL 2023.2.0.4949
  • GPU Drivers
    • Nvidia GPU Driver 535.86.10
    • NV Peer Memory (GPU Direct RDMA)
    • NVIDIA Fabric Manager
    • CUDA 12.2
  • GDRCopy 2.3
  • Data Center GPU Manager 3.1.8
  • Azure HPC Diagnostics Tool
  • SKU based Customizations
    • Topology files
    • NCCL configuration
  • Moby 24.0.7-ubuntu22.04u1
  • NVIDIA Docker container 24.0.7-1
  • Azure Managed Lustre 2.15.1-29-gbae0abe
  • Moneo v0.3.3
  • Azure HPC Health checks v0.2.6

Deploying HPC VM Images :

The HPC VM images are available from Azure Marketplace, and they can be deployed through a variety of deployment vehicles (CycleCloud, Batch, ARM templates, etc).
AzureHPC scripts provide an easy way to quickly deploy an HPC cluster using an HPC VM image.

The Ubuntu Images are available in the marketplace with the following URIs :

microsoft-dsvm:ubuntu-hpc:2004:20.04.2023111801
microsoft-dsvm:ubuntu-hpc:2204:22.04.2023111801

What's changed :

  • Updates to Mellanox OFED 23.07-0.5.1.2
  • Updates to HPC-X v2.16
  • Updates to NVIDIA GPU driver 535.86.10
  • Updates to NCCL 2.19.3-1
  • Updates to Intel MKL 2023.2.0.4949
  • Updates to Moneo v0.3.3
  • Updates to Health checks v0.2.6
  • Updates to NVIDIA docker and Moby engine

AlmaLinux 8.7 HPC Image - 20231128

28 Nov 19:58
2fde031
Compare
Choose a tag to compare

The AlmaLinux 8.7 HPC Image includes optimizations and recommended configurations to deliver optimal performance, consistency, and reliability. This image consists of the following HPC tools and libraries:

  • Mellanox OFED 23.07-0.5.1.2
  • Pre-configured IPoIB (IP-over-InfiniBand)
  • Popular InfiniBand based MPI Libraries
    • HPC-X v2.16
    • IntelMPI 2021.9.0
    • MVAPICH2 2.3.7-1
    • OpenMPI 4.1.5
  • Communication Runtimes
    • Libfabric
    • OpenUCX
  • Optimized libraries
    • AMD Blis 4.0
    • AMD FFTW 4.0
    • AMD Flame 4.0
    • Intel MKL 2023.2.0.49497
  • GCC 9.2.0
  • GPU Drivers
    • Nvidia GPU Driver 535.86.10
  • NCCL - 2.19.3-1
    • NCCL RDMA Sharp Plugin
  • NV Peer Memory (GPU Direct RDMA)
  • GDRCopy 2.3
  • Data Center GPU Manager 3.1.8
  • Moby
  • Docker 24.0.7-1

Deploying HPC VM Images :

The HPC VM images are available from Azure Marketplace, and they can be deployed through a variety of deployment vehicles (CycleCloud, Batch, ARM templates, etc).
AzureHPC scripts provide an easy way to quickly deploy an HPC cluster using an HPC VM image.

The AlmaLinux 8.7 Image is available in the marketplace with the following URIs :

almalinux:almalinux-hpc:8-hpc-gen1:8.7.2023111401
almalinux:almalinux-hpc:8_7-hpc-gen1:8.7.2023111401

almalinux:almalinux-hpc:8-hpc-gen2:8.7.2023111401
almalinux:almalinux-hpc:8_7-hpc-gen2:8.7.2023111401