Skip to content

environments acpt pytorch 2.2 cuda12.1

github-actions[bot] edited this page Oct 2, 2024 · 24 revisions

acpt-pytorch-2.2-cuda12.1

Overview

Recommended environment for Deep Learning in public preview with PyTorch on Azure containing the Azure ML SDK with the latest compatible versions of Ubuntu, Python, PyTorch, CUDA\RocM, combined with optimizers like ORT Training,+DeepSpeed+MSCCL+ORT MoE and more. The image introduces newly released PyTorch 2.1 for early testing, and preview of new fastcheckpointing capability called Nebula. Azure Container Registry:acptdev.azurecr.io/test/public/aifx/acpt/stable-ubuntu2004-cu121-py310-torch212

Version: 19

Tags

PyTorch : 2.2 GPU : Cuda12 OS : Ubuntu20.04 Training Preview Python : 3.10 DeepSpeed : 0.13.1 ONNXRuntime : 1.17.1 torch_ORT : 1.17.0 Checkpointing:Nebula : 0.16.10

View in Studio: https://ml.azure.com/registries/azureml/environments/acpt-pytorch-2.2-cuda12.1/version/19

Docker image: mcr.microsoft.com/azureml/curated/acpt-pytorch-2.2-cuda12.1:19

Docker build context

Dockerfile

FROM mcr.microsoft.com/aifx/acpt/stable-ubuntu2004-cu121-py310-torch22x:biweekly.202409.3

# Install pip dependencies
COPY requirements.txt .
RUN pip install -r requirements.txt --no-cache-dir

# Inference requirements
COPY --from=mcr.microsoft.com/azureml/o16n-base/python-assets:20230419.v1 /artifacts /var/
RUN /var/requirements/install_system_requirements.sh && \
    cp /var/configuration/rsyslog.conf /etc/rsyslog.conf && \
    cp /var/configuration/nginx.conf /etc/nginx/sites-available/app && \
    ln -sf /etc/nginx/sites-available/app /etc/nginx/sites-enabled/app && \
    rm -f /etc/nginx/sites-enabled/default
ENV SVDIR=/var/runit
ENV WORKER_TIMEOUT=400
EXPOSE 5001 8883 8888

# support Deepspeed launcher requirement of passwordless ssh login
RUN apt-get update
RUN apt-get install -y openssh-server openssh-client
Clone this wiki locally