ARM64 (Linux), Apple Silicon (M1, M2) support

[danieljurek]

General issue to track addition support for AMR64 (Linux) and Apple Silicon (M1, M2, etc.) support.

Current discussions involve our bar being:

• Build client
• azd test suite passes
• Template tests pass

Current status:

• We have access to a DevOps pool of ARM64 Linux machines but those machines are missing a lot of the software/tools needed for a successful build and run of test scenarios. Some can be installed successfully with a script
• ARM64 support in some tooling may not presently available so some services azd supports in x86_64 environments today will not work until support is added for those tools

[pamelafox]

FYI, I've discovered that the docker-in-docker feature is not compatible with the --platform emulation flag: devcontainers/features#219

So I believe that for local VS Code development, I can either have docker-in-docker support in my dev container, or azd support, but not both. Fortunately I think both should work in Codespaces since that's not running on an M1.

Additional motivation to have better ARM64 support.

[rajeshkamal5050]

@danieljurek has already,

• Captured details on how to get this working - [Issue] Error opening sample in devcontainer in local M1 MacBookPro VS Code #952 (comment) with proper build, packaging and testing.
• Filed dependency issues
  • Build/Pipeline dependency
    • GoToolV0 does not support arm64 downloads microsoft/azure-pipelines-tasks#17348 or Universal Packages should support arm64 machines microsoft/azure-pipelines-tasks#17075
    • @danieljurek any other dependency we need for building and packaging?
  • Runtime dependency
    • TerraformInstaller@0 does not support ARM64 builds microsoft/azure-pipelines-terraform#116
    • @danieljurek remember you doing an exercise to go through the list of azd core and template level dependencies? Any other runtime dependencies that doesn't have support?

[danieljurek]

Setting confidence to Low on this because automated validation scenarios like the ones we use for other binaries are not well covered at this time:

• Little support in DevOps for Linux ARM scenarios
• No support for Apple Silicon in DevOps

If we just cross-compile then the process should be pretty simple to implement though we'd need to work on signing and installers. I'm not sure if signing macOS binaries compiled for ARM64 is supported.

[rajeshkamal5050]

@danieljurek agreed on trying to build, validate and test it natively on Linux ARM64 and Apple Silicon is a huge lift. Since ARM64 support and the ecosystem is not completely vetted and rolled out internally yet. It is definitely going to take sometime and might not be worth while to do the heavy lifting and custom building ourselves(azd and engsys) now.

Instead, as you said let us try to cross compile with our already existing pipelines/vm images. For now, this seems to be the best approach we should take and try things out,

• Let us start to internally build and release ARM64 bits.
• Get some manual testing going(vendor, dev, CDA, internal users).
• Once, we feel confident with our testing and flush out signing of bits.
• We can release it.

cc: @savannahostrowski @Petermarcu @ellismg @weshaggard

[weshaggard]

Yes I think cross-compiling will be a reasonable starting point. I'll add that GitHub is targeting support for images in Q3 this year https://github.com/orgs/github/projects/4247?pane=issue&itemId=5944419 and which point we can hopefully leverage those to do building and testing on.

[Petermarcu]

I made this PR to update the docs to mention installing the emulator. MicrosoftDocs/azure-dev-docs#1087

[rajeshkamal5050]

Moving this out to Gallium due to dependencies with external teams in getting native pipelines and required infra setup.

cc: @savannahostrowski

[pamelafox]

You probably already know this, but FYI that I'm unable to run the playwright tests for the TODO samples on my M1. There's a qemu error when it tries to start up Chromium. Just noting here as something affected by M1 usage.

[danieljurek]

This was released on 2023-10-05.