google-cloud-sdk crashes on Apple M1

[verokarhu]

Describe the bug

Running the unstable version of google-cloud-sdk on an M1 Mac results in the following error:

ERROR: gcloud crashed (MemoryError): Cannot allocate write+execute memory for ffi.callback(). You might be running on a system that prevents this. For more information, see https://cffi.readthedocs.io/en/latest/using.html#callbacks

Steps To Reproduce

Steps to reproduce the behavior:

1. Create shell.nix with following content:

with import (builtins.fetchTarball {
  name = "nixos-unstable";
  sha256 = "14szn1k345jfm47k6vcgbxprmw1v16n7mvyhcdl7jbjmcggjh4z7";
  url = "https://github.com/NixOS/nixpkgs/archive/253aecf69ed7595aaefabde779aa6449195bebb7.tar.gz";
}) {};

mkShell {
  buildInputs = [
    google-cloud-sdk
  ];
}

2. Run nix-shell --run "gcloud info --run-diagnostics"

Expected behavior

Diagnostic information from gcloud is successfully printed.

Notify maintainers

@iAmMrinal0
@pradyuman
@stephenmw
@zimbatm

Metadata

 - system: `"aarch64-darwin"`
 - host os: `Darwin 20.6.0, macOS 11.5.2`
 - multi-user?: `no`
 - sandbox: `no`
 - version: `nix-env (Nix) 2.3.15`
 - channels(andreasm): `"home-manager-21.05, nixpkgs-21.11pre309670.253aecf69ed"`
 - nixpkgs: `/Users/andreasm/.nix-defexpr/channels/nixpkgs`

[jduan]

I've encountered the same problem for my m1 laptop when trying to install google-cloud-sdk.

[Artturin]

pyOpenSSL doesn't work on m1
pyca/pyopenssl#873 (comment)

[ghost]

Thanks @Artturin

[maciej-trebacz]

@Artturin is there a way to mitigate that somehow? I'm on an M1 machine and gcloud CLI when installed via their installer works fine, it just doesn't work under Nix. I have a suspicion that the reason is my Python installation is actually x86_64 (which I checked using file /usr/local/bin/python3) while the Python and all the libraries Nix installes are arm64. Maybe a workaround for this bug could be making Nix install an x86_64 version of Python and all the libraries as a dependency of google-cloud-sdk on M1 machines?

[iAmMrinal0]

#141773 uses openSSL instead of pyOpenSSL. Maybe someone could try it from unstable?

[maciej-trebacz]

@iAmMrinal0 I've just tested and it does indeed work, thank you! With this I think this issue can be closed.

[iAmMrinal0]

Thanks for testing and verifying.