Can't compile ring with target aarch64-unknown-linux-musl #1414

nuvanti · 2021-10-13T23:22:09Z

I don't use ring directly but via jsowebtoken, rustls, etc.

I am trying to compile on AWS Graviton EC2 and get the following error for the following command:
cargo build --release --target aarch64-unknown-linux-musl

If you see the error message below, what stands out is:

No such file or directory (os error 2)', /home/ssm-user/.cargo/registry/src/gh.neting.cc-1ecc6299db9ec823/ring-0.16.20/build.rs:653:9

error: failed to run custom build command for ring v0.16.20

Caused by:
process didn't exit successfully: /tmp/lambda_build/target/release/build/ring-6fdf78c41c5d5ad7/build-script-build (exit status: 101)
--- stdout
OPT_LEVEL = Some("z")
TARGET = Some("aarch64-unknown-linux-musl")
HOST = Some("aarch64-unknown-linux-gnu")
CC_aarch64-unknown-linux-musl = None
CC_aarch64_unknown_linux_musl = None
TARGET_CC = None
CC = None
CROSS_COMPILE = None
CFLAGS_aarch64-unknown-linux-musl = None
CFLAGS_aarch64_unknown_linux_musl = None
TARGET_CFLAGS = None
CFLAGS = None
CRATE_CC_NO_DEFAULTS = None
DEBUG = Some("false")
CARGO_CFG_TARGET_FEATURE = None

--- stderr
running "aarch64-linux-musl-gcc" "-Os" "-ffunction-sections" "-fdata-sections" "-fPIC" "-I" "include" "-Wall" "-Wextra" "-pedantic" "-pedantic-errors" "-Wall" "-Wextra" "-Wcast-align" "-Wcast-qual" "-Wconversion" "-Wenum-compare" "-Wfloat-equal" "-Wformat=2" "-Winline" "-Winvalid-pch" "-Wmissing-field-initializers" "-Wmissing-include-dirs" "-Wredundant-decls" "-Wshadow" "-Wsign-compare" "-Wsign-conversion" "-Wundef" "-Wuninitialized" "-Wwrite-strings" "-fno-strict-aliasing" "-fvisibility=hidden" "-fstack-protector" "-g3" "-U_FORTIFY_SOURCE" "-DNDEBUG" "-c" "-o/tmp/lambda_build/target/aarch64-unknown-linux-musl/release/build/ring-8d8172b2ed11f37e/out/aesv8-armx-linux64.o" "/home/ssm-user/.cargo/registry/src/gh.neting.cc-1ecc6299db9ec823/ring-0.16.20/pregenerated/aesv8-armx-linux64.S"
thread 'main' panicked at 'failed to execute ["aarch64-linux-musl-gcc" "-Os" "-ffunction-sections" "-fdata-sections" "-fPIC" "-I" "include" "-Wall" "-Wextra" "-pedantic" "-pedantic-errors" "-Wall" "-Wextra" "-Wcast-align" "-Wcast-qual" "-Wconversion" "-Wenum-compare" "-Wfloat-equal" "-Wformat=2" "-Winline" "-Winvalid-pch" "-Wmissing-field-initializers" "-Wmissing-include-dirs" "-Wredundant-decls" "-Wshadow" "-Wsign-compare" "-Wsign-conversion" "-Wundef" "-Wuninitialized" "-Wwrite-strings" "-fno-strict-aliasing" "-fvisibility=hidden" "-fstack-protector" "-g3" "-U_FORTIFY_SOURCE" "-DNDEBUG" "-c" "-o/tmp/lambda_build/target/aarch64-unknown-linux-musl/release/build/ring-8d8172b2ed11f37e/out/aesv8-armx-linux64.o" "/home/ssm-user/.cargo/registry/src/gh.neting.cc-1ecc6299db9ec823/ring-0.16.20/pregenerated/aesv8-armx-linux64.S"]: No such file or directory (os error 2)', /home/ssm-user/.cargo/registry/src/gh.neting.cc-1ecc6299db9ec823/ring-0.16.20/build.rs:653:9

The text was updated successfully, but these errors were encountered:

Leandros · 2021-10-17T16:41:06Z

Same here.

Leandros · 2021-10-19T15:06:51Z

My solution was to use the messense/rust-musl-cross:aarch64-musl docker image to cross-compile, rather than using rustup add target ....

duaneking · 2021-11-07T04:20:38Z

This is critical to be able to deploy to AWS Lambda.

To reproduce:

rustup target add x86_64-unknown-linux-musl && cargo build --release --target x86_64-unknown-linux-musl

In this case all the cross compilation requirmemts were met as I had been able to deploy other Rust based software.

jmfiaschi · 2021-11-14T14:47:04Z

~~Hello, same for me even with the messense/rust-musl-cross:x86_64-musl~~

After more tests, now it's work with messense/rust-musl-cross:x86_64-musl

duaneking · 2021-11-15T19:11:11Z

Do we have an ETA? This is 100% blocking for many people.

Respectfully pinging @briansmith with good vibes and good intentions.

briansmith · 2021-11-15T19:28:03Z

What is the output of which aarch64-linux-musl-gcc?

Look at mk/cargo.sh and .github/ci.yml to see how to configure cross-compilation. I would recommend doing it with clang. Feel free to submit a PR that adds the aarch64-unknown-linux-musl target to .gitlab/ci.yml so we can ensure this works and help people understand which environment variables to set.

I think using clang instead of gcc for the C compiler (again, see mk/cargo.sh) will make it work easier.

duaneking · 2021-11-15T19:58:40Z

For portability, gcc should also be supported as some platforms prefer it.

I'm trying to use Ubuntu to cross compile and deploy to AWS lambda, Ring seems to be the only thing blocking that.

Thing is, Ubuntu support is core for a lot of devs because of its use for wsl2 (on windows to allow unix via containers) and because a lot of devs use ubuntu laptops for rust development machines professionally when their companies are too cheap to provide macbooks.

On my Ubuntu machine I can show that they are installed by simply typing aarch64-linux-gnu-gcc --version to get the Ubuntu specific version of Ubuntu 9.3.0-17ubuntu1-20.04) 9.3.0

briansmith · 2021-11-16T01:03:00Z

For portability, gcc should also be supported as some platforms prefer it.

I bet it does work. Presently you need to install a working musl toolchain for it. I believe if you use clang instead, it is easier.

On my Ubuntu machine I can show that they are installed by simply typing aarch64-linux-gnu-gcc --version to get the Ubuntu specific version of Ubuntu 9.3.0-17ubuntu1-20.04) 9.3.0

Please make a PR to add your configuration to ring's CI/CD, if you can. Then it would be easy for me to debug it.

duaneking · 2021-11-16T01:09:59Z

Unfortunately the code I'm deploying is such I can't make it public; but there is an easy repo.

In this case, I have a working musl toolchain on ubuntu; I was able to deploy to lambda just fine on it until I added the lambda_web crate; it seems to be triggered by the dependency of brotli and that pulls in Ring.

https://crates.io/crates/lambda-web/0.1.4

briansmith · 2021-11-16T17:49:00Z

failed to execute ["aarch64-linux-musl-gcc" makes it look a lot like the system can't find aarch64-linux-musl-gcc in the path.

briansmith · 2021-11-16T17:49:43Z

Unfortunately the code I'm deploying is such I can't make it public; but there is an easy repo.

You didn't give me the STR.

duaneking · 2021-11-16T20:28:42Z

You didn't give me the STR.

I'm confused by this comment and don't know what you mean.

The crate is at https://crates.io/crates/lambda-web/

aarch64-linux-musl-gcc is installed and we can easily get a version string from it on the cli, per the above.

WilliamVenner · 2022-01-11T17:59:51Z

Just gonna cross-post this which solved the issue for me: #563 (comment)

jensmeindertsma · 2022-02-23T14:14:24Z

@briansmith I’m running into the same issue described here, is there anything I could do to help?

wiktor-k · 2022-03-01T08:59:05Z

For the record I've been able to compile ring for aarch64 by using llvm like Brian mentioned.

I've taken environment variables from StackOverflow that took it from ring's config file:

ENV CC_aarch64_unknown_linux_musl=clang
ENV AR_aarch64_unknown_linux_musl=llvm-ar
ENV CARGO_TARGET_AARCH64_UNKNOWN_LINUX_MUSL_RUSTFLAGS="-Clink-self-contained=yes -Clinker=rust-lld"

This of course needs LLVM and musl-tools: apt-get install musl-tools clang llvm -y

jokeyrhyme · 2022-07-03T07:37:52Z

Just encountered this today:

With RUST_BACKTRACE=1, the error output is:

error: failed to run custom build command for `ring v0.16.20`
Caused by:
  process didn't exit successfully: `/repo/target/release/build/ring-bdefb98f3de94c81/build-script-build` (exit status: 101)
  --- stdout
  OPT_LEVEL = Some("z")
  TARGET = Some("aarch64-unknown-linux-musl")
  HOST = Some("x86_64-unknown-linux-musl")
  CC_aarch64-unknown-linux-musl = None
  CC_aarch64_unknown_linux_musl = None
  TARGET_CC = None
  CC = None
  CROSS_COMPILE = None
  CFLAGS_aarch64-unknown-linux-musl = None
  CFLAGS_aarch64_unknown_linux_musl = None
  TARGET_CFLAGS = None
  CFLAGS = None
  CRATE_CC_NO_DEFAULTS = None
  DEBUG = Some("false")
  CARGO_CFG_TARGET_FEATURE = Some("neon,pmuv3")
  --- stderr
  running "aarch64-linux-musl-gcc" "-Os" "-ffunction-sections" "-fdata-sections" "-fPIC" "-I" "include" "-Wall" "-Wextra" "-pedantic" "-pedantic-errors" "-Wall" "-Wextra" "-Wcast-align" "-Wcast-qual" "-Wconversion" "-Wenum-compare" "-Wfloat-equal" "-Wformat=2" "-Winline" "-Winvalid-pch" "-Wmissing-field-initializers" "-Wmissing-include-dirs" "-Wredundant-decls" "-Wshadow" "-Wsign-compare" "-Wsign-conversion" "-Wundef" "-Wuninitialized" "-Wwrite-strings" "-fno-strict-aliasing" "-fvisibility=hidden" "-fstack-protector" "-g3" "-U_FORTIFY_SOURCE" "-DNDEBUG" "-c" "-o/repo/target/aarch64-unknown-linux-musl/release/build/ring-4efa80a8699004e7/out/aesv8-armx-linux64.o" "/usr/local/cargo/registry/src/gh.neting.cc-1ecc6299db9ec823/ring-0.16.20/pregenerated/aesv8-armx-linux64.S"
  thread 'main' panicked at 'failed to execute ["aarch64-linux-musl-gcc" "-Os" "-ffunction-sections" "-fdata-sections" "-fPIC" "-I" "include" "-Wall" "-Wextra" "-pedantic" "-pedantic-errors" "-Wall" "-Wextra" "-Wcast-align" "-Wcast-qual" "-Wconversion" "-Wenum-compare" "-Wfloat-equal" "-Wformat=2" "-Winline" "-Winvalid-pch" "-Wmissing-field-initializers" "-Wmissing-include-dirs" "-Wredundant-decls" "-Wshadow" "-Wsign-compare" "-Wsign-conversion" "-Wundef" "-Wuninitialized" "-Wwrite-strings" "-fno-strict-aliasing" "-fvisibility=hidden" "-fstack-protector" "-g3" "-U_FORTIFY_SOURCE" "-DNDEBUG" "-c" "-o/repo/target/aarch64-unknown-linux-musl/release/build/ring-4efa80a8699004e7/out/aesv8-armx-linux64.o" "/usr/local/cargo/registry/src/gh.neting.cc-1ecc6299db9ec823/ring-0.16.20/pregenerated/aesv8-armx-linux64.S"]: No such file or directory (os error 2)', /usr/local/cargo/registry/src/gh.neting.cc-1ecc6299db9ec823/ring-0.16.20/build.rs:653:9
  stack backtrace:
     0: rust_begin_unwind
               at /rustc/a8314ef7d0ec7b75c336af2c9857bfaf43002bfc/library/std/src/panicking.rs:584:5
     1: core::panicking::panic_fmt
               at /rustc/a8314ef7d0ec7b75c336af2c9857bfaf43002bfc/library/core/src/panicking.rs:142:14
     2: build_script_build::run_command::{{closure}}
     3: core::result::Result<T,E>::unwrap_or_else
     4: build_script_build::run_command
     5: build_script_build::compile
     6: build_script_build::build_library::{{closure}}
     7: core::ops::function::impls::<impl core::ops::function::FnOnce<A> for &mut F>::call_once
     8: core::option::Option<T>::map
     9: <core::iter::adapters::map::Map<I,F> as core::iter::traits::iterator::Iterator>::next
    10: <alloc::vec::Vec<T> as alloc::vec::spec_from_iter_nested::SpecFromIterNested<T,I>>::from_iter
    11: <alloc::vec::Vec<T> as alloc::vec::spec_from_iter::SpecFromIter<T,I>>::from_iter
    12: <alloc::vec::Vec<T> as core::iter::traits::collect::FromIterator<T>>::from_iter
    13: core::iter::traits::iterator::Iterator::collect
    14: build_script_build::build_library
    15: build_script_build::build_c_code::{{closure}}
    16: <core::slice::iter::Iter<T> as core::iter::traits::iterator::Iterator>::for_each
    17: build_script_build::build_c_code
    18: build_script_build::ring_build_rs_main
    19: build_script_build::main
    20: core::ops::function::FnOnce::call_once
  note: Some details are omitted, run with `RUST_BACKTRACE=full` for a verbose backtrace.
The command '/bin/sh -c cargo build --release --target $CARGO_BUILD_TARGET --workspace' returned a non-zero code: 101

I'll try switching to LLVM for now

using hints from - briansmith/ring#1414 and - https://stackoverflow.com/questions/65874219/trouble-compiling-rust-crates-that-include-c-libraries-for-aarch64/65876959#65876959

sakibstark11 · 2022-11-03T17:35:47Z

I did the same env setup. I am getting the following error.

#12 373.4 error: failed to run custom build command for `ring v0.16.15`
#12 373.4 
#12 373.4 Caused by:
#12 373.4   process didn't exit successfully: `/jenkins/strck-cloud/target/release/build/ring-bbfe3777739977f5/build-script-build` (exit status: 101)
#12 373.4   --- stdout
#12 373.4   OPT_LEVEL = Some("3")
#12 373.4   TARGET = Some("aarch64-unknown-linux-musl")
#12 373.4   HOST = Some("x86_64-unknown-linux-gnu")
#12 373.4   CC_aarch64-unknown-linux-musl = None
#12 373.4   CC_aarch64_unknown_linux_musl = Some("clang")
#12 373.4   CFLAGS_aarch64-unknown-linux-musl = None
#12 373.4   CFLAGS_aarch64_unknown_linux_musl = None
#12 373.4   TARGET_CFLAGS = None
#12 373.4   CFLAGS = None
#12 373.4   CRATE_CC_NO_DEFAULTS = None
#12 373.4   DEBUG = Some("false")
#12 373.4   OPT_LEVEL = Some("3")
#12 373.4   TARGET = Some("aarch64-unknown-linux-musl")
#12 373.4   HOST = Some("x86_64-unknown-linux-gnu")
#12 373.4   CC_aarch64-unknown-linux-musl = None
#12 373.4   CC_aarch64_unknown_linux_musl = Some("clang")
#12 373.4   CFLAGS_aarch64-unknown-linux-musl = None
#12 373.4   CFLAGS_aarch64_unknown_linux_musl = None
#12 373.4   TARGET_CFLAGS = None
#12 373.4   CFLAGS = None
#12 373.4   CRATE_CC_NO_DEFAULTS = None
#12 373.4   DEBUG = Some("false")
#12 373.4   OPT_LEVEL = Some("3")
#12 373.4   TARGET = Some("aarch64-unknown-linux-musl")
#12 373.4   HOST = Some("x86_64-unknown-linux-gnu")
#12 373.4   CC_aarch64-unknown-linux-musl = None
#12 373.4   CC_aarch64_unknown_linux_musl = Some("clang")
#12 373.4   CFLAGS_aarch64-unknown-linux-musl = None
#12 373.4   CFLAGS_aarch64_unknown_linux_musl = None
#12 373.4   TARGET_CFLAGS = None
#12 373.4   CFLAGS = None
#12 373.4   CRATE_CC_NO_DEFAULTS = None
#12 373.4   DEBUG = Some("false")
#12 373.4   OPT_LEVEL = Some("3")
#12 373.4   TARGET = Some("aarch64-unknown-linux-musl")
#12 373.4   HOST = Some("x86_64-unknown-linux-gnu")
#12 373.4   CC_aarch64-unknown-linux-musl = None
#12 373.4   CC_aarch64_unknown_linux_musl = Some("clang")
#12 373.4   CFLAGS_aarch64-unknown-linux-musl = None
#12 373.4   CFLAGS_aarch64_unknown_linux_musl = None
#12 373.4   TARGET_CFLAGS = None
#12 373.4   CFLAGS = None
#12 373.4   CRATE_CC_NO_DEFAULTS = None
#12 373.4   DEBUG = Some("false")
#12 373.4   OPT_LEVEL = Some("3")
#12 373.4   TARGET = Some("aarch64-unknown-linux-musl")
#12 373.4   HOST = Some("x86_64-unknown-linux-gnu")
#12 373.4   CC_aarch64-unknown-linux-musl = None
#12 373.4   CC_aarch64_unknown_linux_musl = Some("clang")
#12 373.4   CFLAGS_aarch64-unknown-linux-musl = None
#12 373.4   CFLAGS_aarch64_unknown_linux_musl = None
#12 373.4   TARGET_CFLAGS = None
#12 373.4   CFLAGS = None
#12 373.4   CRATE_CC_NO_DEFAULTS = None
#12 373.4   DEBUG = Some("false")
#12 373.4   OPT_LEVEL = Some("3")
#12 373.4   TARGET = Some("aarch64-unknown-linux-musl")
#12 373.4   HOST = Some("x86_64-unknown-linux-gnu")
#12 373.4   CC_aarch64-unknown-linux-musl = None
#12 373.4   CC_aarch64_unknown_linux_musl = Some("clang")
#12 373.4   CFLAGS_aarch64-unknown-linux-musl = None
#12 373.4   CFLAGS_aarch64_unknown_linux_musl = None
#12 373.4   TARGET_CFLAGS = None
#12 373.4   CFLAGS = None
#12 373.4   CRATE_CC_NO_DEFAULTS = None
#12 373.4   DEBUG = Some("false")
#12 373.4   OPT_LEVEL = Some("3")
#12 373.4   TARGET = Some("aarch64-unknown-linux-musl")
#12 373.4   HOST = Some("x86_64-unknown-linux-gnu")
#12 373.4   CC_aarch64-unknown-linux-musl = None
#12 373.4   CC_aarch64_unknown_linux_musl = Some("clang")
#12 373.4   CFLAGS_aarch64-unknown-linux-musl = None
#12 373.4   CFLAGS_aarch64_unknown_linux_musl = None
#12 373.4   TARGET_CFLAGS = None
#12 373.4   CFLAGS = None
#12 373.4   CRATE_CC_NO_DEFAULTS = None
#12 373.4   DEBUG = Some("false")
#12 373.4   OPT_LEVEL = Some("3")
#12 373.4   TARGET = Some("aarch64-unknown-linux-musl")
#12 373.4   HOST = Some("x86_64-unknown-linux-gnu")
#12 373.4   CC_aarch64-unknown-linux-musl = None
#12 373.4   CC_aarch64_unknown_linux_musl = Some("clang")
#12 373.4   CFLAGS_aarch64-unknown-linux-musl = None
#12 373.4   CFLAGS_aarch64_unknown_linux_musl = None
#12 373.4   TARGET_CFLAGS = None
#12 373.4   CFLAGS = None
#12 373.4   CRATE_CC_NO_DEFAULTS = None
#12 373.4   DEBUG = Some("false")
#12 373.4   OPT_LEVEL = Some("3")
#12 373.4   TARGET = Some("aarch64-unknown-linux-musl")
#12 373.4   HOST = Some("x86_64-unknown-linux-gnu")
#12 373.4   CC_aarch64-unknown-linux-musl = None
#12 373.4   CC_aarch64_unknown_linux_musl = Some("clang")
#12 373.4   CFLAGS_aarch64-unknown-linux-musl = None
#12 373.4   CFLAGS_aarch64_unknown_linux_musl = None
#12 373.4   TARGET_CFLAGS = None
#12 373.4   CFLAGS = None
#12 373.4   CRATE_CC_NO_DEFAULTS = None
#12 373.4   DEBUG = Some("false")
#12 373.4   OPT_LEVEL = Some("3")
#12 373.4   TARGET = Some("aarch64-unknown-linux-musl")
#12 373.4   HOST = Some("x86_64-unknown-linux-gnu")
#12 373.4   CC_aarch64-unknown-linux-musl = None
#12 373.4   CC_aarch64_unknown_linux_musl = Some("clang")
#12 373.4   CFLAGS_aarch64-unknown-linux-musl = None
#12 373.4   CFLAGS_aarch64_unknown_linux_musl = None
#12 373.4   TARGET_CFLAGS = None
#12 373.4   CFLAGS = None
#12 373.4   CRATE_CC_NO_DEFAULTS = None
#12 373.4   DEBUG = Some("false")
#12 373.4   OPT_LEVEL = Some("3")
#12 373.4   TARGET = Some("aarch64-unknown-linux-musl")
#12 373.4   HOST = Some("x86_64-unknown-linux-gnu")
#12 373.4   CC_aarch64-unknown-linux-musl = None
#12 373.4   CC_aarch64_unknown_linux_musl = Some("clang")
#12 373.4   CFLAGS_aarch64-unknown-linux-musl = None
#12 373.4   CFLAGS_aarch64_unknown_linux_musl = None
#12 373.4   TARGET_CFLAGS = None
#12 373.4   CFLAGS = None
#12 373.4   CRATE_CC_NO_DEFAULTS = None
#12 373.4   DEBUG = Some("false")
#12 373.4 
#12 373.4   --- stderr
#12 373.4   ENV TARGET=aarch64-unknown-linux-musl
#12 373.4   ENV SSL_CERT_FILE=/usr/lib/ssl/certs/ca-certificates.crt
#12 373.4   ENV SSL_CERT_DIR=/usr/lib/ssl/certs
#12 373.4   ENV RUST_RECURSION_COUNT=1
#12 373.4   ENV RUSTUP_TOOLCHAIN=stable-x86_64-unknown-linux-gnu
#12 373.4   ENV RUSTUP_HOME=/root/.rustup
#12 373.4   ENV RUSTDOC=rustdoc
#12 373.4   ENV RUSTC=rustc
#12 373.4   ENV PWD=/jenkins/strck-cloud
#12 373.4   ENV PROFILE=release
#12 373.4   ENV PATH=/root/.cargo/bin:/jenkins/.cargo/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
#12 373.4   ENV OUT_DIR=/jenkins/strck-cloud/target/aarch64-unknown-linux-musl/release/build/ring-6dbfdc74a1174779/out
#12 373.4   ENV OPT_LEVEL=3
#12 373.4   ENV NUM_JOBS=8
#12 373.4   ENV LD_LIBRARY_PATH=/jenkins/strck-cloud/target/release/deps:/jenkins/strck-cloud/target/release:/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib/rustlib/x86_64-unknown-linux-gnu/lib:/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/lib
#12 373.4   ENV HOST=x86_64-unknown-linux-gnu
#12 373.4   ENV HOME=/root
#12 373.4   ENV DEBUG=false
#12 373.4   ENV CC_aarch64_unknown_linux_musl=clang
#12 373.4   ENV CARGO_TARGET_AARCH64_UNKNOWN_LINUX_MUSL_RUSTFLAGS=-Clink-self-contained=yes -Clinker=rust-lld
#12 373.4   ENV CARGO_TARGET_AARCH64_UNKNOWN_LINUX_MUSL_RUNNER=qemu-aarch64 -L /usr/aarch64-linux-gnu
#12 373.4   ENV CARGO_PKG_VERSION_PRE=
#12 373.4   ENV CARGO_PKG_VERSION_PATCH=15
#12 373.4   ENV CARGO_PKG_VERSION_MINOR=16
#12 373.4   ENV CARGO_PKG_VERSION_MAJOR=0
#12 373.4   ENV CARGO_PKG_VERSION=0.16.15
#12 373.4   ENV CARGO_PKG_RUST_VERSION=
#12 373.4   ENV CARGO_PKG_REPOSITORY=https://github.com/briansmith/ring
#12 373.4   ENV CARGO_PKG_NAME=ring
#12 373.4   ENV CARGO_PKG_LICENSE_FILE=LICENSE
#12 373.4   ENV CARGO_PKG_LICENSE=
#12 373.4   ENV CARGO_PKG_HOMEPAGE=
#12 373.4   ENV CARGO_PKG_DESCRIPTION=Safe, fast, small crypto using Rust.
#12 373.4   ENV CARGO_PKG_AUTHORS=Brian Smith <brian@briansmith.org>
#12 373.4   ENV CARGO_MANIFEST_LINKS=ring-asm
#12 373.4   ENV CARGO_MANIFEST_DIR=/root/.cargo/registry/src/gh.neting.cc-1ecc6299db9ec823/ring-0.16.15
#12 373.4   ENV CARGO_MAKEFLAGS=-j --jobserver-fds=9,14 --jobserver-auth=9,14
#12 373.4   ENV CARGO_HOME=/root/.cargo
#12 373.4   ENV CARGO_FEATURE_ONCE_CELL=1
#12 373.4   ENV CARGO_FEATURE_DEV_URANDOM_FALLBACK=1
#12 373.4   ENV CARGO_FEATURE_DEFAULT=1
#12 373.4   ENV CARGO_FEATURE_ALLOC=1
#12 373.4   ENV CARGO_ENCODED_RUSTFLAGS=-Clink-self-contained=yes-Clinker=rust-lld
#12 373.4   ENV CARGO_CFG_UNIX=
#12 373.4   ENV CARGO_CFG_TARGET_VENDOR=unknown
#12 373.4   ENV CARGO_CFG_TARGET_POINTER_WIDTH=64
#12 373.4   ENV CARGO_CFG_TARGET_OS=linux
#12 373.4   ENV CARGO_CFG_TARGET_HAS_ATOMIC=128,16,32,64,8,ptr
#12 373.4   ENV CARGO_CFG_TARGET_FEATURE=neon
#12 373.4   ENV CARGO_CFG_TARGET_FAMILY=unix
#12 373.4   ENV CARGO_CFG_TARGET_ENV=musl
#12 373.4   ENV CARGO_CFG_TARGET_ENDIAN=little
#12 373.4   ENV CARGO_CFG_TARGET_ARCH=aarch64
#12 373.4   ENV CARGO_CFG_PANIC=unwind
#12 373.4   ENV CARGO=/root/.rustup/toolchains/stable-x86_64-unknown-linux-gnu/bin/cargo
#12 373.4   ENV AR_aarch64_unknown_linux_musl=llvm-ar
#12 373.4   running "clang" "-O3" "-ffunction-sections" "-fdata-sections" "-fPIC" "--target=aarch64-unknown-linux-musl" "-I" "include" "-Wall" "-Wextra" "-pedantic" "-pedantic-errors" "-Wall" "-Wextra" "-Wcast-align" "-Wcast-qual" "-Wconversion" "-Wenum-compare" "-Wfloat-equal" "-Wformat=2" "-Winline" "-Winvalid-pch" "-Wmissing-field-initializers" "-Wmissing-include-dirs" "-Wredundant-decls" "-Wshadow" "-Wsign-compare" "-Wsign-conversion" "-Wundef" "-Wuninitialized" "-Wwrite-strings" "-fno-strict-aliasing" "-fvisibility=hidden" "-fstack-protector" "-g3" "-U_FORTIFY_SOURCE" "-DNDEBUG" "-c" "-o/jenkins/strck-cloud/target/aarch64-unknown-linux-musl/release/build/ring-6dbfdc74a1174779/out/aesv8-armx-linux64.o" "/root/.cargo/registry/src/gh.neting.cc-1ecc6299db9ec823/ring-0.16.15/pregenerated/aesv8-armx-linux64.S"
#12 373.4   running "clang" "-O3" "-ffunction-sections" "-fdata-sections" "-fPIC" "--target=aarch64-unknown-linux-musl" "-I" "include" "-Wall" "-Wextra" "-pedantic" "-pedantic-errors" "-Wall" "-Wextra" "-Wcast-align" "-Wcast-qual" "-Wconversion" "-Wenum-compare" "-Wfloat-equal" "-Wformat=2" "-Winline" "-Winvalid-pch" "-Wmissing-field-initializers" "-Wmissing-include-dirs" "-Wredundant-decls" "-Wshadow" "-Wsign-compare" "-Wsign-conversion" "-Wundef" "-Wuninitialized" "-Wwrite-strings" "-fno-strict-aliasing" "-fvisibility=hidden" "-fstack-protector" "-g3" "-U_FORTIFY_SOURCE" "-DNDEBUG" "-c" "-o/jenkins/strck-cloud/target/aarch64-unknown-linux-musl/release/build/ring-6dbfdc74a1174779/out/ghashv8-armx-linux64.o" "/root/.cargo/registry/src/gh.neting.cc-1ecc6299db9ec823/ring-0.16.15/pregenerated/ghashv8-armx-linux64.S"
#12 373.4   running "clang" "-O3" "-ffunction-sections" "-fdata-sections" "-fPIC" "--target=aarch64-unknown-linux-musl" "-I" "include" "-Wall" "-Wextra" "-pedantic" "-pedantic-errors" "-Wall" "-Wextra" "-Wcast-align" "-Wcast-qual" "-Wconversion" "-Wenum-compare" "-Wfloat-equal" "-Wformat=2" "-Winline" "-Winvalid-pch" "-Wmissing-field-initializers" "-Wmissing-include-dirs" "-Wredundant-decls" "-Wshadow" "-Wsign-compare" "-Wsign-conversion" "-Wundef" "-Wuninitialized" "-Wwrite-strings" "-fno-strict-aliasing" "-fvisibility=hidden" "-fstack-protector" "-g3" "-U_FORTIFY_SOURCE" "-DNDEBUG" "-c" "-o/jenkins/strck-cloud/target/aarch64-unknown-linux-musl/release/build/ring-6dbfdc74a1174779/out/vpaes-armv8-linux64.o" "/root/.cargo/registry/src/gh.neting.cc-1ecc6299db9ec823/ring-0.16.15/pregenerated/vpaes-armv8-linux64.S"
#12 373.4   running "clang" "-O3" "-ffunction-sections" "-fdata-sections" "-fPIC" "--target=aarch64-unknown-linux-musl" "-I" "include" "-Wall" "-Wextra" "-pedantic" "-pedantic-errors" "-Wall" "-Wextra" "-Wcast-align" "-Wcast-qual" "-Wconversion" "-Wenum-compare" "-Wfloat-equal" "-Wformat=2" "-Winline" "-Winvalid-pch" "-Wmissing-field-initializers" "-Wmissing-include-dirs" "-Wredundant-decls" "-Wshadow" "-Wsign-compare" "-Wsign-conversion" "-Wundef" "-Wuninitialized" "-Wwrite-strings" "-fno-strict-aliasing" "-fvisibility=hidden" "-fstack-protector" "-g3" "-U_FORTIFY_SOURCE" "-DNDEBUG" "-c" "-o/jenkins/strck-cloud/target/aarch64-unknown-linux-musl/release/build/ring-6dbfdc74a1174779/out/armv8-mont-linux64.o" "/root/.cargo/registry/src/gh.neting.cc-1ecc6299db9ec823/ring-0.16.15/pregenerated/armv8-mont-linux64.S"
#12 373.4   running "clang" "-O3" "-ffunction-sections" "-fdata-sections" "-fPIC" "--target=aarch64-unknown-linux-musl" "-I" "include" "-Wall" "-Wextra" "-pedantic" "-pedantic-errors" "-Wall" "-Wextra" "-Wcast-align" "-Wcast-qual" "-Wconversion" "-Wenum-compare" "-Wfloat-equal" "-Wformat=2" "-Winline" "-Winvalid-pch" "-Wmissing-field-initializers" "-Wmissing-include-dirs" "-Wredundant-decls" "-Wshadow" "-Wsign-compare" "-Wsign-conversion" "-Wundef" "-Wuninitialized" "-Wwrite-strings" "-fno-strict-aliasing" "-fvisibility=hidden" "-fstack-protector" "-g3" "-U_FORTIFY_SOURCE" "-DNDEBUG" "-c" "-o/jenkins/strck-cloud/target/aarch64-unknown-linux-musl/release/build/ring-6dbfdc74a1174779/out/chacha-armv8-linux64.o" "/root/.cargo/registry/src/gh.neting.cc-1ecc6299db9ec823/ring-0.16.15/pregenerated/chacha-armv8-linux64.S"
#12 373.4   running "clang" "-O3" "-ffunction-sections" "-fdata-sections" "-fPIC" "--target=aarch64-unknown-linux-musl" "-I" "include" "-Wall" "-Wextra" "-pedantic" "-pedantic-errors" "-Wall" "-Wextra" "-Wcast-align" "-Wcast-qual" "-Wconversion" "-Wenum-compare" "-Wfloat-equal" "-Wformat=2" "-Winline" "-Winvalid-pch" "-Wmissing-field-initializers" "-Wmissing-include-dirs" "-Wredundant-decls" "-Wshadow" "-Wsign-compare" "-Wsign-conversion" "-Wundef" "-Wuninitialized" "-Wwrite-strings" "-fno-strict-aliasing" "-fvisibility=hidden" "-fstack-protector" "-g3" "-U_FORTIFY_SOURCE" "-DNDEBUG" "-c" "-o/jenkins/strck-cloud/target/aarch64-unknown-linux-musl/release/build/ring-6dbfdc74a1174779/out/ecp_nistz256-armv8-linux64.o" "/root/.cargo/registry/src/gh.neting.cc-1ecc6299db9ec823/ring-0.16.15/pregenerated/ecp_nistz256-armv8-linux64.S"
#12 373.4   running "clang" "-O3" "-ffunction-sections" "-fdata-sections" "-fPIC" "--target=aarch64-unknown-linux-musl" "-I" "include" "-Wall" "-Wextra" "-pedantic" "-pedantic-errors" "-Wall" "-Wextra" "-Wcast-align" "-Wcast-qual" "-Wconversion" "-Wenum-compare" "-Wfloat-equal" "-Wformat=2" "-Winline" "-Winvalid-pch" "-Wmissing-field-initializers" "-Wmissing-include-dirs" "-Wredundant-decls" "-Wshadow" "-Wsign-compare" "-Wsign-conversion" "-Wundef" "-Wuninitialized" "-Wwrite-strings" "-fno-strict-aliasing" "-fvisibility=hidden" "-fstack-protector" "-g3" "-U_FORTIFY_SOURCE" "-DNDEBUG" "-c" "-o/jenkins/strck-cloud/target/aarch64-unknown-linux-musl/release/build/ring-6dbfdc74a1174779/out/ghash-neon-armv8-linux64.o" "/root/.cargo/registry/src/gh.neting.cc-1ecc6299db9ec823/ring-0.16.15/pregenerated/ghash-neon-armv8-linux64.S"
#12 373.4   running "clang" "-O3" "-ffunction-sections" "-fdata-sections" "-fPIC" "--target=aarch64-unknown-linux-musl" "-I" "include" "-Wall" "-Wextra" "-pedantic" "-pedantic-errors" "-Wall" "-Wextra" "-Wcast-align" "-Wcast-qual" "-Wconversion" "-Wenum-compare" "-Wfloat-equal" "-Wformat=2" "-Winline" "-Winvalid-pch" "-Wmissing-field-initializers" "-Wmissing-include-dirs" "-Wredundant-decls" "-Wshadow" "-Wsign-compare" "-Wsign-conversion" "-Wundef" "-Wuninitialized" "-Wwrite-strings" "-fno-strict-aliasing" "-fvisibility=hidden" "-fstack-protector" "-g3" "-U_FORTIFY_SOURCE" "-DNDEBUG" "-c" "-o/jenkins/strck-cloud/target/aarch64-unknown-linux-musl/release/build/ring-6dbfdc74a1174779/out/poly1305-armv8-linux64.o" "/root/.cargo/registry/src/gh.neting.cc-1ecc6299db9ec823/ring-0.16.15/pregenerated/poly1305-armv8-linux64.S"
#12 373.4   running "clang" "-O3" "-ffunction-sections" "-fdata-sections" "-fPIC" "--target=aarch64-unknown-linux-musl" "-I" "include" "-Wall" "-Wextra" "-pedantic" "-pedantic-errors" "-Wall" "-Wextra" "-Wcast-align" "-Wcast-qual" "-Wconversion" "-Wenum-compare" "-Wfloat-equal" "-Wformat=2" "-Winline" "-Winvalid-pch" "-Wmissing-field-initializers" "-Wmissing-include-dirs" "-Wredundant-decls" "-Wshadow" "-Wsign-compare" "-Wsign-conversion" "-Wundef" "-Wuninitialized" "-Wwrite-strings" "-fno-strict-aliasing" "-fvisibility=hidden" "-fstack-protector" "-g3" "-U_FORTIFY_SOURCE" "-DNDEBUG" "-c" "-o/jenkins/strck-cloud/target/aarch64-unknown-linux-musl/release/build/ring-6dbfdc74a1174779/out/sha512-armv8-linux64.o" "/root/.cargo/registry/src/gh.neting.cc-1ecc6299db9ec823/ring-0.16.15/pregenerated/sha512-armv8-linux64.S"
#12 373.4   running "clang" "-O3" "-ffunction-sections" "-fdata-sections" "-fPIC" "--target=aarch64-unknown-linux-musl" "-I" "include" "-Wall" "-Wextra" "-pedantic" "-pedantic-errors" "-Wall" "-Wextra" "-Wcast-align" "-Wcast-qual" "-Wconversion" "-Wenum-compare" "-Wfloat-equal" "-Wformat=2" "-Winline" "-Winvalid-pch" "-Wmissing-field-initializers" "-Wmissing-include-dirs" "-Wredundant-decls" "-Wshadow" "-Wsign-compare" "-Wsign-conversion" "-Wundef" "-Wuninitialized" "-Wwrite-strings" "-fno-strict-aliasing" "-fvisibility=hidden" "-fstack-protector" "-g3" "-U_FORTIFY_SOURCE" "-DNDEBUG" "-c" "-o/jenkins/strck-cloud/target/aarch64-unknown-linux-musl/release/build/ring-6dbfdc74a1174779/out/sha256-armv8-linux64.o" "/root/.cargo/registry/src/gh.neting.cc-1ecc6299db9ec823/ring-0.16.15/pregenerated/sha256-armv8-linux64.S"
#12 373.4   running "clang" "-O3" "-ffunction-sections" "-fdata-sections" "-fPIC" "--target=aarch64-unknown-linux-musl" "-I" "include" "-Wall" "-Wextra" "-std=c1x" "-Wbad-function-cast" "-Wnested-externs" "-Wstrict-prototypes" "-pedantic" "-pedantic-errors" "-Wall" "-Wextra" "-Wcast-align" "-Wcast-qual" "-Wconversion" "-Wenum-compare" "-Wfloat-equal" "-Wformat=2" "-Winline" "-Winvalid-pch" "-Wmissing-field-initializers" "-Wmissing-include-dirs" "-Wredundant-decls" "-Wshadow" "-Wsign-compare" "-Wsign-conversion" "-Wundef" "-Wuninitialized" "-Wwrite-strings" "-fno-strict-aliasing" "-fvisibility=hidden" "-fstack-protector" "-g3" "-U_FORTIFY_SOURCE" "-DNDEBUG" "-c" "-o/jenkins/strck-cloud/target/aarch64-unknown-linux-musl/release/build/ring-6dbfdc74a1174779/out/aes_nohw.o" "crypto/fipsmodule/aes/aes_nohw.c"
#12 373.4   In file included from crypto/fipsmodule/aes/aes_nohw.c:15:
#12 373.4   In file included from include/GFp/aes.h:52:
#12 373.4   include/GFp/base.h:117:1: error: static_assert failed due to requirement 'sizeof(unsigned long) == sizeof(unsigned int)' "uintptr_t and size_t differ."
#12 373.4   OPENSSL_STATIC_ASSERT(sizeof(size_t) == sizeof(uintptr_t), "uintptr_t and size_t differ.");
#12 373.4   ^                     ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
#12 373.4   include/GFp/type_check.h:71:42: note: expanded from macro 'OPENSSL_STATIC_ASSERT'
#12 373.4   #define OPENSSL_STATIC_ASSERT(cond, msg) _Static_assert(cond, msg)
#12 373.4                                            ^              ~~~~
#12 373.4   1 error generated.
#12 373.4   thread 'main' panicked at 'execution failed', /root/.cargo/registry/src/gh.neting.cc-1ecc6299db9ec823/ring-0.16.15/build.rs:664:9
#12 373.4   note: run with `RUST_BACKTRACE=1` environment variable to display a backtrace
#12 373.4 warning: build failed, waiting for other jobs to finish...
------
executor failed running [/bin/sh -c cargo build --release --target aarch64-unknown-linux-musl]: exit code: 101

Using docker with --platform=x86_64 in an m1 mac. Anything that I am missing?

briansmith · 2022-11-03T18:03:18Z

OPENSSL_STATIC_ASSERT(sizeof(size_t) == sizeof(uintptr_t), "uintptr_t and size_t differ.");

I'm guessing that something in your configuration is confusing clang about what headers to use.

In build.rs we have this:

    if (target.arch == "wasm32" && target.os == "unknown")
        || (target.os == "linux" && target.is_musl && target.arch != "x86_64")
    {
        if let Ok(compiler) = c.try_get_compiler() {
            // TODO: Expand this to non-clang compilers in 0.17.0 if practical.
            if compiler.is_like_clang() {
                let _ = c.flag("-nostdlibinc");
                let _ = c.define("RING_CORE_NOSTDLIBINC", "1");
            }
        }
    }

Try removing the && target.arch != "x86_64" and see if that helps you make progress.

vnghia · 2023-06-18T23:10:29Z

Not sure if this could help anyone but if you are using ring with sqlite, I successfully managed to make it work by using this.

ENV CC_aarch64_unknown_linux_musl="clang"
ENV AR_aarch64_unknown_linux_musl="llvm-ar"
ENV CFLAGS_aarch64_unknown_linux_musl="-nostdinc -nostdlib -isystem/usr/include/x86_64-linux-musl/"
ENV CARGO_TARGET_AARCH64_UNKNOWN_LINUX_MUSL_RUSTFLAGS="-Clink-self-contained=yes -Clinker=rust-lld -Clink-args=-L/usr/lib/x86_64-linux-musl/"

If we did not add this option, I found that clang used the header of gcc, more specifically headers inside /usr/include/x86_64-linux-gnu/ to compile even if the target is aarch64-unknown-linux-musl and leaded to something like fatal error: 'bits/libc-header-start.h' file not found while compiling with sqlite.

Maybe even if we don't use sqlite, IMHO this should be the default option because I had high CPU usage if I cross-compiled using

ENV CC_aarch64_unknown_linux_musl="clang"
ENV AR_aarch64_unknown_linux_musl="llvm-ar"
ENV CARGO_TARGET_AARCH64_UNKNOWN_LINUX_MUSL_RUSTFLAGS="-Clink-self-contained=yes -Clinker=rust-lld"

nyurik · 2023-09-29T03:45:43Z

I was able to solve all my compilation issues by using cross project:

cross build --release --target aarch64-unknown-linux-gnu ...
cross build --release --target aarch64-unknown-linux-musl ...

briansmith · 2023-09-29T17:26:37Z

Great! I am going to close this issue then.

### Change list - Update with a fix to not implement Fd support on Windows. From omerbenamram/pyo3-file#19. - Have to wait for redhat to get their shit together: https://status.redhat.com/incidents/qh68rjfg6xs6 - The aarch64 build is failing with ``error: failed to run custom build command for `ring v0.17.8` `` which looks to be briansmith/ring#1414.

JakkuSakura · 2024-04-21T15:40:04Z

it doesn't work using zigbuild though

Percivalll mentioned this issue Apr 19, 2022

arm64机器静态编译driver插件出错 bytedance/Elkeid#216

Closed

gaganyaan2 mentioned this issue Oct 29, 2022

kn - static binary build issue with openssl gaganyaan2/kx-kn-rust#3

Open

casey mentioned this issue Dec 10, 2022

Build releases for arm ordinals/ord#941

Merged

thejcannon mentioned this issue Mar 3, 2023

PyOxy release for linux aarch64? indygreg/PyOxidizer#689

Open

This was referenced Mar 13, 2023

Dockerfile broken exec /atomic-server-bin: no such file or directory atomicdata-dev/atomic-server#618

Closed

musl build for cross-platform docker images atomicdata-dev/atomic-server#620

Closed

This comment was marked as outdated.

Sign in to view

This was referenced Apr 14, 2023

Use Cross-Compile LemmyNet/lemmy#2806

Closed

Use official rust image and clean up Dockerfiles LemmyNet/lemmy#2804

Merged

MichaReiser mentioned this issue Apr 18, 2023

Use musl in ecosystem docker astral-sh/ruff#3998

Merged

vnghia mentioned this issue Jun 13, 2023

ci: add support for arm64 IgnisDa/ryot#130

Merged

briansmith closed this as completed Sep 29, 2023

franziskusz mentioned this issue Mar 8, 2024

Cross Compilation from macOS to Linux fails franziskusz/process-logger#1

Closed

kylebarron mentioned this issue Mar 22, 2024

Fix wheel builds geoarrow/geoarrow-rs#577

Merged

twitb1t mentioned this issue May 23, 2024

feat/support-multi-arch-releases Isawan/iam-assumer#18

Merged

mpaperno mentioned this issue Oct 23, 2024

Unable to build ring for aarch64-unknown-linux-musl #2127

Open

kylebarron mentioned this issue Dec 16, 2024

No manylinux aarch64 wheels for version 0.4.4 release kylebarron/arro3#276

Closed

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Can't compile ring with target aarch64-unknown-linux-musl #1414

Can't compile ring with target aarch64-unknown-linux-musl #1414

nuvanti commented Oct 13, 2021 •

edited

Loading

Leandros commented Oct 17, 2021

Leandros commented Oct 19, 2021

duaneking commented Nov 7, 2021 •

edited

Loading

jmfiaschi commented Nov 14, 2021 •

edited

Loading

duaneking commented Nov 15, 2021 •

edited

Loading

briansmith commented Nov 15, 2021

duaneking commented Nov 15, 2021 •

edited

Loading

briansmith commented Nov 16, 2021

duaneking commented Nov 16, 2021 •

edited

Loading

briansmith commented Nov 16, 2021 •

edited

Loading

briansmith commented Nov 16, 2021

duaneking commented Nov 16, 2021

WilliamVenner commented Jan 11, 2022

jensmeindertsma commented Feb 23, 2022

wiktor-k commented Mar 1, 2022 •

edited

Loading

jokeyrhyme commented Jul 3, 2022

sakibstark11 commented Nov 3, 2022

briansmith commented Nov 3, 2022

This comment was marked as outdated.

vnghia commented Jun 18, 2023 •

edited

Loading

nyurik commented Sep 29, 2023

briansmith commented Sep 29, 2023

JakkuSakura commented Apr 21, 2024

Can't compile ring with target aarch64-unknown-linux-musl #1414

Can't compile ring with target aarch64-unknown-linux-musl #1414

Comments

nuvanti commented Oct 13, 2021 • edited Loading

Leandros commented Oct 17, 2021

Leandros commented Oct 19, 2021

duaneking commented Nov 7, 2021 • edited Loading

jmfiaschi commented Nov 14, 2021 • edited Loading

duaneking commented Nov 15, 2021 • edited Loading

briansmith commented Nov 15, 2021

duaneking commented Nov 15, 2021 • edited Loading

briansmith commented Nov 16, 2021

duaneking commented Nov 16, 2021 • edited Loading

briansmith commented Nov 16, 2021 • edited Loading

briansmith commented Nov 16, 2021

duaneking commented Nov 16, 2021

WilliamVenner commented Jan 11, 2022

jensmeindertsma commented Feb 23, 2022

wiktor-k commented Mar 1, 2022 • edited Loading

jokeyrhyme commented Jul 3, 2022

sakibstark11 commented Nov 3, 2022

briansmith commented Nov 3, 2022

This comment was marked as outdated.

vnghia commented Jun 18, 2023 • edited Loading

nyurik commented Sep 29, 2023

briansmith commented Sep 29, 2023

JakkuSakura commented Apr 21, 2024

nuvanti commented Oct 13, 2021 •

edited

Loading

duaneking commented Nov 7, 2021 •

edited

Loading

jmfiaschi commented Nov 14, 2021 •

edited

Loading

duaneking commented Nov 15, 2021 •

edited

Loading

duaneking commented Nov 15, 2021 •

edited

Loading

duaneking commented Nov 16, 2021 •

edited

Loading

briansmith commented Nov 16, 2021 •

edited

Loading

wiktor-k commented Mar 1, 2022 •

edited

Loading

vnghia commented Jun 18, 2023 •

edited

Loading