Make https://static.rust-lang.org/cargo-dist browsable (i.e. add indexes)

[jirutka]

It’s kinda hard to find what snapshots are available when static.rust-lang.org doesn’t provide indexes.

Related to: rust-lang/rust#31322 (comment)

[alexcrichton]

cc @brson, @edunham

(I forget how the script otherwise runs here)

[brson]

I've modified update-rust-dist-index.sh on the build master to generate indexes for cargo-dist and ran it. Should be fixed.

[jirutka]

It's not, https://static.rust-lang.org/cargo-dist/ still returns an error message.

[japaric]

https://static.rust-lang.org/cargo-dist/index.html works but I'm seeing the same thing as https://static.rust-lang.org/dist/index.html

[alexcrichton]

@brson it looks like it's just uploading the same index twice, rather than regenerating for the cargo-dist dir?

[brson]

Uh, wow. My previous fix for this was all kinds of wrong. Should be working now. I've done the CDN invalidation on the main index.html but it could be 24 hours until some of the other pages are refreshed.

[jonhoo]

It looks like no builds from 2017 show up in the listing yet?

[alexcrichton]

We're no longer using buildbot for nightlies, so those archives won't be populated any more

[jirutka]

Yeah, nightlies are now on totally unpredictable URLs… 😕

[alexcrichton]

The historical process for building Cargo nightlies has been discontinued. There is a current process uploading to deterministic URLs at:

• https://s3.amazonaws.com/rust-lang-ci/cargo-builds/6f1b860da7aba4c5ea97a49de08a61f3f330e92d/cargo-nightly-x86_64-unknown-linux-gnu.tar.gz

We plan on also maybe discontinuing this process as the main rust-lang/rust repository will be responsible for building Cargo and distributing it.

[jirutka]

So how can we easily get the latest nightly...?

[alexcrichton]

https://static.rust-lang.org/dist/cargo-nightly-x86_64-unknown-linux-gnu.tar.gz

[jirutka]

Okay, but why https://static.rust-lang.org/dist/cargo-nightly-x86_64-unknown-linux-musl.tar.gz and https://static.rust-lang.org/dist/cargo-0.17.0-x86_64-unknown-linux-musl.tar.gz returns 404?

[alexcrichton]

rust-lang/rust isn't buliding musl cargo binaries

[sanmai-NL]

@alexcrichton https://static.rust-lang.org/cargo-dist/index.html seems to have fossilized ... Somewhere around 2016.