Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Crater runs for 1.48 #77970

Closed
Mark-Simulacrum opened this issue Oct 15, 2020 · 19 comments
Closed

Crater runs for 1.48 #77970

Mark-Simulacrum opened this issue Oct 15, 2020 · 19 comments
Labels
S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. T-release Relevant to the release subteam, which will review and decide on the PR/issue.

Comments

@Mark-Simulacrum
Copy link
Member

Note: Please do not conduct triage on these runs without discussing how to do so with a release team member first. Thanks!

@Mark-Simulacrum Mark-Simulacrum added the T-release Relevant to the release subteam, which will review and decide on the PR/issue. label Oct 15, 2020
@Mark-Simulacrum
Copy link
Member Author

@craterbot run name=beta-1.48-1 start=1.47.0 end=beta-2020-10-09 mode=build-and-test cap-lints=warn p=10

@craterbot
Copy link
Collaborator

👌 Experiment beta-1.48-1 created and queued.
🔍 You can check out the queue and this experiment's details.

ℹ️ Crater is a tool to run experiments across parts of the Rust ecosystem. Learn more

@craterbot craterbot added the S-waiting-on-crater Status: Waiting on a crater run to be completed. label Oct 15, 2020
@Mark-Simulacrum
Copy link
Member Author

@craterbot run name=beta-1.48-rustdoc-1 start=1.47.0 end=beta-2020-10-09 mode=rustdoc cap-lints=warn p=5

@craterbot
Copy link
Collaborator

👌 Experiment beta-1.48-rustdoc-1 created and queued.
🔍 You can check out the queue and this experiment's details.

ℹ️ Crater is a tool to run experiments across parts of the Rust ecosystem. Learn more

@craterbot
Copy link
Collaborator

🚧 Experiment beta-1.48-1 is now running

ℹ️ Crater is a tool to run experiments across parts of the Rust ecosystem. Learn more

@craterbot
Copy link
Collaborator

🚧 Experiment beta-1.48-rustdoc-1 is now running

ℹ️ Crater is a tool to run experiments across parts of the Rust ecosystem. Learn more

@craterbot
Copy link
Collaborator

🎉 Experiment beta-1.48-1 is completed!
📊 424 regressed and 53 fixed (126219 total)
📰 Open the full report.

⚠️ If you notice any spurious failure please add them to the blacklist!
ℹ️ Crater is a tool to run experiments across parts of the Rust ecosystem. Learn more

@craterbot craterbot added S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. and removed S-waiting-on-crater Status: Waiting on a crater run to be completed. labels Oct 19, 2020
@Mark-Simulacrum
Copy link
Member Author

I triaged the build failures from the crater run, but ran out of energy to open the ~245 test failures. I personally suspect many of them to be the uninitialized checking getting more stringent; I plan to finish this up later today hopefully.

Opened/tagged:

There's also a bunch of failures in build scripts due to old versions of crossbeam-epoch having UB around mem::uninitialized, but that's intentional/won't fix. I believe those folks should be a cargo update away from fixing the failure.

@Mark-Simulacrum
Copy link
Member Author

Mark-Simulacrum commented Oct 20, 2020

There's a bunch of segfaults/aborts etc -- 49 of them -- that I have not yet tried to diagnose, see https://gist.github.com/Mark-Simulacrum/d0759db08cd0528ae2762c1aecf04c37 for a list of log files. Beyond that I've triaged the rest of the test failures and those look good. I think for these it would be good to re-run crater on the subset and see how many of them are still present (which should be quick), I'll look at doing that shortly.

@Mark-Simulacrum
Copy link
Member Author

@craterbot run name=beta-1.48-2-subset start=1.47.0 end=beta-2020-10-16 mode=build-and-test cap-lints=warn p=10 crates=list:https://gist.githubusercontent.com/Mark-Simulacrum/ecfa4deb6ba7151067d71269ba567f30/raw/c0375bdc243814a9af60f0ff19ada599091ce8ad/gistfile1.txt

Hopefully this works...

@craterbot
Copy link
Collaborator

🚨 Error: missing desired crates: {"https://gist.githubusercontent.com/Mark-Simulacrum/ecfa4deb6ba7151067d71269ba567f30/raw/c0375bdc243814a9af60f0ff19ada599091ce8ad/gistfile1.txt"}

🆘 If you have any trouble with Crater please ping @rust-lang/infra!
ℹ️ Crater is a tool to run experiments across parts of the Rust ecosystem. Learn more

@Mark-Simulacrum
Copy link
Member Author

Huh. Not sure what's wrong there. @pietroalbini would you be able to find some time to take a look? I don't think it's super urgent but would be good to have this cycleish.

@pietroalbini
Copy link
Member

@craterbot run name=beta-1.48-2-subset start=1.47.0 end=beta-2020-10-16 mode=build-and-test cap-lints=warn p=10 crates=https://gist.githubusercontent.com/Mark-Simulacrum/ecfa4deb6ba7151067d71269ba567f30/raw/c0375bdc243814a9af60f0ff19ada599091ce8ad/gistfile1.txt

@craterbot
Copy link
Collaborator

👌 Experiment beta-1.48-2-subset created and queued.
🔍 You can check out the queue and this experiment's details.

ℹ️ Crater is a tool to run experiments across parts of the Rust ecosystem. Learn more

@craterbot craterbot added S-waiting-on-crater Status: Waiting on a crater run to be completed. and removed S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. labels Oct 20, 2020
@craterbot
Copy link
Collaborator

🚧 Experiment beta-1.48-2-subset is now running

ℹ️ Crater is a tool to run experiments across parts of the Rust ecosystem. Learn more

@craterbot
Copy link
Collaborator

🎉 Experiment beta-1.48-2-subset is completed!
📊 21 regressed and 2 fixed (47 total)
📰 Open the full report.

⚠️ If you notice any spurious failure please add them to the blacklist!
ℹ️ Crater is a tool to run experiments across parts of the Rust ecosystem. Learn more

@craterbot craterbot added S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. and removed S-waiting-on-crater Status: Waiting on a crater run to be completed. labels Oct 20, 2020
@Aaron1011
Copy link
Member

Aaron1011 commented Oct 20, 2020

The first segfault (ya2d2 in https://crater-reports.s3.amazonaws.com/beta-1.48-2-subset/beta-2020-10-16/gh/abhijat.ya2d2/log.txt) is caused by #71274 - an old version of crossbeam-epoch is in use. When mem::uninitialized triggers a panic, crossbeam-epoch ends up performing some raw pointer operations with the queue in an invalid state, leading to a segfault.

This is easier to see if the tests are run with cargo test -- --nocapture, since the initial panic message is otherwise hidden.

@craterbot
Copy link
Collaborator

🎉 Experiment beta-1.48-rustdoc-1 is completed!
📊 207 regressed and 1 fixed (126219 total)
📰 Open the full report.

⚠️ If you notice any spurious failure please add them to the blacklist!
ℹ️ Crater is a tool to run experiments across parts of the Rust ecosystem. Learn more

@RalfJung
Copy link
Member

RalfJung commented Oct 21, 2020

See this hackmd for the previous regression analysis of #71274. The vast majority of these cases has semver-compatible updates (in particular, everything caused by linked-hash-map), but I am not sure if crater has picked those up -- in the past I had trouble with crater using a broken version of a crate even when a fixed version was available.

We focused on crates though and mostly skipped GH repositories; in my prior experience, 100% of those regressions were one-off repositories of unmaintained code (things like advent of code) or the cause was in some dependency on crates.io, so there was little expected payoff from going over all of those as well. So there's nothing on ya2d2 in the hackmd.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
S-waiting-on-review Status: Awaiting review from the assignee but also interested parties. T-release Relevant to the release subteam, which will review and decide on the PR/issue.
Projects
None yet
Development

No branches or pull requests

5 participants