Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

libFuzzer fuzzer-leak.test and fuzzer-finalstats.test are unstable #97712

Open
DavidSpickett opened this issue Jul 4, 2024 · 4 comments
Open

Comments

@DavidSpickett
Copy link
Collaborator

compiler-rt/test/fuzzer/fuzzer-leak.test has been the cause of a lot of unrelated failures since buildbot started posting statues to PRs.

For example: #97397 (comment)

I know in general this test can be sensitive to the resources available on the machine at the time, but perhaps something can be done to make it deterministic?

DavidSpickett added a commit that referenced this issue Jul 4, 2024
This has been flaky and reporting a lot of unrelated failures to PRs.

See #97712
@DavidSpickett
Copy link
Collaborator Author

DavidSpickett commented Jul 4, 2024

@kcc

(apologies for the blunt approach here just disabling it completely, I'm not very familiar with the internal workings of the fuzzer)

@DavidSpickett
Copy link
Collaborator Author

DavidSpickett commented Jul 4, 2024

#97396 (comment)
#97513 (comment)
#97259 (comment)
#97047 (comment)
#94705 (comment)
#96305 (comment)

Some more examples, in case any pattern emerges when looking at the build times/worker names/etc.

kbluck pushed a commit to kbluck/llvm-project that referenced this issue Jul 6, 2024
This has been flaky and reporting a lot of unrelated failures to PRs.

See llvm#97712
DavidSpickett added a commit that referenced this issue Jul 9, 2024
This test is flaky and has been reporting irrelevant failures to PRs
on Github for example:
#97829 (comment)
https://lab.llvm.org/buildbot/#/builders/66/builds/1159

Adding this to #97712.
@DavidSpickett DavidSpickett changed the title libFuzzer fuzzer-leak.test is unstable libFuzzer fuzzer-leak.test and fuzzer-finalstats.test are unstable Jul 9, 2024
@DavidSpickett
Copy link
Collaborator Author

Also temporarily disabled compiler-rt/test/fuzzer/fuzzer-finalstats.test for the same reasons.

@DavidSpickett
Copy link
Collaborator Author

finalstats potentially fixed by #96914

aaryanshukla pushed a commit to aaryanshukla/llvm-project that referenced this issue Jul 14, 2024
This test is flaky and has been reporting irrelevant failures to PRs
on Github for example:
llvm#97829 (comment)
https://lab.llvm.org/buildbot/#/builders/66/builds/1159

Adding this to llvm#97712.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant