-
Notifications
You must be signed in to change notification settings - Fork 1.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Running tests uses 50.1GB of disk space on Ubuntu #11105
Comments
On Ubuntu, $ lsb_release -rc
Release: 22.04
Codename: jammy After $ du -h -d2 target
4.0K target/tmp
6.1G target/debug/incremental
12M target/debug/.fingerprint
337M target/debug/build
16G target/debug/deps
28G target/debug/examples
50G target/debug
50G target |
Not sure what I've done (except run tests more times): Update, not using 103GB. Seeing this nice error:
|
The more you run, the more artifacts in /target is. |
Yeah, I think this obscene use of temp space is an artifact of rust (rather than an artifact of datafusion specifically) |
It would also help if we consolidated some of the example binaries: #11172 |
I filed a few tickets to start consolidating the examples which i think will help: |
Describe the bug
I just cloned datafusion and tried
cargo t
on my ubuntu desktop, to check things were working properly.It crashed.
I restarted, and it seems datafusion is using 50.1GB to just run tests.
The
examples
directory seems to be the biggest culpret.To Reproduce
Just clone and run
cargo t
on Ubuntu (no idea if this is limited to linux).Expected behavior
Humm, I guess in principle this isn't a show stopper, but seems somewhat unfortunate.
If there's an easy/low impact way to reduce disk usage, it might be useful.
Additional context
No response
The text was updated successfully, but these errors were encountered: