-
-
Notifications
You must be signed in to change notification settings - Fork 5.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
CI (Buildkite): use a TMPDIR
that is backed by real storage
#42995
Conversation
@staticfloat I am seeing the following test failure on several Buildkite jobs.
|
@@ -61,6 +61,11 @@ steps: | |||
unset JULIA_DEPOT_PATH | |||
unset JULIA_PKG_SERVER | |||
|
|||
# Make sure that temp files and temp directories are created in a location that is |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Why is this required?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Inside the Buildkite sandbox, the /tmp
directory lives on a tempfs that is backed by 1GB of RAM.
On certain Buildkite jobs (e.g. when we run the Pkg test suite with the Pkg server disabled), we end up cloning a lot of Git repos, and as a result we end up running out of space in the tempfs.
While /tmp
lives in the tempfs, the build directory (the current working directory to which the Julia repo has been cloned) is actually backed by a real filesystem. So we want to tell all programs to create temp files and temp directories inside our current working directory.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Increase the size of the tempfs?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
We could do that. I know that @staticfloat and @maleadt have expressed concerns about that in the past. We have multiple Buildkite agents on each machine, and we don't want to use up too much RAM.
d060bf2
to
0444910
Compare
0444910
to
0b2eba8
Compare
(cherry picked from commit f317d57)
(cherry picked from commit f317d57)
(cherry picked from commit f317d57)
(cherry picked from commit f317d57)
(cherry picked from commit f317d57)
…ang#42995) (cherry picked from commit f317d57)
(cherry picked from commit f317d57)
No description provided.