-
-
Notifications
You must be signed in to change notification settings - Fork 5.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
addprocs fails on Julia v1.8 triggering internal error #45434
Comments
does this happen on the nightly? |
On beta3 for me:
|
Tangentially, isn't it a bit much for Profile to allocate 76 MB for every process getting started, even if Profile is not used? |
The error I got above was on a VM, when I run it on my real Windows install (with more resources) I don't have an issue:
|
Yes, with slightly different error messages, but more severe consequences. PC appears to lock up.
Have you tried |
It crashes then. I'll try to bisect it. |
Hm, but I get this on 1.7 as well:
|
The amount Profile allocates doesn't seem to have changed. In fact we use this logic:
so on windows we should be passing the same value as before. Maybe random based on system conditions? |
That is almost entirely due to OpenBLAS, to run on threads. We commit about 285 MB, then OpenBLAS commits about 915 MB. It goes away if you set |
The threads used to be somewhat lazily allocated, but that was removed in #42442, and that logic has not been restored, despite several PRs that attempted to do so, but which misunderstood the problem, and existing known solution, and it did not restore the test deleted by that PR (#45412, #42470, and to a lesser extent #30004) |
n.b. that OpenBLAS memory usage scales fast as the product of the maximum number of threads configured and the current number of threads visible at startup, which was temporarily increased by JuliaPackaging/Yggdrasil#3667, before being changed back to the old default |
I don't see how that used to be lazily allocated. Isn't the only change the number of buffers OpenBLAS end up creating, not lazy vs eager? |
It used to set the initial thread count, then initialize openblas. Now it initializes openblas, then restricts the threads it can use. But openblas knows how to start them up lazily, it just doesn't. |
Seems like this should be a 1.9 release blocker? |
FYI: This may be fixed by #47803 (comment). Just commenting redundantly, I see it doesn't go to top of issue list by Kristoffer linking to it (nor if I sort by recent, I suppose it will now with my comment). |
I believe this is fixed by #47803. Please comment if this is still an issue on Julia master (or 1.8.4) when that comes out. |
addprocs()
causes an error on Julia v1.8 (Windows 10).It works as expected on Julia v1.6 and v1.7.
Error messages are not always the same, but always seems to be some sort on internal error.
Might be hitting some resource limit (memory?)
Since it works fine on earlier Julia versions, I was looking for any pointers to what changed in Julia v1.8, and any tips on how to further diagnose the issue?
Error message
The text was updated successfully, but these errors were encountered: