-
Notifications
You must be signed in to change notification settings - Fork 5.6k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
OpenBLAS doesn't support multi thread application #7234
Comments
Fixed at #7208. |
Do you have a crash log about it?
This is not totally correct. In FAQ, it uses
So if CPU cores is larger than trainer_count, using Besides, it will also effect MKL. Lines 84 to 86 in 5911644
|
Crash log:
You can reproduce it at this branch |
@tonyyang-svail I encounter some error when compile
|
@luotao1 Please change |
I can run successfully on the server when
|
@luotao1 which mul_op kernel are you using? please make sure it is the openBLAS kernel. |
I use latest develop branch + |
During the implementation of data parallelism, we found concurrent calls on OpenBLAS results in a crash without error messages. This issue has been discussed in the official FAQ here.
OpenBLAS usually gets its thread count from OMP_NUM_THREADS. So we decided to set the default OMP_NUM_THREADS to one. And print warnings if the user decides to set OMP_NUM_THREADS > 1.
The text was updated successfully, but these errors were encountered: