You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I want to get a stable eval result, however, when I eval the same checkpoint, I found different batch size (such as 32, 64) get different result, I try to set generation_temperature==0, however , the results still changes when I change the batch size from 60 to 32, how to prevent this thiing happening ?
I want to get a stable eval result, however, when I eval the same checkpoint, I found different batch size (such as 32, 64) get different result, I try to set generation_temperature==0, however , the results still changes when I change the batch size from 60 to 32, how to prevent this thiing happening ?
below is my command
The text was updated successfully, but these errors were encountered: