You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
All optimizers require the one-time initialization of some tensors like learning rate, accumulators etc. Currently we initialize them using fill_constant op, which is not correct. Once the new initialization design (#4852) is implemented, we need to change the initialization in optimizers.py.
The text was updated successfully, but these errors were encountered:
All optimizers require the one-time initialization of some tensors like learning rate, accumulators etc. Currently we initialize them using
fill_constant
op, which is not correct. Once the new initialization design (#4852) is implemented, we need to change the initialization in optimizers.py.The text was updated successfully, but these errors were encountered: